The London Perl and Raku Workshop takes place on 26th Oct 2024. If your company depends on Perl, please consider sponsoring and/or attending.
 / 
Bencher-ScenarioBundle-SmartMatch-0.001
River stage zero No dependents
/ Bencher::Scenario::Switch::Startup

NAME

Bencher::Scenario::Switch::Startup - Benchmark the startup overhead of various switch modules

VERSION

This document describes version 0.001 of Bencher::Scenario::Switch::Startup (from Perl distribution Bencher-ScenarioBundle-SmartMatch), released on 2024-07-02.

SYNOPSIS

To run benchmark with default option:

 % bencher -m Switch::Startup

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Switch::Right 0.000005

Switch::Back 0.000002

Switch::Perlish 1.0.5

Switch::Plain 0.0501

BENCHMARK PARTICIPANTS

BENCHMARK SAMPLE RESULTS

Sample benchmark #1

Run on: perl: v5.38.2, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.4.0-164-generic.

Benchmark command (default options):

 % bencher -m Switch::Startup

Result formatted as table:

 #table1#
 +---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+
 | participant         | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors  | samples |
 +---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+
 | Switch::Right       |    760    |            753.16 |                 0.00% |             10969.46% |   0.0028 |      20 |
 | Switch::Back        |    620    |            613.16 |                21.83% |              8985.69% |   0.001  |      20 |
 | Switch::Perlish     |     20    |             13.16 |              3767.04% |               186.25% | 2.5e-05  |      20 |
 | Switch::Plain       |     13.2  |              6.36 |              5643.72% |                92.72% | 7.1e-06  |      20 |
 | perl -e1 (baseline) |      6.84 |              0    |             10969.46% |                 0.00% | 5.3e-06  |      20 |
 +---------------------+-----------+-------------------+-----------------------+-----------------------+----------+---------+

The above result formatted in Benchmark.pm style:

                          Rate  Switch::Right  Switch::Back  Switch::Perlish  Switch::Plain  perl -e1 (baseline) 
  Switch::Right          1.3/s             --          -18%             -97%           -98%                 -99% 
  Switch::Back           1.6/s            22%            --             -96%           -97%                 -98% 
  Switch::Perlish       50.0/s          3700%         3000%               --           -34%                 -65% 
  Switch::Plain         75.8/s          5657%         4596%              51%             --                 -48% 
  perl -e1 (baseline)  146.2/s         11011%         8964%             192%            92%                   -- 
 
 Legends:
   Switch::Back: mod_overhead_time=613.16 participant=Switch::Back
   Switch::Perlish: mod_overhead_time=13.16 participant=Switch::Perlish
   Switch::Plain: mod_overhead_time=6.36 participant=Switch::Plain
   Switch::Right: mod_overhead_time=753.16 participant=Switch::Right
   perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

BENCHMARK NOTES

So, as I suspected, Switch::Right and Switch::Back has a large startup overhead, too large for my taste. Won't be using them anytime soon.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-ScenarioBundle-SmartMatch.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-ScenarioBundle-SmartMatch.

AUTHOR

perlancar <perlancar@cpan.org>

CONTRIBUTING

To contribute, you can send patches by email/via RT, or send pull requests on GitHub.

Most of the time, you don't need to build the distribution yourself. You can simply modify the code, then test via:

 % prove -l

If you want to build the distribution (e.g. to try to install it locally on your system), you can install Dist::Zilla, Dist::Zilla::PluginBundle::Author::PERLANCAR, Pod::Weaver::PluginBundle::Author::PERLANCAR, and sometimes one or two other Dist::Zilla- and/or Pod::Weaver plugins. Any additional steps required beyond that are considered a bug and can be reported to me.

COPYRIGHT AND LICENSE

This software is copyright (c) 2024 by perlancar <perlancar@cpan.org>.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-ScenarioBundle-SmartMatch

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.