/ 
Bencher-Scenario-CmdLineParsingModules-0.06
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::CmdLineParsingModules

NAME

Bencher::Scenario::CmdLineParsingModules - Benchmark command-line parsing modules

VERSION

This document describes version 0.06 of Bencher::Scenario::CmdLineParsingModules (from Perl distribution Bencher-Scenario-CmdLineParsingModules), released on 2017-01-25.

SYNOPSIS

To run benchmark with default option:

% bencher -m CmdLineParsingModules

To run module startup overhead benchmark:

% bencher --module-startup -m CmdLineParsingModules

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Complete::Bash 0.31

Parse::CommandLine 0.02

BENCHMARK PARTICIPANTS

  • Parse::CommandLine::parse_command_line (perl_code)

    Function call template:

    Parse::CommandLine::parse_command_line(<cmdline>)

  • Complete::Bash::parse_cmdline (perl_code)

    Function call template:

    Complete::Bash::parse_cmdline(<cmdline>, 0)

BENCHMARK DATASETS

  • empty

  • cmd-only

  • 2args-simple

  • 4args

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) M-5Y71 CPU @ 1.20GHz (2 cores), OS: GNU/Linux LinuxMint version 17.3, OS kernel: Linux version 3.19.0-32-generic.

Benchmark with default options (bencher -m CmdLineParsingModules):

#table1#
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| participant                            | dataset      | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| Parse::CommandLine::parse_command_line | 4args        |     34000 | 29.4      |     1      | 1.2e-08 |      24 |
| Complete::Bash::parse_cmdline          | 4args        |     38100 | 26.2      |     1.12   | 1.3e-08 |      20 |
| Complete::Bash::parse_cmdline          | 2args-simple |     93000 | 11        |     2.7    | 1.3e-08 |      20 |
| Parse::CommandLine::parse_command_line | 2args-simple |    137000 |  7.29     |     4.03   | 3.3e-09 |      20 |
| Complete::Bash::parse_cmdline          | cmd-only     |    220000 |  4.5      |     6.5    | 6.5e-09 |      21 |
| Parse::CommandLine::parse_command_line | cmd-only     |    354000 |  2.82     |    10.4    | 6.7e-10 |      31 |
| Complete::Bash::parse_cmdline          | empty        |   1300000 |  0.8      |    37      | 1.7e-09 |      20 |
| Parse::CommandLine::parse_command_line | empty        |   2949820 |  0.339004 |    86.6955 |   0     |      20 |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+

Benchmark module startup overhead (bencher -m CmdLineParsingModules --module-startup):

#table2#
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| participant         | proc_private_dirty_size (MB) | proc_rss_size (MB) | proc_size (MB) | time (ms) | mod_overhead_time (ms) | vs_slowest |  errors | samples |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| Parse::CommandLine  | 1.1                          | 4.4                | 16             |       9.5 |                    4   |        1   | 3.9e-05 |      20 |
| Complete::Bash      | 0.82                         | 4.1                | 16             |       9.4 |                    3.9 |        1   | 1.8e-05 |      20 |
| perl -e1 (baseline) | 1                            | 4.5                | 16             |       5.5 |                    0   |        1.7 | 1.5e-05 |      20 |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-CmdLineParsingModules.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-CmdLineParsingModules.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-CmdLineParsingModules

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2017 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.