/ 
Bencher-Scenario-CmdLineParsingModules-0.05
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::CmdLineParsingModules

NAME

Bencher::Scenario::CmdLineParsingModules - Benchmark command-line parsing modules

VERSION

This document describes version 0.05 of Bencher::Scenario::CmdLineParsingModules (from Perl distribution Bencher-Scenario-CmdLineParsingModules), released on 2017-01-25.

SYNOPSIS

To run benchmark with default option:

% bencher -m CmdLineParsingModules

To run module startup overhead benchmark:

% bencher --module-startup -m CmdLineParsingModules

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Complete::Bash 0.31

Parse::CommandLine 0.02

BENCHMARK PARTICIPANTS

  • Parse::CommandLine::parse_command_line (perl_code)

    Function call template:

    Parse::CommandLine::parse_command_line(<cmdline>)

  • Complete::Bash::parse_cmdline (perl_code)

    Function call template:

    Complete::Bash::parse_cmdline(<cmdline>, 0)

BENCHMARK DATASETS

  • empty

  • cmd-only

  • 2args-simple

  • 4args

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) M-5Y71 CPU @ 1.20GHz (2 cores), OS: GNU/Linux LinuxMint version 17.3, OS kernel: Linux version 3.19.0-32-generic.

Benchmark with default options (bencher -m CmdLineParsingModules):

#table1#
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| participant                            | dataset      | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| Parse::CommandLine::parse_command_line | 4args        |     34400 | 29.1      |      1     | 1.2e-08 |      23 |
| Complete::Bash::parse_cmdline          | 4args        |     37600 | 26.6      |      1.09  | 1.3e-08 |      20 |
| Complete::Bash::parse_cmdline          | 2args-simple |     93300 | 10.7      |      2.71  | 3.1e-09 |      23 |
| Parse::CommandLine::parse_command_line | 2args-simple |    140000 |  7.4      |      4     |   1e-08 |      33 |
| Complete::Bash::parse_cmdline          | cmd-only     |    200000 |  4.9      |      5.9   | 1.8e-08 |      30 |
| Parse::CommandLine::parse_command_line | cmd-only     |    353000 |  2.83     |     10.3   | 7.5e-10 |      25 |
| Complete::Bash::parse_cmdline          | empty        |    680000 |  1.5      |     20     | 6.5e-09 |      21 |
| Parse::CommandLine::parse_command_line | empty        |   2949840 |  0.339001 |     85.764 |   0     |      20 |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+

Benchmark module startup overhead (bencher -m CmdLineParsingModules --module-startup):

#table2#
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| participant         | proc_private_dirty_size (MB) | proc_rss_size (MB) | proc_size (MB) | time (ms) | mod_overhead_time (ms) | vs_slowest |  errors | samples |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| Complete::Bash      | 0.83                         | 4.1                | 16             |       9   |                    4.1 |        1   |   2e-05 |      23 |
| Parse::CommandLine  | 1.1                          | 4.5                | 16             |       8.8 |                    3.9 |        1   | 3.7e-05 |      20 |
| perl -e1 (baseline) | 1                            | 4.3                | 16             |       4.9 |                    0   |        1.8 | 1.3e-05 |      21 |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-CmdLineParsingModules.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-CmdLineParsingModules.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-CmdLineParsingModules

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2017 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.