/ 
Bencher-Scenario-CmdLineParsingModules-0.07
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::CmdLineParsingModules

NAME

Bencher::Scenario::CmdLineParsingModules - Benchmark command-line parsing modules

VERSION

This document describes version 0.07 of Bencher::Scenario::CmdLineParsingModules (from Perl distribution Bencher-Scenario-CmdLineParsingModules), released on 2017-05-24.

SYNOPSIS

To run benchmark with default option:

% bencher -m CmdLineParsingModules

To run module startup overhead benchmark:

% bencher --module-startup -m CmdLineParsingModules

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Complete::Bash 0.31

Parse::CommandLine 0.02

Text::ParseWords 3.30

BENCHMARK PARTICIPANTS

  • Parse::CommandLine::parse_command_line (perl_code)

    Function call template:

    Parse::CommandLine::parse_command_line(<cmdline>)

  • Complete::Bash::parse_cmdline (perl_code)

    Function call template:

    Complete::Bash::parse_cmdline(<cmdline>, 0)

  • Text::ParseWords::shellwords (perl_code)

    Function call template:

    Text::ParseWords::shellwords(<cmdline>)

BENCHMARK DATASETS

  • empty

  • cmd-only

  • 2args-simple

  • 4args

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) M-5Y71 CPU @ 1.20GHz (2 cores), OS: GNU/Linux LinuxMint version 17.3, OS kernel: Linux version 3.19.0-32-generic.

Benchmark with default options (bencher -m CmdLineParsingModules):

#table1#
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| participant                            | dataset      | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+
| Parse::CommandLine::parse_command_line | 4args        |     34000 |   29      |       1    | 5.3e-08 |      20 |
| Text::ParseWords::shellwords           | 4args        |     34000 |   29      |       1    | 5.3e-08 |      20 |
| Complete::Bash::parse_cmdline          | 4args        |     38400 |   26.1    |       1.13 | 1.3e-08 |      20 |
| Text::ParseWords::shellwords           | 2args-simple |     83700 |   11.9    |       2.46 |   1e-08 |      20 |
| Complete::Bash::parse_cmdline          | 2args-simple |     93400 |   10.7    |       2.74 | 2.9e-09 |      26 |
| Parse::CommandLine::parse_command_line | 2args-simple |    130000 |    7.8    |       3.8  | 2.2e-08 |      37 |
| Complete::Bash::parse_cmdline          | cmd-only     |    214000 |    4.67   |       6.28 | 1.7e-09 |      20 |
| Text::ParseWords::shellwords           | cmd-only     |    216000 |    4.62   |       6.35 | 1.7e-09 |      20 |
| Parse::CommandLine::parse_command_line | cmd-only     |    358000 |    2.79   |      10.5  | 7.9e-10 |      22 |
| Text::ParseWords::shellwords           | empty        |   1181000 |    0.8466 |      34.66 |   1e-11 |      20 |
| Complete::Bash::parse_cmdline          | empty        |   1276000 |    0.7839 |      37.43 | 2.9e-11 |      20 |
| Parse::CommandLine::parse_command_line | empty        |   3000000 |    0.34   |      87    | 6.1e-10 |      21 |
+----------------------------------------+--------------+-----------+-----------+------------+---------+---------+

Benchmark module startup overhead (bencher -m CmdLineParsingModules --module-startup):

#table2#
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| participant         | proc_private_dirty_size (MB) | proc_rss_size (MB) | proc_size (MB) | time (ms) | mod_overhead_time (ms) | vs_slowest |  errors | samples |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| Complete::Bash      | 0.99                         | 4.4                | 16             |       8.2 |                    4.1 |        1   | 2.3e-05 |      20 |
| Parse::CommandLine  | 1.1                          | 4.4                | 16             |       8   |                    3.9 |        1   | 2.4e-05 |      20 |
| Text::ParseWords    | 0.82                         | 4.1                | 16             |       7.5 |                    3.4 |        1.1 | 2.2e-05 |      20 |
| perl -e1 (baseline) | 1                            | 4.4                | 16             |       4.1 |                    0   |        2   | 5.8e-06 |      20 |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-CmdLineParsingModules.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-CmdLineParsingModules.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-CmdLineParsingModules

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2017, 2016, 2015 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.