Sponsoring The Perl Toolchain Summit 2025: Help make this important event another success Learn more

NAME

Bencher::Scenario::ShellGuess::Overhead - Benchmark the startup overhead of guessing shell

VERSION

This document describes version 0.003 of Bencher::Scenario::ShellGuess::Overhead (from Perl distribution Bencher-Scenarios-ShellGuess), released on 2021-07-31.

SYNOPSIS

To run benchmark with default option:

% bencher -m ShellGuess::Overhead

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARK PARTICIPANTS

  • load Shell::Guess (command)

  • load Shell::Guess + running_shell (command)

  • perl (baseline) (command)

BENCHMARK SAMPLE RESULTS

Sample benchmark #1

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores), OS: GNU/Linux Debian version 8.0, OS kernel: Linux version 3.16.0-4-amd64.

Benchmark command (under bash):

%

Result formatted as table:

#table1#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell | 98 | 10 | 0 | 3.74052667964341 | 3.8e-05 | 21 |
| load Shell::Guess | 100 | 9.7 | 0.0517047248148278 | 3.50746922381476 | 3e-05 | 20 |
| perl (baseline) | 460 | 2.2 | 3.74052667964341 | 0 | 1.1e-05 | 20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)
load Shell::Guess + running_shell 98/s -- -3% -78%
load Shell::Guess 100/s 3% -- -77%
perl (baseline) 460/s 354% 340% --
Legends:
load Shell::Guess: participant=load Shell::Guess
load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #2

Benchmark command (under fish):

%

Result formatted as table:

#table2#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell | 99 | 10 | 0 | 4.50965048854215 | 4.6e-05 | 21 |
| load Shell::Guess | 100 | 9.7 | 0.0452853002877057 | 4.27095376451354 | 3.4e-05 | 20 |
| perl (baseline) | 550 | 1.8 | 4.50965048854215 | 0 | 6.6e-06 | 21 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)
load Shell::Guess + running_shell 99/s -- -3% -82%
load Shell::Guess 100/s 3% -- -81%
perl (baseline) 550/s 455% 438% --
Legends:
load Shell::Guess: participant=load Shell::Guess
load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #3

Benchmark command (under tcsh ('c')):

%

Result formatted as table:

#table3#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| load Shell::Guess + running_shell | 100 | 10 | 0 | 3.66106761739065 | 4.6e-05 | 20 |
| load Shell::Guess | 100 | 9.7 | 0.0311256049185042 | 3.52036841598851 | 4.7e-05 | 20 |
| perl (baseline) | 500 | 2 | 3.66106761739065 | 0 | 4.7e-05 | 20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

The above result formatted in Benchmark.pm style:

Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)
load Shell::Guess + running_shell 100/s -- -3% -80%
load Shell::Guess 100/s 3% -- -79%
perl (baseline) 500/s 400% 384% --
Legends:
load Shell::Guess: participant=load Shell::Guess
load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
perl (baseline): participant=perl (baseline)

The above result presented as chart:

Sample benchmark #4

Benchmark command (under zsh ('z')):

%

Result formatted as table:

#table4#
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
| load Shell::Guess | 100 | 10 | 0 | 4.17013158922127 | 0.00011 | 20 |
| load Shell::Guess + running_shell | 99 | 10 | 0.0309140475235712 | 4.01509471293053 | 5e-05 | 20 |
| perl (baseline) | 500 | 2 | 4.17013158922127 | 0 | 2.6e-05 | 20 |
+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+

The above result formatted in Benchmark.pm style:

Rate load Shell::Guess load Shell::Guess + running_shell perl (baseline)
load Shell::Guess 100/s -- 0% -80%
load Shell::Guess + running_shell 99/s 0% -- -80%
perl (baseline) 500/s 400% 400% --
Legends:
load Shell::Guess: participant=load Shell::Guess
load Shell::Guess + running_shell: participant=load Shell::Guess + running_shell
perl (baseline): participant=perl (baseline)

The above result presented as chart:

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-ShellGuess.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-ShellGuess.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-ShellGuess

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

SEE ALSO

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2021, 2017, 2016 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.