NAME
Bencher::Scenario::ShellGuess::Overhead - Benchmark the startup overhead of guessing shell
VERSION
This document describes version 0.003 of Bencher::Scenario::ShellGuess::Overhead (from Perl distribution Bencher-Scenarios-ShellGuess), released on 2021-07-31.
SYNOPSIS
To run benchmark with default option:
% bencher -m ShellGuess::Overhead
For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARK PARTICIPANTS
load Shell::Guess (command)
load Shell::Guess + running_shell (command)
perl (baseline) (command)
BENCHMARK SAMPLE RESULTS
Sample benchmark #1
Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores), OS: GNU/Linux Debian version 8.0, OS kernel: Linux version 3.16.0-4-amd64.
Benchmark command (under bash):
%
Result formatted as table:
#table1#+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| participant | rate (/s) |time(ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| load Shell::Guess + running_shell | 98 | 10 | 0 | 3.74052667964341 | 3.8e-05 | 21 || load Shell::Guess | 100 | 9.7 | 0.0517047248148278 | 3.50746922381476 | 3e-05 | 20 || perl (baseline) | 460 | 2.2 | 3.74052667964341 | 0 | 1.1e-05 | 20 |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
The above result formatted in Benchmark.pm style:
Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)load Shell::Guess + running_shell 98/s -- -3% -78%load Shell::Guess 100/s 3% -- -77%perl (baseline) 460/s 354% 340% --Legends:load Shell::Guess: participant=load Shell::Guessload Shell::Guess + running_shell: participant=load Shell::Guess + running_shellperl (baseline): participant=perl (baseline)
The above result presented as chart:
Sample benchmark #2
Benchmark command (under fish):
%
Result formatted as table:
#table2#+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| participant | rate (/s) |time(ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| load Shell::Guess + running_shell | 99 | 10 | 0 | 4.50965048854215 | 4.6e-05 | 21 || load Shell::Guess | 100 | 9.7 | 0.0452853002877057 | 4.27095376451354 | 3.4e-05 | 20 || perl (baseline) | 550 | 1.8 | 4.50965048854215 | 0 | 6.6e-06 | 21 |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
The above result formatted in Benchmark.pm style:
Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)load Shell::Guess + running_shell 99/s -- -3% -82%load Shell::Guess 100/s 3% -- -81%perl (baseline) 550/s 455% 438% --Legends:load Shell::Guess: participant=load Shell::Guessload Shell::Guess + running_shell: participant=load Shell::Guess + running_shellperl (baseline): participant=perl (baseline)
The above result presented as chart:
Sample benchmark #3
Benchmark command (under tcsh ('c')):
%
Result formatted as table:
#table3#+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| participant | rate (/s) |time(ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+| load Shell::Guess + running_shell | 100 | 10 | 0 | 3.66106761739065 | 4.6e-05 | 20 || load Shell::Guess | 100 | 9.7 | 0.0311256049185042 | 3.52036841598851 | 4.7e-05 | 20 || perl (baseline) | 500 | 2 | 3.66106761739065 | 0 | 4.7e-05 | 20 |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
The above result formatted in Benchmark.pm style:
Rate load Shell::Guess + running_shell load Shell::Guess perl (baseline)load Shell::Guess + running_shell 100/s -- -3% -80%load Shell::Guess 100/s 3% -- -79%perl (baseline) 500/s 400% 384% --Legends:load Shell::Guess: participant=load Shell::Guessload Shell::Guess + running_shell: participant=load Shell::Guess + running_shellperl (baseline): participant=perl (baseline)
The above result presented as chart:
Sample benchmark #4
Benchmark command (under zsh ('z')):
%
Result formatted as table:
#table4#+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+| participant | rate (/s) |time(ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+| load Shell::Guess | 100 | 10 | 0 | 4.17013158922127 | 0.00011 | 20 || load Shell::Guess + running_shell | 99 | 10 | 0.0309140475235712 | 4.01509471293053 | 5e-05 | 20 || perl (baseline) | 500 | 2 | 4.17013158922127 | 0 | 2.6e-05 | 20 |+-----------------------------------+-----------+-----------+-----------------------+-----------------------+-----------+---------+
The above result formatted in Benchmark.pm style:
Rate load Shell::Guess load Shell::Guess + running_shell perl (baseline)load Shell::Guess 100/s -- 0% -80%load Shell::Guess + running_shell 99/s 0% -- -80%perl (baseline) 500/s 400% 400% --Legends:load Shell::Guess: participant=load Shell::Guessload Shell::Guess + running_shell: participant=load Shell::Guess + running_shellperl (baseline): participant=perl (baseline)
The above result presented as chart:
To display as an interactive HTML table on a browser, you can add option --format html+datatables.
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-ShellGuess.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-ShellGuess.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-ShellGuess
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
SEE ALSO
AUTHOR
perlancar <perlancar@cpan.org>
COPYRIGHT AND LICENSE
This software is copyright (c) 2021, 2017, 2016 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.