NAME
Bencher::Scenario::Perl::Startup - Benchmark startup time of perls
VERSION
This document describes version 0.053 of Bencher::Scenario::Perl::Startup (from Perl distribution Bencher-Scenario-Perl-Startup), released on 2021-07-23.
SYNOPSIS
To run benchmark with default option:
% bencher -m Perl::Startup
For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help
.
DESCRIPTION
Conclusion: in general newer versions of perl has larger startup overhead than previous ones. If startup overhead is important to you, use -e
instead of -E
unless necessary.
BENCHMARK PARTICIPANTS
perl-5.34.0 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.34.0/bin/perl -e1
perl-5.34.0 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.34.0/bin/perl -E1
perl-5.32.1 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.32.1/bin/perl -e1
perl-5.32.1 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.32.1/bin/perl -E1
perl-5.30.3 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.30.3/bin/perl -e1
perl-5.30.3 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.30.3/bin/perl -E1
perl-5.30.0 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.30.0/bin/perl -e1
perl-5.30.0 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.30.0/bin/perl -E1
perl-5.28.3 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.28.3/bin/perl -e1
perl-5.28.3 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.28.3/bin/perl -E1
perl-5.26.3 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.26.3/bin/perl -e1
perl-5.26.3 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.26.3/bin/perl -E1
perl-5.24.4 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.24.4/bin/perl -e1
perl-5.24.4 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.24.4/bin/perl -E1
perl-5.22.4 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.22.4/bin/perl -e1
perl-5.22.4 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.22.4/bin/perl -E1
perl-5.20.3 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.20.3/bin/perl -e1
perl-5.20.3 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.20.3/bin/perl -E1
perl-5.18.4 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.18.4/bin/perl -e1
perl-5.18.4 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.18.4/bin/perl -E1
perl-5.16.3 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.16.3/bin/perl -e1
perl-5.16.3 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.16.3/bin/perl -E1
perl-5.14.4 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.14.4/bin/perl -e1
perl-5.14.4 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.14.4/bin/perl -E1
perl-5.12.5 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.12.5/bin/perl -e1
perl-5.12.5 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.12.5/bin/perl -E1
perl-5.10.1 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.10.1/bin/perl -e1
perl-5.10.1 -E1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.10.1/bin/perl -E1
perl-5.8.9 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.8.9/bin/perl -e1
perl-5.6.2 -e1 (command)
Command line:
/home/u1/perl5/perlbrew/perls/perl-5.6.2/bin/perl -e1
SAMPLE BENCHMARK RESULTS
Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.3.0-64-generic.
Benchmark with default options (bencher -m Perl::Startup
):
#table1#
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest | errors | samples |
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| perl-5.28.3 -E1 | 130 | 7.4 | 0.00% | 19.97% | 3.4e-05 | 27 |
| perl-5.32.1 -E1 | 140 | 7.2 | 3.80% | 15.58% | 7.8e-06 | 20 |
| perl-5.34.0 -E1 | 140 | 7.1 | 4.09% | 15.26% | 1.4e-05 | 20 |
| perl-5.30.3 -E1 | 140 | 7.1 | 4.57% | 14.74% | 1.5e-05 | 20 |
| perl-5.30.0 -E1 | 140 | 7.1 | 4.98% | 14.28% | 2.1e-05 | 20 |
| perl-5.18.4 -E1 | 140 | 7.1 | 5.25% | 13.99% | 3.3e-05 | 63 |
| perl-5.26.3 -E1 | 140 | 7 | 5.63% | 13.58% | 3.1e-05 | 26 |
| perl-5.14.4 -E1 | 140 | 7 | 6.68% | 12.47% | 3.4e-05 | 56 |
| perl-5.16.3 -E1 | 140 | 6.9 | 7.34% | 11.77% | 3.4e-05 | 31 |
| perl-5.22.4 -E1 | 140 | 6.9 | 7.41% | 11.69% | 3.2e-05 | 20 |
| perl-5.20.3 -E1 | 150 | 6.9 | 7.85% | 11.24% | 1.9e-05 | 20 |
| perl-5.30.3 -e1 | 150 | 6.8 | 8.64% | 10.43% | 3.4e-05 | 30 |
| perl-5.24.4 -E1 | 150 | 6.8 | 8.80% | 10.27% | 2.3e-05 | 20 |
| perl-5.34.0 -e1 | 150 | 6.8 | 8.88% | 10.19% | 3.4e-05 | 25 |
| perl-5.32.1 -e1 | 150 | 6.7 | 10.15% | 8.92% | 3.1e-05 | 46 |
| perl-5.22.4 -e1 | 150 | 6.7 | 10.84% | 8.24% | 3.1e-05 | 32 |
| perl-5.10.1 -E1 | 150 | 6.6 | 11.64% | 7.47% | 2.3e-05 | 20 |
| perl-5.20.3 -e1 | 150 | 6.6 | 12.15% | 6.98% | 3.1e-05 | 30 |
| perl-5.12.5 -E1 | 150 | 6.6 | 12.29% | 6.84% | 2.3e-05 | 20 |
| perl-5.26.3 -e1 | 150 | 6.6 | 12.72% | 6.44% | 3.3e-05 | 37 |
| perl-5.30.0 -e1 | 150 | 6.6 | 12.86% | 6.30% | 3.2e-05 | 20 |
| perl-5.24.4 -e1 | 150 | 6.6 | 13.17% | 6.01% | 2.9e-05 | 35 |
| perl-5.10.1 -e1 | 150 | 6.5 | 13.43% | 5.77% | 2.9e-05 | 20 |
| perl-5.18.4 -e1 | 150 | 6.5 | 13.45% | 5.75% | 2.9e-05 | 38 |
| perl-5.12.5 -e1 | 150 | 6.5 | 14.22% | 5.04% | 3e-05 | 32 |
| perl-5.28.3 -e1 | 160 | 6.4 | 15.70% | 3.70% | 1.7e-05 | 21 |
| perl-5.16.3 -e1 | 160 | 6.4 | 16.79% | 2.72% | 3.1e-05 | 22 |
| perl-5.6.2 -e1 | 160 | 6.3 | 17.51% | 2.10% | 2.9e-05 | 35 |
| perl-5.8.9 -e1 | 160 | 6.2 | 19.67% | 0.25% | 1.9e-05 | 20 |
| perl-5.14.4 -e1 | 160 | 6.2 | 19.97% | 0.00% | 8.1e-06 | 21 |
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
Formatted as Benchmark.pm result:
Rate perl-5.28.3 -E1 perl-5.32.1 -E1 perl-5.34.0 -E1 perl-5.30.3 -E1 perl-5.30.0 -E1 perl-5.18.4 -E1 perl-5.26.3 -E1 perl-5.14.4 -E1 perl-5.16.3 -E1 perl-5.22.4 -E1 perl-5.20.3 -E1 perl-5.30.3 -e1 perl-5.24.4 -E1 perl-5.34.0 -e1 perl-5.32.1 -e1 perl-5.22.4 -e1 perl-5.10.1 -E1 perl-5.20.3 -e1 perl-5.12.5 -E1 perl-5.26.3 -e1 perl-5.30.0 -e1 perl-5.24.4 -e1 perl-5.10.1 -e1 perl-5.18.4 -e1 perl-5.12.5 -e1 perl-5.28.3 -e1 perl-5.16.3 -e1 perl-5.6.2 -e1 perl-5.8.9 -e1 perl-5.14.4 -e1
perl-5.28.3 -E1 130/s -- -2% -4% -4% -4% -4% -5% -5% -6% -6% -6% -8% -8% -8% -9% -9% -10% -10% -10% -10% -10% -10% -12% -12% -12% -13% -13% -14% -16% -16%
perl-5.32.1 -E1 140/s 2% -- -1% -1% -1% -1% -2% -2% -4% -4% -4% -5% -5% -5% -6% -6% -8% -8% -8% -8% -8% -8% -9% -9% -9% -11% -11% -12% -13% -13%
perl-5.34.0 -E1 140/s 4% 1% -- 0% 0% 0% -1% -1% -2% -2% -2% -4% -4% -4% -5% -5% -7% -7% -7% -7% -7% -7% -8% -8% -8% -9% -9% -11% -12% -12%
perl-5.30.3 -E1 140/s 4% 1% 0% -- 0% 0% -1% -1% -2% -2% -2% -4% -4% -4% -5% -5% -7% -7% -7% -7% -7% -7% -8% -8% -8% -9% -9% -11% -12% -12%
perl-5.30.0 -E1 140/s 4% 1% 0% 0% -- 0% -1% -1% -2% -2% -2% -4% -4% -4% -5% -5% -7% -7% -7% -7% -7% -7% -8% -8% -8% -9% -9% -11% -12% -12%
perl-5.18.4 -E1 140/s 4% 1% 0% 0% 0% -- -1% -1% -2% -2% -2% -4% -4% -4% -5% -5% -7% -7% -7% -7% -7% -7% -8% -8% -8% -9% -9% -11% -12% -12%
perl-5.26.3 -E1 140/s 5% 2% 1% 1% 1% 1% -- 0% -1% -1% -1% -2% -2% -2% -4% -4% -5% -5% -5% -5% -5% -5% -7% -7% -7% -8% -8% -9% -11% -11%
perl-5.14.4 -E1 140/s 5% 2% 1% 1% 1% 1% 0% -- -1% -1% -1% -2% -2% -2% -4% -4% -5% -5% -5% -5% -5% -5% -7% -7% -7% -8% -8% -9% -11% -11%
perl-5.16.3 -E1 140/s 7% 4% 2% 2% 2% 2% 1% 1% -- 0% 0% -1% -1% -1% -2% -2% -4% -4% -4% -4% -4% -4% -5% -5% -5% -7% -7% -8% -10% -10%
perl-5.22.4 -E1 140/s 7% 4% 2% 2% 2% 2% 1% 1% 0% -- 0% -1% -1% -1% -2% -2% -4% -4% -4% -4% -4% -4% -5% -5% -5% -7% -7% -8% -10% -10%
perl-5.20.3 -E1 150/s 7% 4% 2% 2% 2% 2% 1% 1% 0% 0% -- -1% -1% -1% -2% -2% -4% -4% -4% -4% -4% -4% -5% -5% -5% -7% -7% -8% -10% -10%
perl-5.30.3 -e1 150/s 8% 5% 4% 4% 4% 4% 2% 2% 1% 1% 1% -- 0% 0% -1% -1% -2% -2% -2% -2% -2% -2% -4% -4% -4% -5% -5% -7% -8% -8%
perl-5.24.4 -E1 150/s 8% 5% 4% 4% 4% 4% 2% 2% 1% 1% 1% 0% -- 0% -1% -1% -2% -2% -2% -2% -2% -2% -4% -4% -4% -5% -5% -7% -8% -8%
perl-5.34.0 -e1 150/s 8% 5% 4% 4% 4% 4% 2% 2% 1% 1% 1% 0% 0% -- -1% -1% -2% -2% -2% -2% -2% -2% -4% -4% -4% -5% -5% -7% -8% -8%
perl-5.32.1 -e1 150/s 10% 7% 5% 5% 5% 5% 4% 4% 2% 2% 2% 1% 1% 1% -- 0% -1% -1% -1% -1% -1% -1% -2% -2% -2% -4% -4% -5% -7% -7%
perl-5.22.4 -e1 150/s 10% 7% 5% 5% 5% 5% 4% 4% 2% 2% 2% 1% 1% 1% 0% -- -1% -1% -1% -1% -1% -1% -2% -2% -2% -4% -4% -5% -7% -7%
perl-5.10.1 -E1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% -- 0% 0% 0% 0% 0% -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.20.3 -e1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% 0% -- 0% 0% 0% 0% -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.12.5 -E1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% 0% 0% -- 0% 0% 0% -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.26.3 -e1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% 0% 0% 0% -- 0% 0% -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.30.0 -e1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% 0% 0% 0% 0% -- 0% -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.24.4 -e1 150/s 12% 9% 7% 7% 7% 7% 6% 6% 4% 4% 4% 3% 3% 3% 1% 1% 0% 0% 0% 0% 0% -- -1% -1% -1% -3% -3% -4% -6% -6%
perl-5.10.1 -e1 150/s 13% 10% 9% 9% 9% 9% 7% 7% 6% 6% 6% 4% 4% 4% 3% 3% 1% 1% 1% 1% 1% 1% -- 0% 0% -1% -1% -3% -4% -4%
perl-5.18.4 -e1 150/s 13% 10% 9% 9% 9% 9% 7% 7% 6% 6% 6% 4% 4% 4% 3% 3% 1% 1% 1% 1% 1% 1% 0% -- 0% -1% -1% -3% -4% -4%
perl-5.12.5 -e1 150/s 13% 10% 9% 9% 9% 9% 7% 7% 6% 6% 6% 4% 4% 4% 3% 3% 1% 1% 1% 1% 1% 1% 0% 0% -- -1% -1% -3% -4% -4%
perl-5.28.3 -e1 160/s 15% 12% 10% 10% 10% 10% 9% 9% 7% 7% 7% 6% 6% 6% 4% 4% 3% 3% 3% 3% 3% 3% 1% 1% 1% -- 0% -1% -3% -3%
perl-5.16.3 -e1 160/s 15% 12% 10% 10% 10% 10% 9% 9% 7% 7% 7% 6% 6% 6% 4% 4% 3% 3% 3% 3% 3% 3% 1% 1% 1% 0% -- -1% -3% -3%
perl-5.6.2 -e1 160/s 17% 14% 12% 12% 12% 12% 11% 11% 9% 9% 9% 7% 7% 7% 6% 6% 4% 4% 4% 4% 4% 4% 3% 3% 3% 1% 1% -- -1% -1%
perl-5.8.9 -e1 160/s 19% 16% 14% 14% 14% 14% 12% 12% 11% 11% 11% 9% 9% 9% 8% 8% 6% 6% 6% 6% 6% 6% 4% 4% 4% 3% 3% 1% -- 0%
perl-5.14.4 -e1 160/s 19% 16% 14% 14% 14% 14% 12% 12% 11% 11% 11% 9% 9% 9% 8% 8% 6% 6% 6% 6% 6% 6% 4% 4% 4% 3% 3% 1% 0% --
Legends:
perl-5.10.1 -E1: participant=perl-5.10.1 -E1
perl-5.10.1 -e1: participant=perl-5.10.1 -e1
perl-5.12.5 -E1: participant=perl-5.12.5 -E1
perl-5.12.5 -e1: participant=perl-5.12.5 -e1
perl-5.14.4 -E1: participant=perl-5.14.4 -E1
perl-5.14.4 -e1: participant=perl-5.14.4 -e1
perl-5.16.3 -E1: participant=perl-5.16.3 -E1
perl-5.16.3 -e1: participant=perl-5.16.3 -e1
perl-5.18.4 -E1: participant=perl-5.18.4 -E1
perl-5.18.4 -e1: participant=perl-5.18.4 -e1
perl-5.20.3 -E1: participant=perl-5.20.3 -E1
perl-5.20.3 -e1: participant=perl-5.20.3 -e1
perl-5.22.4 -E1: participant=perl-5.22.4 -E1
perl-5.22.4 -e1: participant=perl-5.22.4 -e1
perl-5.24.4 -E1: participant=perl-5.24.4 -E1
perl-5.24.4 -e1: participant=perl-5.24.4 -e1
perl-5.26.3 -E1: participant=perl-5.26.3 -E1
perl-5.26.3 -e1: participant=perl-5.26.3 -e1
perl-5.28.3 -E1: participant=perl-5.28.3 -E1
perl-5.28.3 -e1: participant=perl-5.28.3 -e1
perl-5.30.0 -E1: participant=perl-5.30.0 -E1
perl-5.30.0 -e1: participant=perl-5.30.0 -e1
perl-5.30.3 -E1: participant=perl-5.30.3 -E1
perl-5.30.3 -e1: participant=perl-5.30.3 -e1
perl-5.32.1 -E1: participant=perl-5.32.1 -E1
perl-5.32.1 -e1: participant=perl-5.32.1 -e1
perl-5.34.0 -E1: participant=perl-5.34.0 -E1
perl-5.34.0 -e1: participant=perl-5.34.0 -e1
perl-5.6.2 -e1: participant=perl-5.6.2 -e1
perl-5.8.9 -e1: participant=perl-5.8.9 -e1
To display as an interactive HTML table on a browser, you can add option --format html+datatables
.
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-Perl-Startup.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-Perl-Startup.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-Perl-Startup
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
SEE ALSO
Bencher::Scenario::Interpreters
AUTHOR
perlancar <perlancar@cpan.org>
COPYRIGHT AND LICENSE
This software is copyright (c) 2021 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.