NAME

Bencher::Scenario::Perl::Startup - Benchmark startup time of perls

VERSION

This document describes version 0.052 of Bencher::Scenario::Perl::Startup (from Perl distribution Bencher-Scenario-Perl-Startup), released on 2021-07-23.

SYNOPSIS

To run benchmark with default option:

% bencher -m Perl::Startup

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Conclusion: in general newer versions of perl has larger startup overhead than previous ones. If startup overhead is important to you, use -e instead of -E unless necessary.

BENCHMARK PARTICIPANTS

  • perl-5.34.0 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.34.0/bin/perl -e1
  • perl-5.34.0 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.34.0/bin/perl -E1
  • perl-5.32.1 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.32.1/bin/perl -e1
  • perl-5.32.1 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.32.1/bin/perl -E1
  • perl-5.30.3 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.30.3/bin/perl -e1
  • perl-5.30.3 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.30.3/bin/perl -E1
  • perl-5.30.0 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.30.0/bin/perl -e1
  • perl-5.30.0 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.30.0/bin/perl -E1
  • perl-5.28.3 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.28.3/bin/perl -e1
  • perl-5.28.3 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.28.3/bin/perl -E1
  • perl-5.26.3 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.26.3/bin/perl -e1
  • perl-5.26.3 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.26.3/bin/perl -E1
  • perl-5.24.4 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.24.4/bin/perl -e1
  • perl-5.24.4 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.24.4/bin/perl -E1
  • perl-5.22.4 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.22.4/bin/perl -e1
  • perl-5.22.4 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.22.4/bin/perl -E1
  • perl-5.20.3 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.20.3/bin/perl -e1
  • perl-5.20.3 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.20.3/bin/perl -E1
  • perl-5.18.4 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.18.4/bin/perl -e1
  • perl-5.18.4 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.18.4/bin/perl -E1
  • perl-5.16.3 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.16.3/bin/perl -e1
  • perl-5.16.3 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.16.3/bin/perl -E1
  • perl-5.14.4 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.14.4/bin/perl -e1
  • perl-5.14.4 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.14.4/bin/perl -E1
  • perl-5.12.5 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.12.5/bin/perl -e1
  • perl-5.12.5 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.12.5/bin/perl -E1
  • perl-5.10.1 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.10.1/bin/perl -e1
  • perl-5.10.1 -E1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.10.1/bin/perl -E1
  • perl-5.8.9 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.8.9/bin/perl -e1
  • perl-5.6.2 -e1 (command)

    Command line:

    /home/u1/perl5/perlbrew/perls/perl-5.6.2/bin/perl -e1

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (2 cores), OS: GNU/Linux Ubuntu version 20.04, OS kernel: Linux version 5.3.0-64-generic.

Benchmark with default options (bencher -m Perl::Startup):

#table1#
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| participant     | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+
| perl-5.32.1 -E1 |       110 |      9.2  |                 0.00% |                74.27% | 1.8e-05 |      20 |
| perl-5.30.0 -E1 |       140 |      7.2  |                27.53% |                36.65% | 3.4e-05 |      35 |
| perl-5.6.2 -e1  |       140 |      7.1  |                29.11% |                34.98% | 2.2e-05 |      42 |
| perl-5.10.1 -E1 |       140 |      7    |                30.64% |                33.39% | 2.9e-05 |      20 |
| perl-5.28.3 -E1 |       150 |      6.8  |                34.61% |                29.46% | 3.4e-05 |      54 |
| perl-5.24.4 -E1 |       150 |      6.8  |                35.12% |                28.97% | 1.3e-05 |      20 |
| perl-5.30.3 -E1 |       150 |      6.7  |                37.56% |                26.69% | 2.8e-05 |      21 |
| perl-5.10.1 -e1 |       150 |      6.5  |                40.15% |                24.34% | 3.2e-05 |      21 |
| perl-5.16.3 -E1 |       150 |      6.5  |                41.13% |                23.48% | 6.7e-06 |      20 |
| perl-5.18.4 -E1 |       150 |      6.5  |                41.43% |                23.22% | 1.5e-05 |      21 |
| perl-5.14.4 -E1 |       150 |      6.5  |                41.94% |                22.77% | 3.2e-05 |      24 |
| perl-5.20.3 -E1 |       160 |      6.4  |                42.48% |                22.32% | 3.1e-05 |      21 |
| perl-5.34.0 -E1 |       159 |      6.28 |                45.80% |                19.52% | 4.2e-06 |      20 |
| perl-5.30.0 -e1 |       160 |      6.3  |                46.23% |                19.17% | 1.7e-05 |      21 |
| perl-5.8.9 -e1  |       160 |      6.2  |                47.23% |                18.37% | 2.7e-05 |      26 |
| perl-5.28.3 -e1 |       160 |      6.2  |                48.81% |                17.11% | 1.6e-05 |      20 |
| perl-5.30.3 -e1 |       160 |      6.1  |                49.00% |                16.96% | 2.7e-05 |      40 |
| perl-5.22.4 -e1 |       160 |      6.1  |                49.52% |                16.55% | 1.5e-05 |      20 |
| perl-5.12.5 -E1 |       160 |      6.1  |                49.99% |                16.19% | 2.6e-05 |      73 |
| perl-5.26.3 -E1 |       160 |      6.1  |                50.04% |                16.15% | 7.2e-06 |      20 |
| perl-5.12.5 -e1 |       160 |      6.1  |                50.36% |                15.90% |   1e-05 |      20 |
| perl-5.24.4 -e1 |       160 |      6.1  |                50.58% |                15.73% | 8.7e-06 |      20 |
| perl-5.14.4 -e1 |       170 |      6.1  |                51.33% |                15.16% | 1.7e-05 |      20 |
| perl-5.16.3 -e1 |       170 |      6    |                52.08% |                14.59% | 1.2e-05 |      21 |
| perl-5.22.4 -E1 |       167 |      5.98 |                53.29% |                13.69% | 4.9e-06 |      20 |
| perl-5.32.1 -e1 |       170 |      5.8  |                58.58% |                 9.89% | 9.6e-06 |      20 |
| perl-5.34.0 -e1 |       180 |      5.5  |                65.61% |                 5.23% | 7.8e-06 |      20 |
| perl-5.26.3 -e1 |       180 |      5.4  |                69.46% |                 2.84% | 9.6e-06 |      20 |
| perl-5.20.3 -e1 |       188 |      5.33 |                71.99% |                 1.33% | 3.8e-06 |      20 |
| perl-5.18.4 -e1 |       190 |      5.26 |                74.27% |                 0.00% | 2.9e-06 |      20 |
+-----------------+-----------+-----------+-----------------------+-----------------------+---------+---------+

Formatted as Benchmark.pm result:

                   Rate  perl-5.32.1 -E1  perl-5.30.0 -E1  perl-5.6.2 -e1  perl-5.10.1 -E1  perl-5.28.3 -E1  perl-5.24.4 -E1  perl-5.30.3 -E1  perl-5.10.1 -e1  perl-5.16.3 -E1  perl-5.18.4 -E1  perl-5.14.4 -E1  perl-5.20.3 -E1  perl-5.30.0 -e1  perl-5.34.0 -E1  perl-5.8.9 -e1  perl-5.28.3 -e1  perl-5.30.3 -e1  perl-5.22.4 -e1  perl-5.12.5 -E1  perl-5.26.3 -E1  perl-5.12.5 -e1  perl-5.24.4 -e1  perl-5.14.4 -e1  perl-5.16.3 -e1  perl-5.22.4 -E1  perl-5.32.1 -e1  perl-5.34.0 -e1  perl-5.26.3 -e1  perl-5.20.3 -e1  perl-5.18.4 -e1 
 perl-5.32.1 -E1  110/s               --             -21%            -22%             -23%             -26%             -26%             -27%             -29%             -29%             -29%             -29%             -30%             -31%             -31%            -32%             -32%             -33%             -33%             -33%             -33%             -33%             -33%             -33%             -34%             -34%             -36%             -40%             -41%             -42%             -42% 
 perl-5.30.0 -E1  140/s              27%               --             -1%              -2%              -5%              -5%              -6%              -9%              -9%              -9%              -9%             -11%             -12%             -12%            -13%             -13%             -15%             -15%             -15%             -15%             -15%             -15%             -15%             -16%             -16%             -19%             -23%             -25%             -25%             -26% 
 perl-5.6.2 -e1   140/s              29%               1%              --              -1%              -4%              -4%              -5%              -8%              -8%              -8%              -8%              -9%             -11%             -11%            -12%             -12%             -14%             -14%             -14%             -14%             -14%             -14%             -14%             -15%             -15%             -18%             -22%             -23%             -24%             -25% 
 perl-5.10.1 -E1  140/s              31%               2%              1%               --              -2%              -2%              -4%              -7%              -7%              -7%              -7%              -8%              -9%             -10%            -11%             -11%             -12%             -12%             -12%             -12%             -12%             -12%             -12%             -14%             -14%             -17%             -21%             -22%             -23%             -24% 
 perl-5.28.3 -E1  150/s              35%               5%              4%               2%               --               0%              -1%              -4%              -4%              -4%              -4%              -5%              -7%              -7%             -8%              -8%             -10%             -10%             -10%             -10%             -10%             -10%             -10%             -11%             -12%             -14%             -19%             -20%             -21%             -22% 
 perl-5.24.4 -E1  150/s              35%               5%              4%               2%               0%               --              -1%              -4%              -4%              -4%              -4%              -5%              -7%              -7%             -8%              -8%             -10%             -10%             -10%             -10%             -10%             -10%             -10%             -11%             -12%             -14%             -19%             -20%             -21%             -22% 
 perl-5.30.3 -E1  150/s              37%               7%              5%               4%               1%               1%               --              -2%              -2%              -2%              -2%              -4%              -5%              -6%             -7%              -7%              -8%              -8%              -8%              -8%              -8%              -8%              -8%             -10%             -10%             -13%             -17%             -19%             -20%             -21% 
 perl-5.10.1 -e1  150/s              41%              10%              9%               7%               4%               4%               3%               --               0%               0%               0%              -1%              -3%              -3%             -4%              -4%              -6%              -6%              -6%              -6%              -6%              -6%              -6%              -7%              -7%             -10%             -15%             -16%             -17%             -19% 
 perl-5.16.3 -E1  150/s              41%              10%              9%               7%               4%               4%               3%               0%               --               0%               0%              -1%              -3%              -3%             -4%              -4%              -6%              -6%              -6%              -6%              -6%              -6%              -6%              -7%              -7%             -10%             -15%             -16%             -17%             -19% 
 perl-5.18.4 -E1  150/s              41%              10%              9%               7%               4%               4%               3%               0%               0%               --               0%              -1%              -3%              -3%             -4%              -4%              -6%              -6%              -6%              -6%              -6%              -6%              -6%              -7%              -7%             -10%             -15%             -16%             -17%             -19% 
 perl-5.14.4 -E1  150/s              41%              10%              9%               7%               4%               4%               3%               0%               0%               0%               --              -1%              -3%              -3%             -4%              -4%              -6%              -6%              -6%              -6%              -6%              -6%              -6%              -7%              -7%             -10%             -15%             -16%             -17%             -19% 
 perl-5.20.3 -E1  160/s              43%              12%             10%               9%               6%               6%               4%               1%               1%               1%               1%               --              -1%              -1%             -3%              -3%              -4%              -4%              -4%              -4%              -4%              -4%              -4%              -6%              -6%              -9%             -14%             -15%             -16%             -17% 
 perl-5.30.0 -e1  160/s              46%              14%             12%              11%               7%               7%               6%               3%               3%               3%               3%               1%               --               0%             -1%              -1%              -3%              -3%              -3%              -3%              -3%              -3%              -3%              -4%              -5%              -7%             -12%             -14%             -15%             -16% 
 perl-5.34.0 -E1  159/s              46%              14%             13%              11%               8%               8%               6%               3%               3%               3%               3%               1%               0%               --             -1%              -1%              -2%              -2%              -2%              -2%              -2%              -2%              -2%              -4%              -4%              -7%             -12%             -14%             -15%             -16% 
 perl-5.8.9 -e1   160/s              48%              16%             14%              12%               9%               9%               8%               4%               4%               4%               4%               3%               1%               1%              --               0%              -1%              -1%              -1%              -1%              -1%              -1%              -1%              -3%              -3%              -6%             -11%             -12%             -14%             -15% 
 perl-5.28.3 -e1  160/s              48%              16%             14%              12%               9%               9%               8%               4%               4%               4%               4%               3%               1%               1%              0%               --              -1%              -1%              -1%              -1%              -1%              -1%              -1%              -3%              -3%              -6%             -11%             -12%             -14%             -15% 
 perl-5.30.3 -e1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               --               0%               0%               0%               0%               0%               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.22.4 -e1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               --               0%               0%               0%               0%               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.12.5 -E1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               0%               --               0%               0%               0%               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.26.3 -E1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               0%               0%               --               0%               0%               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.12.5 -e1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               0%               0%               0%               --               0%               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.24.4 -e1  160/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               0%               0%               0%               0%               --               0%              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.14.4 -e1  170/s              50%              18%             16%              14%              11%              11%               9%               6%               6%               6%               6%               4%               3%               2%              1%               1%               0%               0%               0%               0%               0%               0%               --              -1%              -1%              -4%              -9%             -11%             -12%             -13% 
 perl-5.16.3 -e1  170/s              53%              19%             18%              16%              13%              13%              11%               8%               8%               8%               8%               6%               5%               4%              3%               3%               1%               1%               1%               1%               1%               1%               1%               --               0%              -3%              -8%              -9%             -11%             -12% 
 perl-5.22.4 -E1  167/s              53%              20%             18%              17%              13%              13%              12%               8%               8%               8%               8%               7%               5%               5%              3%               3%               2%               2%               2%               2%               2%               2%               2%               0%               --              -3%              -8%              -9%             -10%             -12% 
 perl-5.32.1 -e1  170/s              58%              24%             22%              20%              17%              17%              15%              12%              12%              12%              12%              10%               8%               8%              6%               6%               5%               5%               5%               5%               5%               5%               5%               3%               3%               --              -5%              -6%              -8%              -9% 
 perl-5.34.0 -e1  180/s              67%              30%             29%              27%              23%              23%              21%              18%              18%              18%              18%              16%              14%              14%             12%              12%              10%              10%              10%              10%              10%              10%              10%               9%               8%               5%               --              -1%              -3%              -4% 
 perl-5.26.3 -e1  180/s              70%              33%             31%              29%              25%              25%              24%              20%              20%              20%              20%              18%              16%              16%             14%              14%              12%              12%              12%              12%              12%              12%              12%              11%              10%               7%               1%               --              -1%              -2% 
 perl-5.20.3 -e1  188/s              72%              35%             33%              31%              27%              27%              25%              21%              21%              21%              21%              20%              18%              17%             16%              16%              14%              14%              14%              14%              14%              14%              14%              12%              12%               8%               3%               1%               --              -1% 
 perl-5.18.4 -e1  190/s              74%              36%             34%              33%              29%              29%              27%              23%              23%              23%              23%              21%              19%              19%             17%              17%              15%              15%              15%              15%              15%              15%              15%              14%              13%              10%               4%               2%               1%               -- 

Legends:
  perl-5.10.1 -E1: participant=perl-5.10.1 -E1
  perl-5.10.1 -e1: participant=perl-5.10.1 -e1
  perl-5.12.5 -E1: participant=perl-5.12.5 -E1
  perl-5.12.5 -e1: participant=perl-5.12.5 -e1
  perl-5.14.4 -E1: participant=perl-5.14.4 -E1
  perl-5.14.4 -e1: participant=perl-5.14.4 -e1
  perl-5.16.3 -E1: participant=perl-5.16.3 -E1
  perl-5.16.3 -e1: participant=perl-5.16.3 -e1
  perl-5.18.4 -E1: participant=perl-5.18.4 -E1
  perl-5.18.4 -e1: participant=perl-5.18.4 -e1
  perl-5.20.3 -E1: participant=perl-5.20.3 -E1
  perl-5.20.3 -e1: participant=perl-5.20.3 -e1
  perl-5.22.4 -E1: participant=perl-5.22.4 -E1
  perl-5.22.4 -e1: participant=perl-5.22.4 -e1
  perl-5.24.4 -E1: participant=perl-5.24.4 -E1
  perl-5.24.4 -e1: participant=perl-5.24.4 -e1
  perl-5.26.3 -E1: participant=perl-5.26.3 -E1
  perl-5.26.3 -e1: participant=perl-5.26.3 -e1
  perl-5.28.3 -E1: participant=perl-5.28.3 -E1
  perl-5.28.3 -e1: participant=perl-5.28.3 -e1
  perl-5.30.0 -E1: participant=perl-5.30.0 -E1
  perl-5.30.0 -e1: participant=perl-5.30.0 -e1
  perl-5.30.3 -E1: participant=perl-5.30.3 -E1
  perl-5.30.3 -e1: participant=perl-5.30.3 -e1
  perl-5.32.1 -E1: participant=perl-5.32.1 -E1
  perl-5.32.1 -e1: participant=perl-5.32.1 -e1
  perl-5.34.0 -E1: participant=perl-5.34.0 -E1
  perl-5.34.0 -e1: participant=perl-5.34.0 -e1
  perl-5.6.2 -e1: participant=perl-5.6.2 -e1
  perl-5.8.9 -e1: participant=perl-5.8.9 -e1

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-Perl-Startup.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-Perl-Startup.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-Perl-Startup

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

SEE ALSO

Bencher::Scenario::Interpreters

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2021 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.