Sponsoring The Perl Toolchain Summit 2025: Help make this important event another success Learn more

 / 
Bencher-Scenario-AppSorted-0.002
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::AppSorted

NAME

Bencher::Scenario::AppSorted - Benchmark sorted vs is-sorted

VERSION

This document describes version 0.002 of Bencher::Scenario::AppSorted (from Perl distribution Bencher-Scenario-AppSorted), released on 2021-07-31.

SYNOPSIS

To run benchmark with default option:


            

              
              
% bencher -m AppSorted

To run module startup overhead benchmark:


            

              
              
% bencher --module-startup -m AppSorted

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

App::sorted 0.002

File::IsSorted 0.0.6

BENCHMARK PARTICIPANTS

  • sorted (command)

    Command line:

    
            
    
              
              
    #TEMPLATE: sorted <filename>; true

  • is-sorted (command)

    Command line:

    
            
    
              
              
    #TEMPLATE: is-sorted check <filename>; true

BENCHMARK DATASETS

  • 100k-sorted

  • 100k-unsorted-middle

  • 100k-unsorted-beginning

BENCHMARK SAMPLE RESULTS

Sample benchmark #1

Run on: perl: v5.34.0, CPU: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (4 cores), OS: GNU/Linux LinuxMint version 19, OS kernel: Linux version 5.3.0-68-generic.

Benchmark command (default options):


            

              
              
% bencher -m AppSorted

Result formatted as table:


            

              
              
#table1#
| participant | dataset                 | rate (/s) | time (ms) | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
|-------------+-------------------------+-----------+-----------+-----------------------+-----------------------+---------+---------|
| sorted      | 100k-sorted             |       8.1 |       120 |                 0.00% |                96.99% | 0.0011  |       7 |
| sorted      | 100k-unsorted-middle    |      10   |        98 |                27.06% |                55.04% | 0.00018 |       7 |
| sorted      | 100k-unsorted-beginning |      13   |        75 |                64.21% |                19.97% | 0.00029 |       8 |
| is-sorted   | 100k-sorted             |      13   |        75 |                65.08% |                19.33% | 0.00031 |       7 |
| is-sorted   | 100k-unsorted-middle    |      14   |        70 |                77.62% |                10.91% | 0.00016 |       8 |
| is-sorted   | 100k-unsorted-beginning |      16   |        63 |                96.99% |                 0.00% | 0.00023 |       7 |

The above result formatted in Benchmark.pm style:


            

              
              
                                     Rate  sorted 100k-sorted  sorted 100k-unsorted-middle  sorted 100k-unsorted-beginning  is-sorted 100k-sorted  is-sorted 100k-unsorted-middle  is-sorted 100k-unsorted-beginning 
 sorted 100k-sorted                 8.1/s                  --                         -18%                            -37%                   -37%                            -41%                               -47% 
 sorted 100k-unsorted-middle         10/s                 22%                           --                            -23%                   -23%                            -28%                               -35% 
 sorted 100k-unsorted-beginning      13/s                 60%                          30%                              --                     0%                             -6%                               -16% 
 is-sorted 100k-sorted               13/s                 60%                          30%                              0%                     --                             -6%                               -16% 
 is-sorted 100k-unsorted-middle      14/s                 71%                          39%                              7%                     7%                              --                                -9% 
 is-sorted 100k-unsorted-beginning   16/s                 90%                          55%                             19%                    19%                             11%                                 -- 
Legends:
  is-sorted 100k-sorted: dataset=100k-sorted participant=is-sorted
  is-sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=is-sorted
  is-sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=is-sorted
  sorted 100k-sorted: dataset=100k-sorted participant=sorted
  sorted 100k-unsorted-beginning: dataset=100k-unsorted-beginning participant=sorted
  sorted 100k-unsorted-middle: dataset=100k-unsorted-middle participant=sorted

The above result presented as chart:

Sample benchmark #2

Benchmark command (benchmarking module startup overhead):


            

              
              
% bencher -m AppSorted --module-startup

Result formatted as table:


            

              
              
#table2#
| participant         | time (ms) | mod_overhead_time | pct_faster_vs_slowest | pct_slower_vs_fastest |  errors | samples |
|---------------------+-----------+-------------------+-----------------------+-----------------------+---------+---------|
| File::IsSorted      |        32 |                28 |                 0.00% |               693.00% | 0.00012 |       7 |
| App::sorted         |         9 |                 5 |               242.68% |               131.41% | 0.00032 |       7 |
| perl -e1 (baseline) |         4 |                 0 |               693.00% |                 0.00% | 0.00016 |       9 |

The above result formatted in Benchmark.pm style:


            

              
              
                         Rate   F:I   A:s  perl -e1 (baseline) 
 F:I                   31.2/s    --  -71%                 -87% 
 A:s                  111.1/s  255%    --                 -55% 
 perl -e1 (baseline)  250.0/s  700%  125%                   -- 
Legends:
  A:s: mod_overhead_time=5 participant=App::sorted
  F:I: mod_overhead_time=28 participant=File::IsSorted
  perl -e1 (baseline): mod_overhead_time=0 participant=perl -e1 (baseline)

The above result presented as chart:

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

CONTRIBUTOR

perlancar (on netbook-dell-xps13) <perlancar@gmail.com>

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-AppSorted.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-AppSorted.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-AppSorted

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2021 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.