/ 
Bencher-Scenario-SortBySpec-0.03
River stage one • 1 direct dependent • 1 total dependent
/ Bencher::Scenario::SortBySpec

NAME

Bencher::Scenario::SortBySpec - Benchmark Sort::BySpec (e.g. against Sort::ByExample, etc)

VERSION

This document describes version 0.03 of Bencher::Scenario::SortBySpec (from Perl distribution Bencher-Scenario-SortBySpec), released on 2016-06-26.

SYNOPSIS

To run benchmark with default option:

% bencher -m SortBySpec

To run module startup overhead benchmark:

% bencher --module-startup -m SortBySpec

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Sort::ByExample 0.007

Sort::BySpec 0.02

BENCHMARK PARTICIPANTS

  • gen_sorter-sbe (perl_code) [gen_sorter, sbe]

    Code template:

    Sort::ByExample::sbe(<spec>)

  • gen_sorter-sbs (perl_code) [gen_sorter, sbs]

    Code template:

    Sort::BySpec::sort_by_spec(spec => <spec>)

  • sort-sbe (perl_code) [sort, sbe]

    Code template:

    state $sorter = Sort::ByExample::sbe(<spec>); [$sorter->(@{<list>})]

  • sort-sbs (perl_code) [sort, sbs]

    Code template:

    state $sorter = Sort::BySpec::sort_by_spec(spec => <spec>); [$sorter->(@{<list>})]

BENCHMARK DATASETS

  • eg-num5-list10

  • eg-num5-list100

  • eg-num5-list1000

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.22.2, CPU: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (4 cores), OS: GNU/Linux Debian version 8.0, OS kernel: Linux version 3.16.0-4-amd64.

Benchmark with default options (bencher -m SortBySpec):

+----------------+------------------+-----------+------------+------------+---------+---------+
| participant    | dataset          | rate (/s) |  time (ms) | vs_slowest |  errors | samples |
+----------------+------------------+-----------+------------+------------+---------+---------+
| sort-sbs       | eg-num5-list1000 |     302   | 3.32       |      1     | 4.8e-07 |      20 |
| sort-sbe       | eg-num5-list1000 |    2900   | 0.344      |      9.63  | 5.3e-08 |      20 |
| sort-sbs       | eg-num5-list100  |    3110   | 0.322      |     10.3   | 1.6e-07 |      21 |
| sort-sbe       | eg-num5-list100  |   27600   | 0.0363     |     91.4   | 9.7e-09 |      38 |
| sort-sbs       | eg-num5-list10   |   41930.8 | 0.0238488  |    139.048 |   0     |      21 |
| sort-sbe       | eg-num5-list10   |  140000   | 0.0074     |    450     | 1.3e-08 |      20 |
| gen_sorter-sbe | eg-num5-list1000 |  249859   | 0.00400225 |    828.567 |   0     |      22 |
| gen_sorter-sbe | eg-num5-list100  |  249900   | 0.004002   |    828.7   | 8.7e-11 |      21 |
| gen_sorter-sbe | eg-num5-list10   |  250000   | 0.004      |    830     | 5.5e-09 |      29 |
| gen_sorter-sbs | eg-num5-list100  |  252185   | 0.00396534 |    836.28  |   0     |      20 |
| gen_sorter-sbs | eg-num5-list1000 |  253000   | 0.00396    |    837     | 1.3e-09 |      32 |
| gen_sorter-sbs | eg-num5-list10   |  250000   | 0.004      |    840     | 5.7e-09 |      27 |
+----------------+------------------+-----------+------------+------------+---------+---------+

Benchmark module startup overhead (bencher -m SortBySpec --module-startup):

+---------------------+-----------+------------------------+------------+---------+---------+
| participant         | time (ms) | mod_overhead_time (ms) | vs_slowest |  errors | samples |
+---------------------+-----------+------------------------+------------+---------+---------+
| Sort::ByExample     |      14   |                   11.5 |        1   | 5.3e-05 |      22 |
| Sort::BySpec        |       5   |                    2.5 |        2.7 | 2.8e-05 |      20 |
| perl -e1 (baseline) |       2.5 |                    0   |        5.5 | 4.5e-06 |      20 |
+---------------------+-----------+------------------------+------------+---------+---------+

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-SortBySpec.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-SortBySpec.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-SortBySpec

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2016 by perlancar@cpan.org.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.