NAME
Bencher::Scenario::SetComparison - Benchmark set comparison
VERSION
This document describes version 0.001 of Bencher::Scenario::SetComparison (from Perl distribution Bencher-Scenario-SetComparison), released on 2016-10-19.
SYNOPSIS
To run benchmark with default option:
% bencher -m SetComparisonTo run module startup overhead benchmark:
% bencher --module-startup -m SetComparisonFor more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
TODO: include more set modules.
TODO: compare complex elements.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Test::Deep 1.120
Set::Tiny 0.04
BENCHMARK PARTICIPANTS
Test::Deep (perl_code)
Code template:
state $set = Test::Deep::set(@{<set>}); Test::Deep::eq_deeply(<array>, $set)Set::Tiny (perl_code) [simple-elements]
Code template:
state $set1 = Set::Tiny->new(@{<array>}); state $set2 = Set::Tiny->new(@{<set>}); $set1->symmetric_difference($set2)->size == 0 ? 1:0
BENCHMARK DATASETS
elems=10num
elems=100num
elems=200num
SAMPLE BENCHMARK RESULTS
Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores), OS: GNU/Linux Debian version 8.0, OS kernel: Linux version 3.16.0-4-amd64.
Benchmark with default options (bencher -m SetComparison):
#table1#
+-------------+--------------+-----------+-----------+------------+-----------+---------+
| participant | dataset | rate (/s) | time (ms) | vs_slowest | errors | samples |
+-------------+--------------+-----------+-----------+------------+-----------+---------+
| Test::Deep | elems=200num | 4.09 | 244 | 1 | 0.00022 | 20 |
| Test::Deep | elems=100num | 16.1 | 62 | 3.94 | 5.2e-05 | 20 |
| Test::Deep | elems=10num | 1400 | 0.69 | 350 | 6.9e-07 | 20 |
| Set::Tiny | elems=200num | 15000 | 0.069 | 3500 | 1.1e-07 | 20 |
| Set::Tiny | elems=100num | 28000 | 0.036 | 6800 | 2.3e-07 | 20 |
| Set::Tiny | elems=10num | 182000 | 0.00551 | 44400 | 1.7e-09 | 20 |
+-------------+--------------+-----------+-----------+------------+-----------+---------+Benchmark module startup overhead (bencher -m SetComparison --module-startup):
#table2#
+---------------------+-----------+------------------------+------------+---------+---------+
| participant | time (ms) | mod_overhead_time (ms) | vs_slowest | errors | samples |
+---------------------+-----------+------------------------+------------+---------+---------+
| Test::Deep | 24 | 19 | 1 | 7.1e-05 | 20 |
| Set::Tiny | 7.2 | 2.2 | 3.4 | 6.8e-05 | 21 |
| perl -e1 (baseline) | 5 | 0 | 5 | 8.1e-05 | 20 |
+---------------------+-----------+------------------------+------------+---------+---------+BENCHMARK NOTES
Test::Deep is slow :)
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-SetComparison.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-SetComparison.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-SetComparison
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
SEE ALSO
Bencher::Scenario::BagComparison
Bencher::Scenario::SetOperationModules
AUTHOR
perlancar <perlancar@cpan.org>
COPYRIGHT AND LICENSE
This software is copyright (c) 2016 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.