NAME

Bencher::Scenario::SetOperationModules - Benchmark Perl set operation (union, intersection, diff, symmetric diff) modules

VERSION

This document describes version 0.12 of Bencher::Scenario::SetOperationModules (from Perl distribution Bencher-Scenario-SetOperationModules), released on 2017-02-19.

SYNOPSIS

To run benchmark with default option:

% bencher -m SetOperationModules

To run module startup overhead benchmark:

% bencher --module-startup -m SetOperationModules

For more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.

DESCRIPTION

Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.

BENCHMARKED MODULES

Version numbers shown below are the versions used when running the sample benchmark.

Array::AsObject 1.02

Array::Set 0.05

Array::Utils 0.5

List::Collection 0.0.4

List::MoreUtils 0.416

List::MoreUtils::PP 0.416

Set::Array 0.30

Set::Object 1.35

Set::Scalar 1.29

Set::Tiny 0.04

BENCHMARK PARTICIPANTS

Array::Utils::unique (perl_code) [op:union]

Code template:
```
&Array::Utils::unique(<set1>, <set2>)
```

Set::Scalar::union (perl_code) [op:union]

Code template:

my $s1 = Set::Scalar->new(@{<set1>}); my $s2 = Set::Scalar->new(@{<set2>}); $s1->union($s2)

List::MoreUtils::PP::uniq (perl_code) [op:union]

Function call template:
```
List::MoreUtils::PP::uniq(@{<set1>}, @{<set2>})
```
List::MoreUtils::XS::uniq (perl_code) [op:union]

Function call template:
```
List::MoreUtils::uniq(@{<set1>}, @{<set2>})
```
Array::Set::set_union (perl_code) [op:union]

Function call template:
```
Array::Set::set_union(<set1>, <set2>)
```

Set::Array::union (perl_code) [op:union]

Code template:

my $s1 = Set::Array->new(@{<set1>}); my $s2 = Set::Array->new(@{<set2>}); $s1->union($s2)

Array::AsObject::union (perl_code) [op:union]

Code template:

my $s1 = Array::AsObject->new(@{<set1>}); my $s2 = Array::AsObject->new(@{<set2>}); $s1->union($s2, 1)

Set::Object::union (perl_code) [op:union]

Code template:

my $s1 = Set::Object->new(@{<set1>}); my $s2 = Set::Object->new(@{<set2>}); $s1->union($s2)

Set::Tiny::union (perl_code) [op:union]

Code template:

my $s1 = Set::Tiny->new(@{<set1>}); my $s2 = Set::Tiny->new(@{<set2>}); $s1->union($s2)

List::Collection::union (perl_code) [op:union]

Code template:
```
[List::Collection::union(<set1>, <set2>)]
```
Array::Utils::array_diff (perl_code) [op:symdiff]

Code template:
```
&Array::Utils::array_diff(<set1>, <set2>)
```

Set::Scalar::symmetric_difference (perl_code) [op:symdiff]

Code template:

my $s1 = Set::Scalar->new(@{<set1>}); my $s2 = Set::Scalar->new(@{<set2>}); $s1->symmetric_difference($s2)

List::MoreUtils::PP::singleton (perl_code) [op:symdiff]

Function call template:
```
List::MoreUtils::PP::singleton(@{<set1>}, @{<set2>})
```
List::MoreUtils::XS::singleton (perl_code) [op:symdiff]

Function call template:
```
List::MoreUtils::singleton(@{<set1>}, @{<set2>})
```
Array::Set::set_symdiff (perl_code) [op:symdiff]

Function call template:
```
Array::Set::set_symdiff(<set1>, <set2>)
```

Set::Array::symmetric_difference (perl_code) [op:symdiff]

Code template:

my $s1 = Set::Array->new(@{<set1>}); my $s2 = Set::Array->new(@{<set2>}); $s1->symmetric_difference($s2)

Array::AsObject::symmetric_difference (perl_code) [op:symdiff]

Code template:

my $s1 = Array::AsObject->new(@{<set1>}); my $s2 = Array::AsObject->new(@{<set2>}); $s1->symmetric_difference($s2)

Set::Object::symmetric_difference (perl_code) [op:symdiff]

Code template:

my $s1 = Set::Object->new(@{<set1>}); my $s2 = Set::Object->new(@{<set2>}); $s1->symmetric_difference($s2)

Set::Tiny::symmetric_difference (perl_code) [op:symdiff]

Code template:

my $s1 = Set::Tiny->new(@{<set1>}); my $s2 = Set::Tiny->new(@{<set2>}); $s1->symmetric_difference($s2)

List::Collection::complement (perl_code) [op:symdiff]

Code template:
```
[List::Collection::complement(<set1>, <set2>)]
```
Array::Utils::array_minus (perl_code) [op:diff]

Code template:
```
&Array::Utils::array_minus(<set1>, <set2>)
```

Set::Scalar::difference (perl_code) [op:diff]

Code template:

my $s1 = Set::Scalar->new(@{<set1>}); my $s2 = Set::Scalar->new(@{<set2>}); $s1->difference($s2)

Array::Set::set_diff (perl_code) [op:diff]

Function call template:
```
Array::Set::set_diff(<set1>, <set2>)
```

Set::Array::difference (perl_code) [op:diff]

Code template:

my $s1 = Set::Array->new(@{<set1>}); my $s2 = Set::Array->new(@{<set2>}); $s1->difference($s2)

Array::AsObject::difference (perl_code) [op:diff]

Code template:

my $s1 = Array::AsObject->new(@{<set1>}); my $s2 = Array::AsObject->new(@{<set2>}); $s1->difference($s2)

Set::Object::difference (perl_code) [op:diff]

Code template:

my $s1 = Set::Object->new(@{<set1>}); my $s2 = Set::Object->new(@{<set2>}); $s1->difference($s2)

Set::Tiny::difference (perl_code) [op:diff]

Code template:

my $s1 = Set::Tiny->new(@{<set1>}); my $s2 = Set::Tiny->new(@{<set2>}); $s1->difference($s2)

List::Collection::subtract (perl_code) [op:diff]

Code template:
```
[List::Collection::subtract(<set1>, <set2>)]
```
Array::Utils::intersect (perl_code) [op:intersect]

Code template:
```
&Array::Utils::intersect(<set1>, <set2>)
```

Set::Scalar::intersection (perl_code) [op:intersect]

Code template:

my $s1 = Set::Scalar->new(@{<set1>}); my $s2 = Set::Scalar->new(@{<set2>}); $s1->intersection($s2)

Array::Set::set_intersect (perl_code) [op:intersect]

Function call template:
```
Array::Set::set_intersect(<set1>, <set2>)
```

Set::Array::intersection (perl_code) [op:intersect]

Code template:

my $s1 = Set::Array->new(@{<set1>}); my $s2 = Set::Array->new(@{<set2>}); $s1->intersection($s2)

Array::AsObject::intersection (perl_code) [op:intersect]

Code template:

my $s1 = Array::AsObject->new(@{<set1>}); my $s2 = Array::AsObject->new(@{<set2>}); $s1->intersection($s2, 1)

Set::Object::intersection (perl_code) [op:intersect]

Code template:

my $s1 = Set::Object->new(@{<set1>}); my $s2 = Set::Object->new(@{<set2>}); $s1->intersection($s2)

Set::Tiny::intersection (perl_code) [op:intersect]

Code template:

my $s1 = Set::Tiny->new(@{<set1>}); my $s2 = Set::Tiny->new(@{<set2>}); $s1->intersection($s2)

List::Collection::intersect (perl_code) [op:intersect]

Code template:
```
[List::Collection::intersect(<set1>, <set2>)]
```

BENCHMARK DATASETS

num10
num100

SAMPLE BENCHMARK RESULTS

Run on: perl: v5.24.0, CPU: Intel(R) Core(TM) i7-4770 CPU @ 3.40GHz (4 cores), OS: GNU/Linux Debian version 8.5, OS kernel: Linux version 3.16.0-4-amd64.

Benchmark with default options (bencher -m SetOperationModules):

#table1#
{dataset=>"num10",p_tags=>"op:diff"}
+-----------------------------+-----------+-----------+------------+---------+---------+
| participant                 | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+-----------------------------+-----------+-----------+------------+---------+---------+
| Set::Scalar::difference     |     12000 |   80      |      1     | 1.3e-07 |      20 |
| Array::AsObject::difference |     24000 |   41.7    |      1.92  | 1.3e-08 |      20 |
| Set::Array::difference      |     67000 |   15      |      5.3   | 1.9e-08 |      22 |
| Set::Object::difference     |    114000 |    8.74   |      9.16  | 3.3e-09 |      20 |
| Set::Tiny::difference       |    141000 |    7.08   |     11.3   |   3e-09 |      24 |
| List::Collection::subtract  |    190000 |    5.3    |     15     | 6.7e-09 |      20 |
| Array::Set::set_diff        |    226000 |    4.42   |     18.1   | 1.7e-09 |      20 |
| Array::Utils::array_minus   |    263070 |    3.8013 |     21.053 | 2.9e-11 |      21 |
+-----------------------------+-----------+-----------+------------+---------+---------+

#table2#
{dataset=>"num100",p_tags=>"op:diff"}
+-----------------------------+-----------+-----------+------------+---------+---------+
| participant                 | rate (/s) | time (ms) | vs_slowest |  errors | samples |
+-----------------------------+-----------+-----------+------------+---------+---------+
| Array::AsObject::difference |       460 |    2.2    |        1   | 4.2e-06 |      21 |
| Set::Scalar::difference     |      2200 |    0.46   |        4.7 | 2.4e-06 |      21 |
| Set::Array::difference      |     13000 |    0.078  |       28   | 4.2e-07 |      21 |
| Set::Object::difference     |     15000 |    0.068  |       32   |   8e-08 |      20 |
| Set::Tiny::difference       |     17000 |    0.058  |       37   | 1.1e-07 |      20 |
| Array::Set::set_diff        |     29000 |    0.035  |       62   | 5.3e-08 |      20 |
| Array::Utils::array_minus   |     30000 |    0.034  |       64   | 5.3e-08 |      20 |
| List::Collection::subtract  |     29600 |    0.0338 |       64.5 |   1e-08 |      34 |
+-----------------------------+-----------+-----------+------------+---------+---------+

#table3#
{dataset=>"num10",p_tags=>"op:intersect"}
+-------------------------------+-----------+-----------+------------+---------+---------+
| participant                   | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+-------------------------------+-----------+-----------+------------+---------+---------+
| Set::Scalar::intersection     |     11000 |  90       |     1      | 1.1e-07 |      30 |
| Array::AsObject::intersection |     11000 |  90       |     1      |   1e-07 |      22 |
| List::Collection::intersect   |     18000 |  55       |     1.6    | 9.7e-08 |      24 |
| Set::Array::intersection      |     36000 |  28       |     3.3    | 3.7e-08 |      24 |
| Set::Object::intersection     |     91400 |  10.9     |     8.21   | 3.3e-09 |      20 |
| Set::Tiny::intersection       |    155572 |   6.42789 |    13.9869 |   0     |      38 |
| Array::Set::set_intersect     |    176000 |   5.69    |    15.8    | 1.6e-09 |      22 |
| Array::Utils::intersect       |    249390 |   4.0098  |    22.422  | 2.3e-11 |      20 |
+-------------------------------+-----------+-----------+------------+---------+---------+

#table4#
{dataset=>"num100",p_tags=>"op:intersect"}
+-------------------------------+-----------+-----------+------------+---------+---------+
| participant                   | rate (/s) | time (ms) | vs_slowest |  errors | samples |
+-------------------------------+-----------+-----------+------------+---------+---------+
| Array::AsObject::intersection |       223 |    4.48   |       1    | 2.5e-06 |      20 |
| Set::Array::intersection      |       595 |    1.68   |       2.66 | 1.1e-06 |      20 |
| List::Collection::intersect   |      1400 |    0.73   |       6.2  | 2.2e-06 |      20 |
| Set::Scalar::intersection     |      1980 |    0.505  |       8.87 | 2.1e-07 |      20 |
| Set::Object::intersection     |     11000 |    0.092  |      49    | 1.1e-07 |      27 |
| Set::Tiny::intersection       |     18000 |    0.056  |      80    |   1e-07 |      21 |
| Array::Set::set_intersect     |     20800 |    0.0482 |      92.9  | 1.3e-08 |      22 |
| Array::Utils::intersect       |     27900 |    0.0358 |     125    | 1.1e-08 |      28 |
+-------------------------------+-----------+-----------+------------+---------+---------+

#table5#
{dataset=>"num10",p_tags=>"op:symdiff"}
+---------------------------------------+-----------+-----------+------------+---------+---------+
| participant                           | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+---------------------------------------+-----------+-----------+------------+---------+---------+
| Array::AsObject::symmetric_difference |    5110   |  196      |     1      | 4.9e-08 |      24 |
| List::Collection::complement          |    7900   |  130      |     1.5    | 6.9e-07 |      20 |
| Set::Scalar::symmetric_difference     |   19000   |   53      |     3.7    | 1.3e-07 |      21 |
| Set::Object::symmetric_difference     |   62900   |   15.9    |    12.3    | 6.1e-09 |      24 |
| Set::Array::symmetric_difference      |   73714.5 |   13.5659 |    14.4262 |   0     |      20 |
| Set::Tiny::symmetric_difference       |  130000   |    7.6    |    26      | 1.3e-08 |      20 |
| Array::Set::set_symdiff               |  173400   |    5.767  |    33.93   | 9.8e-11 |      21 |
| Array::Utils::array_diff              |  216300   |    4.622  |    42.34   | 1.9e-10 |      22 |
| List::MoreUtils::PP::singleton        |  235000   |    4.25   |    46.1    | 1.5e-09 |      26 |
| List::MoreUtils::XS::singleton        |  414000   |    2.41   |    81.1    | 7.5e-10 |      25 |
+---------------------------------------+-----------+-----------+------------+---------+---------+

#table6#
{dataset=>"num100",p_tags=>"op:symdiff"}
+---------------------------------------+-----------+-----------+------------+---------+---------+
| participant                           | rate (/s) | time (ms) | vs_slowest |  errors | samples |
+---------------------------------------+-----------+-----------+------------+---------+---------+
| Array::AsObject::symmetric_difference |       110 |    9.3    |          1 | 2.8e-05 |      20 |
| List::Collection::complement          |       530 |    1.9    |          5 | 3.8e-06 |      20 |
| Set::Scalar::symmetric_difference     |      3000 |    0.34   |         28 | 6.1e-07 |      22 |
| Set::Object::symmetric_difference     |      9400 |    0.11   |         87 | 1.5e-07 |      24 |
| Set::Array::symmetric_difference      |     13300 |    0.0752 |        124 | 2.7e-08 |      20 |
| Set::Tiny::symmetric_difference       |     16000 |    0.063  |        150 | 9.9e-08 |      23 |
| Array::Set::set_symdiff               |     20800 |    0.0481 |        193 | 1.3e-08 |      20 |
| List::MoreUtils::PP::singleton        |     26200 |    0.0381 |        244 | 1.2e-08 |      25 |
| Array::Utils::array_diff              |     26700 |    0.0375 |        249 | 1.3e-08 |      20 |
| List::MoreUtils::XS::singleton        |     42800 |    0.0234 |        398 |   6e-09 |      25 |
+---------------------------------------+-----------+-----------+------------+---------+---------+

#table7#
{dataset=>"num10",p_tags=>"op:union"}
+---------------------------+-----------+-----------+------------+---------+---------+
| participant               | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+---------------------------+-----------+-----------+------------+---------+---------+
| Set::Scalar::union        |     12000 |  85       |     1      | 1.3e-07 |      20 |
| List::Collection::union   |     17000 |  60       |     1.4    | 2.1e-07 |      21 |
| Array::AsObject::union    |     75100 |  13.3     |     6.38   | 6.7e-09 |      20 |
| Set::Array::union         |     97000 |  10       |     8.2    | 1.3e-08 |      20 |
| Set::Object::union        |    110000 |   8.9     |     9.5    | 1.3e-08 |      20 |
| Set::Tiny::union          |    150000 |   6.6     |    13      |   1e-08 |      20 |
| Array::Set::set_union     |    180000 |   5.5     |    16      | 6.7e-09 |      20 |
| List::MoreUtils::PP::uniq |    320000 |   3.2     |    27      | 6.7e-09 |      20 |
| List::MoreUtils::XS::uniq |    512740 |   1.95031 |    43.5071 |   0     |      24 |
| Array::Utils::unique      |    849000 |   1.18    |    72.1    | 4.2e-10 |      20 |
+---------------------------+-----------+-----------+------------+---------+---------+

#table8#
{dataset=>"num100",p_tags=>"op:union"}
+---------------------------+-----------+-----------+------------+---------+---------+
| participant               | rate (/s) | time (μs) | vs_slowest |  errors | samples |
+---------------------------+-----------+-----------+------------+---------+---------+
| List::Collection::union   |       920 |  1100     |      1     | 2.2e-06 |      20 |
| Set::Scalar::union        |      2130 |   469     |      2.31  | 4.3e-07 |      20 |
| Array::AsObject::union    |     11000 |    91     |     12     |   3e-07 |      26 |
| Set::Object::union        |     14000 |    71     |     15     | 2.1e-07 |      20 |
| Set::Tiny::union          |     18000 |    57     |     19     | 1.1e-07 |      20 |
| Set::Array::union         |     18000 |    56     |     19     | 1.1e-07 |      20 |
| Array::Set::set_union     |     22168 |    45.111 |     24.076 | 5.8e-11 |      25 |
| List::MoreUtils::PP::uniq |     34600 |    28.9   |     37.6   | 1.2e-08 |      24 |
| List::MoreUtils::XS::uniq |     55900 |    17.9   |     60.7   | 5.8e-09 |      26 |
| Array::Utils::unique      |    260000 |     3.9   |    280     | 6.7e-09 |      20 |
+---------------------------+-----------+-----------+------------+---------+---------+

Benchmark module startup overhead (bencher -m SetOperationModules --module-startup):

#table9#
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| participant         | proc_private_dirty_size (MB) | proc_rss_size (MB) | proc_size (MB) | time (ms) | mod_overhead_time (ms) | vs_slowest |  errors | samples |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+
| List::Collection    | 0.93                         | 4.3                | 20             |      14   |                   11.4 |        1   | 3.3e-05 |      20 |
| Set::Array          | 3                            | 6.5                | 26             |      14   |                   11.4 |        1   | 6.6e-05 |      20 |
| Array::AsObject     | 2.2                          | 5.6                | 23             |      14   |                   11.4 |        1   | 5.9e-05 |      20 |
| Set::Object         | 1                            | 4.4                | 20             |      12   |                    9.4 |        1.2 | 2.7e-05 |      20 |
| Set::Scalar         | 1.2                          | 4.5                | 20             |      11   |                    8.4 |        1.3 | 3.2e-05 |      20 |
| List::MoreUtils     | 1.1                          | 4.4                | 20             |       8.4 |                    5.8 |        1.7 |   5e-05 |      20 |
| List::MoreUtils::PP | 1.6                          | 5                  | 23             |       5.7 |                    3.1 |        2.5 | 3.2e-05 |      20 |
| Array::Set          | 2.7                          | 6.1                | 28             |       5.2 |                    2.6 |        2.8 | 2.7e-05 |      20 |
| Set::Tiny           | 2.3                          | 5.7                | 27             |       3.8 |                    1.2 |        3.8 | 1.7e-05 |      20 |
| Array::Utils        | 1.9                          | 5.3                | 23             |       3.7 |                    1.1 |        3.9 | 2.2e-05 |      20 |
| perl -e1 (baseline) | 0.93                         | 4.3                | 20             |       2.6 |                    0   |        5.6 | 6.5e-06 |      20 |
+---------------------+------------------------------+--------------------+----------------+-----------+------------------------+------------+---------+---------+

To display as an interactive HTML table on a browser, you can add option --format html+datatables.

HOMEPAGE

Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenario-SetOperationModules.

SOURCE

Source repository is at https://github.com/perlancar/perl-Bencher-Scenario-SetOperationModules.

BUGS

Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenario-SetOperationModules

When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.

AUTHOR

perlancar <perlancar@cpan.org>

COPYRIGHT AND LICENSE

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

To install Bencher::Scenario::SetOperationModules, copy and paste the appropriate command in to your terminal.

cpanm

cpanm Bencher::Scenario::SetOperationModules

CPAN shell

perl -MCPAN -e shell
install Bencher::Scenario::SetOperationModules

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	POD
`g` `a`	Go to author
`g` `c`	Go to changes
`g` `i`	Go to issues
`g` `d`	Go to dist
`g` `r`	Go to repository/SCM
`g` `s`	Go to source
`g` `b`	Go to file browse

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)

NAME

VERSION

SYNOPSIS

DESCRIPTION

BENCHMARKED MODULES

BENCHMARK PARTICIPANTS

BENCHMARK DATASETS

SAMPLE BENCHMARK RESULTS

HOMEPAGE

SOURCE

BUGS

SEE ALSO

AUTHOR

COPYRIGHT AND LICENSE

Module Install Instructions