NAME
Bencher::Scenario::LoggingModules::NullLogging - Benchmark logging statement that does not output anywhere (to measure logging overhead)
VERSION
This document describes version 0.002 of Bencher::Scenario::LoggingModules::NullLogging (from Perl distribution Bencher-Scenarios-LoggingModules), released on 2019-02-22.
SYNOPSIS
To run benchmark with default option:
% bencher -m LoggingModules::NullLoggingFor more options (dump scenario, list/include/exclude/add participants, list/include/exclude/add datasets, etc), see bencher or run bencher --help.
DESCRIPTION
Packaging a benchmark script as a Bencher scenario makes it convenient to include/exclude/add participants/datasets (either via CLI or Perl code), send the result to a central repository, among others . See Bencher and bencher (CLI) for more details.
BENCHMARKED MODULES
Version numbers shown below are the versions used when running the sample benchmark.
Log::Any 1.707
Log::Contextual 0.007001
Log::Dispatch::Null 2.65
Log::Dispatchouli 2.015
Log::Fast v2.0.0
Log::Log4perl 1.49
Log::Log4perl::Tiny 1.4.0
Log::Mini 0.0.1
Log::ger 0.025
Log::ger::Plugin::OptAway 0.006
BENCHMARK PARTICIPANTS
Log::Any-no_adapter-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -e my $log = Log::Any->get_logger; for(1..100_000) { $log->trace(q[]) }Log::Any-null_adapter-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Any -MLog::Any::Adapter -e Log::Any::Adapter->set(q[Null]); my $log = Log::Any->get_logger; for(1..100_000) { $log->trace(q[]) }Log::Contextual+Log4perl-100k_trace (command)
Command line:
#TEMPLATE: #perl -e use Log::Contextual ":log", "set_logger"; use Log::Log4perl ":easy"; Log::Log4perl->easy_init($DEBUG); my $logger = Log::Log4perl->get_logger; set_logger $logger; for(1..100_000) { log_trace {} }Log::Contextual+SimpleLogger-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Contextual::SimpleLogger -e use Log::Contextual ":log", -logger=>Log::Contextual::SimpleLogger->new({levels=>["debug"]}); for(1..100_000) { log_trace {} }Log::Dispatch::Null-100k_debug (command)
Command line:
#TEMPLATE: #perl -MLog::Dispatch -e my $null = Log::Dispatch->new(outputs=>[["Null", min_level=>"debug"]]); for(1..100_000) { $null->debug("") }Log::Dispatchouli-100k_debug (command)
Command line:
#TEMPLATE: #perl -MLog::Dispatchouli -e $logger = Log::Dispatchouli->new({ident=>"ident", facility=>"facility", to_stdout=>1, debug=>0}); for(1..100_000) { $logger->log_debug("") }Log::Fast-100k_DEBUG (command)
Command line:
#TEMPLATE: #perl -MLog::Fast -e $LOG = Log::Fast->global; $LOG->level("INFO"); for(1..100_000) { $LOG->DEBUG(q()) }Log::ger-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger -e for(1..100_000) { log_trace(q[]) }Log::ger+LGP:OptAway-100k_log_trace (command)
Command line:
#TEMPLATE: #perl -MLog::ger::Plugin=OptAway -MLog::ger -e for(1..100_000) { log_trace(q[]) }Log::Log4perl-easy-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Log4perl=:easy -e Log::Log4perl->easy_init($ERROR); for(1..100_000) { TRACE "" }Log::Log4perl::Tiny-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Log4perl::Tiny=:easy -e for(1..100_000) { TRACE "" }Log::Mini-100k_trace (command)
Command line:
#TEMPLATE: #perl -MLog::Mini -e $log = Log::Mini->new("stderr"); for(1..100_000) { $log->trace(q[]) }Mojo::Log-100k_debug (command)
Command line:
#TEMPLATE: #perl -MMojo::Log -e $log = Mojo::Log->new(level=>"warn"); for(1..100_000) { $log->debug("") }
SAMPLE BENCHMARK RESULTS
Run on: perl: v5.26.0, CPU: Intel(R) Core(TM) i5-2400 CPU @ 3.10GHz (4 cores), OS: GNU/Linux LinuxMint version 18.2, OS kernel: Linux version 4.8.0-53-generic.
Benchmark with default options (bencher -m LoggingModules::NullLogging):
#table1#
+-----------------------------------------+-----------+-------+------------+-----------+---------+
| participant | rate (/s) | time | vs_slowest | errors | samples |
+-----------------------------------------+-----------+-------+------------+-----------+---------+
| Log::Dispatch::Null-100k_debug | 0.6 | 1.7 | 1 | 0.0018 | 6 |
| Log::Contextual+Log4perl-100k_trace | 1.5 | 0.66 | 2.5 | 0.004 | 7 |
| Log::Contextual+SimpleLogger-100k_trace | 1.6 | 0.63 | 2.6 | 0.0012 | 6 |
| Mojo::Log-100k_debug | 3 | 0.3 | 5 | 0.0068 | 7 |
| Log::Dispatchouli-100k_debug | 4.9 | 0.2 | 8.2 | 0.00047 | 7 |
| Log::Log4perl::Tiny-100k_trace | 7.5 | 0.13 | 13 | 0.00014 | 6 |
| Log::Mini-100k_trace | 11 | 0.088 | 19 | 0.0002 | 6 |
| Log::Any-null_adapter-100k_log_trace | 13 | 0.078 | 22 | 0.00028 | 6 |
| Log::Log4perl-easy-100k_trace | 15 | 0.066 | 25 | 0.00027 | 7 |
| Log::Fast-100k_DEBUG | 20 | 0.05 | 30 | 0.00092 | 7 |
| Log::Any-no_adapter-100k_log_trace | 35 | 0.029 | 58 | 4e-05 | 6 |
| Log::ger+LGP:OptAway-100k_log_trace | 40 | 0.02 | 70 | 0.00069 | 7 |
| Log::ger-100k_log_trace | 51 | 0.019 | 86 | 9.9e-05 | 6 |
+-----------------------------------------+-----------+-------+------------+-----------+---------+To display as an interactive HTML table on a browser, you can add option --format html+datatables.
HOMEPAGE
Please visit the project's homepage at https://metacpan.org/release/Bencher-Scenarios-LoggingModules.
SOURCE
Source repository is at https://github.com/perlancar/perl-Bencher-Scenarios-LoggingModules.
BUGS
Please report any bugs or feature requests on the bugtracker website https://rt.cpan.org/Public/Dist/Display.html?Name=Bencher-Scenarios-LoggingModules
When submitting a bug or request, please include a test-file or a patch to an existing test-file that illustrates the bug or desired feature.
AUTHOR
perlancar <perlancar@cpan.org>
COPYRIGHT AND LICENSE
This software is copyright (c) 2019 by perlancar@cpan.org.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.