NAME
MediaWiki::DumpFile::Benchmarks - Documentation on parsing speeds
ENVIRONMENT
The tests were conducted on a Debian/squeeze using the vendor supplied Perl version 5.10.1. All modules were installed from CPAN and not from the Debian package archives.
The host hardware is a 4 core Intel i7 at 2.8ghz with 16 GiB of RAM and disks that can read at 100 MiB/sec.
RESULTS
With out XML::CompactTree::XS
Chuvash Wikipedia
markup_density: 0.18934898819024
size: 39436366
tests:
- MiB/sec: 25.5846594466644
name: suite//MediaWiki-DumpFile-FastPages.t
percentage: 100
runtimes:
system: 0.04
total: 1.47
user: 1.43
- MiB/sec: 20.4399181448895
name: suite//MediaWiki-DumpFile-Pages_fastmode.t
percentage: 125
runtimes:
system: 0.04
total: 1.84
user: 1.8
- MiB/sec: 14.5210229291879
name: suite//MediaWiki-DumpFile-Compat_fastmode.t
percentage: 176
runtimes:
system: 0.03
total: 2.59
user: 2.56
- MiB/sec: 4.11481940772393
name: suite//Parse-MediaWikiDump.t
percentage: 621
runtimes:
system: 0.03
total: 9.14
user: 9.11
- MiB/sec: 3.87726282336048
name: suite//MediaWiki-DumpFile-Pages.t
percentage: 659
runtimes:
system: 0.03
total: 9.7
user: 9.67
- MiB/sec: 3.53140369827199
name: suite//MediaWiki-DumpFile-Compat.t
percentage: 724
runtimes:
system: 0.06
total: 10.65
user: 10.59
Simple English Wikipedia
markup_density: 0.202659609191331
size: 227681797
tests:
- MiB/sec: 30.0740002925376
name: suite//MediaWiki-DumpFile-FastPages.t
percentage: 100
runtimes:
system: 0.18
total: 7.22
user: 7.04
- MiB/sec: 24.3697286321124
name: suite//MediaWiki-DumpFile-Pages_fastmode.t
percentage: 123
runtimes:
system: 0.23
total: 8.91
user: 8.68
- MiB/sec: 20.2550636298621
name: suite//MediaWiki-DumpFile-Compat_fastmode.t
percentage: 148
runtimes:
system: 0.19
total: 10.72
user: 10.53
- MiB/sec: 4.21456292919491
name: suite//Parse-MediaWikiDump.t
percentage: 713
runtimes:
system: 0.12
total: 51.52
user: 51.4
- MiB/sec: 4.06770854462573
name: suite//MediaWiki-DumpFile-Pages.t
percentage: 739
runtimes:
system: 0.24
total: 53.38
user: 53.14
- MiB/sec: 3.79871032386497
name: suite//MediaWiki-DumpFile-Compat.t
percentage: 791
runtimes:
system: 0.28
total: 57.16
user: 56.88
With XML::CompactTree::XS
Chuvash Wikipedia
markup_density: 0.18934898819024
size: 39436366
tests:
- MiB/sec: 25.7598968401347
name: suite//MediaWiki-DumpFile-FastPages.t
percentage: 100
runtimes:
system: 0.03
total: 1.46
user: 1.43
- MiB/sec: 22.6562948112028
name: suite//MediaWiki-DumpFile-Pages_fastmode.t
percentage: 113
runtimes:
system: 0.06
total: 1.66
user: 1.6
- MiB/sec: 17.9949518596156
name: suite//MediaWiki-DumpFile-Compat_fastmode.t
percentage: 143
runtimes:
system: 0.04
total: 2.09
user: 2.05
- MiB/sec: 7.46219233861045
name: suite//MediaWiki-DumpFile-Pages.t
percentage: 345
runtimes:
system: 0.04
total: 5.04
user: 5
- MiB/sec: 6.45102047797542
name: suite//MediaWiki-DumpFile-Compat.t
percentage: 399
runtimes:
system: 0.05
total: 5.83
user: 5.78
- MiB/sec: 4.15574026371234
name: suite//Parse-MediaWikiDump.t
percentage: 619
runtimes:
system: 0.02
total: 9.05
user: 9.03
Simple English Wikipedia
markup_density: 0.202659609191331
size: 227681797
tests:
- MiB/sec: 27.9092907599128
name: suite//MediaWiki-DumpFile-FastPages.t
percentage: 100
runtimes:
system: 0.17
total: 7.78
user: 7.61
- MiB/sec: 26.19231388566
name: suite//MediaWiki-DumpFile-Pages_fastmode.t
percentage: 106
runtimes:
system: 0.15
total: 8.29
user: 8.14
- MiB/sec: 19.632394404351
name: suite//MediaWiki-DumpFile-Compat_fastmode.t
percentage: 142
runtimes:
system: 0.19
total: 11.06
user: 10.87
- MiB/sec: 7.20180040172874
name: suite//MediaWiki-DumpFile-Pages.t
percentage: 387
runtimes:
system: 0.27
total: 30.15
user: 29.88
- MiB/sec: 6.39382456160546
name: suite//MediaWiki-DumpFile-Compat.t
percentage: 436
runtimes:
system: 0.26
total: 33.96
user: 33.7
- MiB/sec: 4.14457495919301
name: suite//Parse-MediaWikiDump.t
percentage: 673
runtimes:
system: 0.12
total: 52.39
user: 52.27