NAME

MediaWiki::DumpFile::Benchmarks - Documentation on parsing speeds

ENVIRONMENT

The tests were conducted on a Debian/squeeze using the vendor supplied Perl version 5.10.1. All modules were installed from CPAN and not from the Debian package archives.

The host hardware is a 4 core Intel i7 at 2.8ghz with 16 GiB of RAM and disks that can read at 100 MiB/sec.

RESULTS

With out XML::CompactTree::XS

Chuvash Wikipedia

markup_density: 0.18934898819024
size: 39436366
tests:
  - MiB/sec: 25.5846594466644
    name: suite//MediaWiki-DumpFile-FastPages.t
    percentage: 100
    runtimes:
      system: 0.04
      total: 1.47
      user: 1.43
  - MiB/sec: 20.4399181448895
    name: suite//MediaWiki-DumpFile-Pages_fastmode.t
    percentage: 125
    runtimes:
      system: 0.04
      total: 1.84
      user: 1.8
  - MiB/sec: 14.5210229291879
    name: suite//MediaWiki-DumpFile-Compat_fastmode.t
    percentage: 176
    runtimes:
      system: 0.03
      total: 2.59
      user: 2.56
  - MiB/sec: 4.11481940772393
    name: suite//Parse-MediaWikiDump.t
    percentage: 621
    runtimes:
      system: 0.03
      total: 9.14
      user: 9.11
  - MiB/sec: 3.87726282336048
    name: suite//MediaWiki-DumpFile-Pages.t
    percentage: 659
    runtimes:
      system: 0.03
      total: 9.7
      user: 9.67
  - MiB/sec: 3.53140369827199
    name: suite//MediaWiki-DumpFile-Compat.t
    percentage: 724
    runtimes:
      system: 0.06
      total: 10.65
      user: 10.59

Simple English Wikipedia

markup_density: 0.202659609191331
size: 227681797
tests:
  - MiB/sec: 30.0740002925376
    name: suite//MediaWiki-DumpFile-FastPages.t
    percentage: 100
    runtimes:
      system: 0.18
      total: 7.22
      user: 7.04
  - MiB/sec: 24.3697286321124
    name: suite//MediaWiki-DumpFile-Pages_fastmode.t
    percentage: 123
    runtimes:
      system: 0.23
      total: 8.91
      user: 8.68
  - MiB/sec: 20.2550636298621
    name: suite//MediaWiki-DumpFile-Compat_fastmode.t
    percentage: 148
    runtimes:
      system: 0.19
      total: 10.72
      user: 10.53
  - MiB/sec: 4.21456292919491
    name: suite//Parse-MediaWikiDump.t
    percentage: 713
    runtimes:
      system: 0.12
      total: 51.52
      user: 51.4
  - MiB/sec: 4.06770854462573
    name: suite//MediaWiki-DumpFile-Pages.t
    percentage: 739
    runtimes:
      system: 0.24
      total: 53.38
      user: 53.14
  - MiB/sec: 3.79871032386497
    name: suite//MediaWiki-DumpFile-Compat.t
    percentage: 791
    runtimes:
      system: 0.28
      total: 57.16
      user: 56.88

With XML::CompactTree::XS

Chuvash Wikipedia

markup_density: 0.18934898819024
size: 39436366
tests:
  - MiB/sec: 25.7598968401347
    name: suite//MediaWiki-DumpFile-FastPages.t
    percentage: 100
    runtimes:
      system: 0.03
      total: 1.46
      user: 1.43
  - MiB/sec: 22.6562948112028
    name: suite//MediaWiki-DumpFile-Pages_fastmode.t
    percentage: 113
    runtimes:
      system: 0.06
      total: 1.66
      user: 1.6
  - MiB/sec: 17.9949518596156
    name: suite//MediaWiki-DumpFile-Compat_fastmode.t
    percentage: 143
    runtimes:
      system: 0.04
      total: 2.09
      user: 2.05
  - MiB/sec: 7.46219233861045
    name: suite//MediaWiki-DumpFile-Pages.t
    percentage: 345
    runtimes:
      system: 0.04
      total: 5.04
      user: 5
  - MiB/sec: 6.45102047797542
    name: suite//MediaWiki-DumpFile-Compat.t
    percentage: 399
    runtimes:
      system: 0.05
      total: 5.83
      user: 5.78
  - MiB/sec: 4.15574026371234
    name: suite//Parse-MediaWikiDump.t
    percentage: 619
    runtimes:
      system: 0.02
      total: 9.05
      user: 9.03

Simple English Wikipedia

markup_density: 0.202659609191331
size: 227681797
tests:
  - MiB/sec: 27.9092907599128
    name: suite//MediaWiki-DumpFile-FastPages.t
    percentage: 100
    runtimes:
      system: 0.17
      total: 7.78
      user: 7.61
  - MiB/sec: 26.19231388566
    name: suite//MediaWiki-DumpFile-Pages_fastmode.t
    percentage: 106
    runtimes:
      system: 0.15
      total: 8.29
      user: 8.14
  - MiB/sec: 19.632394404351
    name: suite//MediaWiki-DumpFile-Compat_fastmode.t
    percentage: 142
    runtimes:
      system: 0.19
      total: 11.06
      user: 10.87
  - MiB/sec: 7.20180040172874
    name: suite//MediaWiki-DumpFile-Pages.t
    percentage: 387
    runtimes:
      system: 0.27
      total: 30.15
      user: 29.88
  - MiB/sec: 6.39382456160546
    name: suite//MediaWiki-DumpFile-Compat.t
    percentage: 436
    runtimes:
      system: 0.26
      total: 33.96
      user: 33.7
  - MiB/sec: 4.14457495919301
    name: suite//Parse-MediaWikiDump.t
    percentage: 673
    runtimes:
      system: 0.12
      total: 52.39
      user: 52.27