Changes for version 1.821 - 2017-04-02
- Updated MCE::Shared::Queue. The following provides a comparison for the enhancements made regarding IPC during 1.818 through 1.821, in order to run on machines having "many" cores. I ran with 12, 96, and 192 workers on an 8 core box.
- Shared queue, dequeue 100k items.
- my $Q = MCE::Shared->queue();
- $Q->enqueue( 1 .. 100000 ); $Q->end;
- MCE->new( max_workers => 12, 96, or 192, user_func => sub { while ( defined ( my $item = $Q->dequeue ) ) { ; } } )->run;
- MCE::Shared 1.821: 12 ~ 1.325 secs 96 ~ 5.206 secs 192 ~ 8.158 secs MCE::Shared 1.825: ~ 0.913 secs ~ 1.068 secs ~ 1.560 secs
- Shared queue, dequeue 100k items.
- Results were captured on a fast 8 core system running CentOS Linux 7. The thing to take from this is that running many workers "no longer" results in up to 6.2x penalty regarding IPC.
- When IO::FDPass is missing, croak with error if constructing a Condvar or Queue and forgotten to start the shared-manager process manually.
- Bumped MCE dependency to 1.825.
Modules
A threads-like parallelization module
MCE extension for sharing data supporting threads and processes
Array helper class
Base package for helper classes
A hybrid LRU-plain cache helper class
Condvar helper class
Handle helper class
Hash helper class
A pure-Perl in-memory data store
An ordered hash class featuring tombstone deletion
Hybrid-queue helper class
Scalar helper class
Sequence helper class
Server/Object packages for MCE::Shared