Changes for version 0.15 - 2015-11-04
- Fixed a bug where Mysql queue has not skipped correctly.
- Fixed a bug where form submition emulation has failed on certain condition.
Modules
A web crawling framework for Perl
Single crawler job
Crawler queue base class
Crawler queue with memory
Crawler queue with Mysql [EXPERIMENTAL]
Scraper utitlities
Crawler specific featured user agent