Changes for version 0.14 - 2015-10-22
- Added experimental MySQL support for queue (harshals).
- Improved documentations.
- Added some example codes.
- Improved form submittion emulation on unselected and multi selected options.
Modules
A web crawling framework for Perl
Single crawler job
Crawler queue base class
Crawler queue with memory
Crawler queue with Mysql [EXPERIMENTAL]
Scraper utitlities
Crawler specific featured user agent