Changes for version 0.5

  • Added WWW::Crawl::Auto An alternative Crawl module to Auto-detect whether to use HTTP or Chromium.
  • Added retry_count/debug options. Made the Chromium module more robust.

Modules

A simple web crawler for extracting links and more from web pages
Crawl pages and automatically switch between HTTP and Chromium
Crawl JavaScript-rendered pages with Chromium