Changes for version 0.4

  • Added extra callback parameter containing the body of the page Increased default timeout to 120 seconds

Modules

A simple web crawler for extracting links and more from web pages
Crawl JavaScript-rendered pages with Chromium