WWW-3172-Crawler-0.001

Changes for version 0.001 - 2011-10-03

First stab at the crawler
- Required stats: meta description and keywords
- Extra stats: load time, size
- Extra features: Obeys robots.txt, crawls from most linked-to to least

command-line script to control WWW::3172::Crawler

A simple web crawler for CSCI 3172 Assignment 1

To install WWW::3172::Crawler, copy and paste the appropriate command in to your terminal.

cpanm WWW::3172::Crawler

perl -MCPAN -e shell
install WWW::3172::Crawler

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)