NAME
Gungho::Component::RobotRules::Storage - RobotRules Storage Base Class
METHODS
storage
Holds the actual storage backend
get_rule
Gets a rule for a particular URL
put_rule
Stores a rule for a particular URL
get_pending_robots_txt
Returns a list of requests that were waiting for that particular robots.txt information
push_pending_robots_txt
Adds a request to the list of requests waiting for a particular robots.txt information