/ 
Gungho-0.09000
River stage one • 1 direct dependent • 1 total dependent

Changes for version 0.09000

  • General
    • We shall call this the beta release.
    • Redo main doc
    • Change defaults for Engine feature
    • Fix calls where $engine->_http_error() was happening to $c->_http_error()
  • RobotRules
    • Fix spurfulous exception

Documentation

gungho
An Extensible, High-Performance Web Crawler Framework

Modules

Gungho
Yet Another High Performance Web Crawler Framework
Gungho::Base
Base Class For Various Gungho Objects
Gungho::Base::Class
Base For Classes That Won't Be Instantiated
Gungho::Component
Component Base Class For Gungho
Gungho::Component::Authentication
Base Class For WWW Authentication
Gungho::Component::Authentication::Basic
Add Basic Auth To Gungho
Gungho::Component::BlockPrivateIP
Block Requests With Private IP Address
Gungho::Component::Cache
Use Cache In Your App
Gungho::Component::Core
Gungho Core Methods
Gungho::Component::RobotRules
Respect robots.txt
Gungho::Component::RobotRules::Rule
A Rule Object
Gungho::Component::RobotRules::Storage
RobotRules Storage Base Class
Gungho::Component::RobotRules::Storage::Cache
Cache Storage For RobotRules
Gungho::Component::RobotRules::Storage::DB_File
DB_File Storage For RobotRules
Gungho::Component::RobotsMETA
Automatically Parse Robots META
Gungho::Component::Scraper
Web::Scraper From Within Gungho
Gungho::Component::Setup
Routines To Setup Gungho
Gungho::Component::Throttle
Base Class To Throttle Requests
Gungho::Component::Throttle::Domain
Throttle By Domain
Gungho::Component::Throttle::Simple
Throttle By Number Of Requests
Gungho::Component::Throttle::Throttler
Data::Throttler Based Throttling
Gungho::Engine
Base Class For Gungho Engine
Gungho::Engine::Danga::Socket
Gungho Engine Using Danga::Socket
Gungho::Engine::IO::Async
IO::Async Engine
Gungho::Engine::POE
POE Engine For Gungho
Gungho::Exception
Gungho Exceptions
Gungho::Handler
Base Class For Gungho Handlers
Gungho::Handler::FileWriter::Simple
Write Out Fetched Contents To File
Gungho::Handler::Null
A Handler That Does Nothing
Gungho::Inline
Inline Your Providers And Handlers
Gungho::Log
Log Base Class For Gungho
Gungho::Log::Dispatch
Log::Dispatch-Based Log For Gungho
Gungho::Log::Simple
Simple Gungho Log Class
Gungho::Plugin
Gungho Plugin Base Class
Gungho::Plugin::Apoptosis
Stop Execution In Long-Running Processes
Gungho::Plugin::RequestLog
Log Requests
Gungho::Plugin::RequestTimer
Keep Track Of Time To Finish Request
Gungho::Plugin::Statistics
Gather Crawler Statistics
Gungho::Plugin::Statistics::Format::XML
Format Statistics As XML
Gungho::Plugin::Statistics::Storage::SQLite
Gungho::Provider
Base Class For Gungho Prividers
Gungho::Provider::File::Simple
Provide Requests From A Simple File
Gungho::Provider::Simple
An In-Memory, Simple Provider
Gungho::Provider::YAML
Specify requests in YAML format
Gungho::Request
A Gungho Request Object
Gungho::Request::http
HTTP specific utilities
Gungho::Response
Gungho HTTP Response Object

Provides

Gungho::Engine::IO::Async::Impl::Select
in lib/Gungho/Engine/IO/Async.pm
Gungho::Handler::Inline
in lib/Gungho/Inline.pm
Gungho::Plugin::Apoptosis::Time
in lib/Gungho/Plugin/Apoptosis.pm
Gungho::Provider::Inline
in lib/Gungho/Inline.pm

Examples

Other files