NAME

Xango::Broker::Pull - Xango's Pull-Crawler

SYNOPSIS

use Xango::Broker::Pull;
Xango::Broker::Pull->spawn(
  ...
);

DESCRIPTION

Xango::Broker::Pull implements the pull-model crawler for Xango, where jobs that need to be fetched are pulled from a source periodically.

METHODS

new

new() accepts the following parameters, which can also be written in an config file used by Xango::Config. If you use a config file, then the values in the config file will be treated as the default, and the parameters passed to new() can override them.

JobRetrievalDelay (integer)

The number of seconds to wait between calls to 'retrieve_job' state of the handler session. The default is 15 seconds.

MaxSilenceInterval (integer)

The number of seconds that we allow an agent to be inactive for. Once a fetcher session is inactive for this much amount of time, the sessions is stopped via detach_child(). The default is 300 seconds.

states

Inherited from Xango::Broker::Base.

STATES

dispatch_job

Entry point.

pull_jobs

Interface to ask the handler to pull new jobs to be processed

get_http_comp_state

get_ready_fetchers

SEE ALSO

Xango::Broker::Base, Xango::Broker::Push

AUTHOR

Copyright (c) 2005 Daisuke Maki <dmaki@cpan.org>. All rights reserved. Development funded by Brazil, Ltd. <http://b.razil.jp>