NAME
TaskPipe::Task_Scrape::Settings - settings for TaskPipe::Task_Scrape
METHODS
- max_retries
 - 
The maximum number of times to retry if the request fails
 - require_referer
 - 
Exit with an error if set to 1 and no referer is provided (alongside url)
 - require_url
 - 
Exit with an error if set to 1 and no url is provided. If set to zero and no url is provided, the task will return an empty list
 - ua_mgr_module
 - 
The UserAgentManager module to use
 - ua_handler_module
 - 
The UserAgentHandler module to use
 
AUTHOR
Tom Gracey <tomgracey@gmail.com>
COPYRIGHT AND LICENSE
Copyright (c) Tom Gracey 2018
TaskPipe is free software, licensed under
The GNU Public License Version 3