NAME

TaskPipe::ThreadManager::Settings - Settings for TaskPipe::ThreadManager

METHODS

max_threads

The maximum number of threads to use when running a plan. Taskpipe tries to adhere strictly to the number of threads you specify here - so parent threads are included in the value. You should experiment with your setup to determine the optimum value for your system

refresh_mins

The number of minutes after which a thread should be refreshed. Refreshing a thread has the same effect as stopping the thread and running it again - it resumes where it left off, but obviously there is a performance penalty. The point of doing this is to mitigate memory leaks which occur in long running code. The less leaky the code, the longer refresh_mins can be. (However, even LWP::UserAgent and Web::Scraper both appear to leak slightly in long runs, so it is probably better to accept leaks as a fact of life and compensate for them rather than spending hours trying to eliminate them entirely.)

thread_table_deadlock_retries

The number of times to retry an update to the thread table in the event of a "serialization failure" (deadlock)

AUTHOR

Tom Gracey <tomgracey@gmail.com>

COPYRIGHT AND LICENSE

Copyright (c) Tom Gracey 2018

TaskPipe is free software, licensed under

The GNU Public License Version 3