NAME
Minion::Backend::Sereal - File backend for Minion job queues.
SYNOPSIS
use Minion::Backend::Sereal;
my $backend = Minion::Backend::Sereal->new('/some/path/minion.data');
DESCRIPTION
Minion::Backend::Sereal is a highly portable file-based backend for Minion. It is 2--3x as fast as the Storable backend.
This version supports Minion v7.01.
ATTRIBUTES
Minion::Backend::Sereal inherits all attributes from Minion::Backend and implements the following new one.
file
my $file = $backend->file;
$backend = $backend->file('/some/path/minion.data');
File all data is stored in.
METHODS
Minion::Backend::Sereal inherits all methods from Minion::Backend and implements the following new ones.
broadcast
my $bool = $backend->broadcast('some_command');
my $bool = $backend->broadcast('some_command', [@args]);
my $bool = $backend->broadcast('some_command', [@args], [$id1, $id2, $id3]);
Broadcast remote control command to one or more workers.
dequeue
my $job_info = $backend->dequeue($worker_id, 0.5);
my $job_info = $backend->dequeue($worker_id, 0.5, {queues => ['important']});
Wait a given amount of time in seconds for a job, dequeue it and transition from inactive to active state, or return undef if queues were empty.
These options are currently available:
- queues
-
queues => ['important']One or more queues to dequeue jobs from, defaults to
default.
These fields are currently available:
- args
-
args => ['foo', 'bar']Job arguments.
- id
-
id => '10023'Job id.
- retries
-
retries => 3Number of times job has been retried.
- task
-
task => 'foo'Task name.
enqueue
my $job_id = $backend->enqueue('foo');
my $job_id = $backend->enqueue(foo => [@args]);
my $job_id = $backend->enqueue(foo => [@args] => {priority => 1});
Enqueue a new job with inactive state.
These options are currently available:
- attempts
-
attempts => 25Number of times performing this job will be attempted, with a delay based on "backoff" in Minion after the first attempt, defaults to
1. - delay
-
delay => 10Delay job for this many seconds (from now), defaults to
0. - notes
-
notes => {foo => 'bar', baz => [1, 2, 3]}Hash reference with arbitrary metadata for this job.
- parents
-
parents => [$id1, $id2, $id3]One or more existing jobs this job depends on, and that need to have transitioned to the state
finishedbefore it can be processed. - priority
-
priority => 5Job priority, defaults to
0. Jobs with a higher priority get performed first. - queue
-
queue => 'important'Queue to put job in, defaults to
default.
fail_job
my $bool = $backend->fail_job($job_id, $retries);
my $bool = $backend->fail_job($job_id, $retries, 'Something went wrong!');
my $bool = $backend->fail_job($job_id, $retries, {msg => 'Wrong, wrong!'});
Transition from active to failed state, and if there are attempts remaining, transition back to inactive with a delay based on "backoff" in Minion.
finish_job
my $bool = $backend->finish_job($job_id, $retries);
my $bool = $backend->finish_job($job_id, $retries, 'All went well!');
my $bool = $backend->finish_job($job_id, $retries, {msg => 'All went well!'});
Transition from active to finished state.
job_info
my $job_info = $backend->job_info($job_id);
Get information about a job, or return undef if job does not exist.
# Check job state
my $state = $backend->job_info($job_id)->{state};
# Get job result
my $result = $backend->job_info($job_id)->{result};
These fields are currently available:
- args
-
args => ['foo', 'bar']Job arguments.
- attempts
-
attempts => 25Number of times performing this job will be attempted.
- children
-
children => ['10026', '10027', '10028']Jobs depending on this job.
- created
-
created => 784111777Epoch time job was created.
- delayed
-
delayed => 784111777Epoch time job was delayed to.
- finished
-
finished => 784111777Epoch time job was finished.
- notes
-
notes => {foo => 'bar', baz => [1, 2, 3]}Hash reference with arbitrary metadata for this job.
- parents
-
parents => ['10023', '10024', '10025']Jobs this job depends on.
- priority
-
priority => 3Job priority.
- queue
-
queue => 'important'Queue name.
- result
-
result => 'All went well!'Job result.
- retried
-
retried => 784111777Epoch time job has been retried.
- retries
-
retries => 3Number of times job has been retried.
- started
-
started => 784111777Epoch time job was started.
- state
-
state => 'inactive'Current job state, usually
inactive,active,failed, orfinished. - task
-
task => 'foo'Task name.
- worker
-
worker => '154'Id of worker that is processing the job.
list_jobs
my $batch = $backend->list_jobs($offset, $limit);
my $batch = $backend->list_jobs($offset, $limit, {state => 'inactive'});
Returns the same information as "job_info" but in batches.
These options are currently available:
- queue
-
queue => 'important'List only jobs in this queue.
- state
-
state => 'inactive'List only jobs in this state.
- task
-
task => 'test'List only jobs for this task.
list_workers
my $batch = $backend->list_workers($offset, $limit);
Returns the same information as "worker_info" but in batches.
lock
my $bool = $backend->lock('foo', 3600);
my $bool = $backend->lock('foo', 3600, {limit => 20});
Try to acquire a named lock that will expire automatically after the given amount of time in seconds.
These options are currently available:
- limit
-
limit => 20Number of shared locks with the same name that can be active at the same time, defaults to
1.
new
my $backend = Minion::Backend::Sereal->new('/some/path/minion.data');
Construct a new Minion::Backend::Sereal object.
note
my $bool = $backend->note($job_id, foo => 'bar');
Change a metadata field for a job.
receive
my $commands = $backend->receive($worker_id);
Receive remote control commands for worker.
register_worker
my $worker_id = $backend->register_worker;
my $worker_id = $backend->register_worker($worker_id);
my $worker_id = $backend->register_worker(
$worker_id, {status => {queues => ['default', 'important']}});
Register worker or send heartbeat to show that this worker is still alive.
These options are currently available:
- status
-
status => {queues => ['default', 'important']}Hash reference with whatever status information the worker would like to share.
remove_job
my $bool = $backend->remove_job($job_id);
Remove failed, finished or inactive job from queue.
repair
$backend->repair;
Repair worker registry and job queue if necessary.
reset
$backend->reset;
Reset job queue.
retry_job
my $bool = $backend->retry_job($job_id, $retries);
my $bool = $backend->retry_job($job_id, $retries, {delay => 10});
Transition job back to inactive state, already inactive jobs may also be retried to change options.
These options are currently available:
- delay
-
delay => 10Delay job for this many seconds (from now), defaults to
0. - priority
-
priority => 5Job priority.
- queue
-
queue => 'important'Queue to put job in.
stats
my $stats = $backend->stats;
Get statistics for jobs and workers.
These fields are currently available:
- active_jobs
-
active_jobs => 100Number of jobs in
activestate. - active_workers
-
active_workers => 100Number of workers that are currently processing a job.
- delayed_jobs
-
delayed_jobs => 100Number of jobs in
inactivestate that are scheduled to run at specific time in the future or have unresolved dependencies. Note that this field is EXPERIMENTAL and might change without warning! - enqueued_jobs
-
enqueued_jobs => 100000Rough estimate of how many jobs have ever been enqueued. Note that this field is EXPERIMENTAL and might change without warning!
- failed_jobs
-
failed_jobs => 100Number of jobs in
failedstate. - finished_jobs
-
finished_jobs => 100Number of jobs in
finishedstate. - inactive_jobs
-
inactive_jobs => 100Number of jobs in
inactivestate. - inactive_workers
-
inactive_workers => 100Number of workers that are currently not processing a job.
unlock
my $bool = $backend->unlock('foo');
Release a named lock.
unregister_worker
$backend->unregister_worker($worker_id);
Unregister worker.
worker_info
my $worker_info = $backend->worker_info($worker_id);
Get information about a worker, or return undef if worker does not exist.
# Check worker host
my $host = $backend->worker_info($worker_id)->{host};
These fields are currently available:
- host
-
host => 'localhost'Worker host.
- jobs
-
jobs => ['10023', '10024', '10025', '10029']Ids of jobs the worker is currently processing.
- notified
-
notified => 784111777Epoch time worker sent the last heartbeat.
- pid
-
pid => 12345Process id of worker.
- started
-
started => 784111777Epoch time worker was started.
- status
-
status => {queues => ['default', 'important']}Hash reference with whatever status information the worker would like to share.
COPYRIGHT AND LICENCE
Copyright (c) 2014 Sebastian Riedel.
Copyright (c) 2015--2017 Sebastian Riedel & Nic Sandfield.
This program is free software, you can redistribute it and/or modify it under the terms of the Artistic License version 2.0.