NAME

Event - Event loop processing

SYNOPSIS

use Event qw(loop unloop);

# initialize application
Event->type(attribute => value, ...);
   
my $ret = loop();
   
# and some callback will call
unloop('ok');

DESCRIPTION

The Event module provide a central facility to watch for various types of events and invoke a callback when these events occur. The idea is to delay the handling of events so that they may be dispatched in priority order when it is safe for callbacks to execute.

PERL API

Events (the occurance of such) are noticed and queued by 'event watchers'. The creation and configuration of event watchers is the primary topic of the rest of this document.

The following functions control or interrogate the event loop as a whole:

$result = loop([$timeout])

Will enter a loop that calls one_event() until unloop() is called. The argument passed to unloop() is the return value of loop(). Loops can be nested.

unloop($result)

Make the inner-most loop() return with $result.

unloop_all($result)

Cause all pending loop()s to return immediately. This is not implemented with die. It is works as if unloop($result) were called for all nested loops.

sweep([$max_prio])

Queue all pending events and dispatch any with priority strictly less than $max_prio (the highest priority is 0). The default is to process all events except idle events. (While idle events are ignored by sweep, idle watchers are not ignored. If you want to avoid triggering an idle watcher then set max to undef or suspend it.)

one_event([$timeout])

If any events are outstanding then invoke the corresponding callback of the highest priority event. If there are no events available, block forever or until $timeout. Use of this API is not recommended because it is not efficient and does not trap exceptions.

all_watchers()

Returns a list of all watchers (including stopped watchers).

all_running()

Returns a list of all watchers with actively running callbacks. Watchers are returned in order of most recent to least recent.

all_idle()

If the event queue is very busy, all the idle watchers will sit on the idle queue waiting to run. However, be aware that if an idle watcher has the max attribute set then it will queue a normal event when its max wait time is exceeded.

Event Watcher Constructors

All watchers are constructed in one of the following ways:

 $w = Event->type( [attr1 => $value,]... );

or

use Event::type;
$w = Event::type( [attr1 => $value,]...);

Where type is substituted with the kind of watcher. Built-in types include idle, io, signal, timer, and var.

New watchers (hopefully) have reasonable defaults and can also be customized by passing extra attributes to the constructor. When created, watcher objects are "started" and are waiting for events (see $event->start below).

NetServer::ProcessTop displays watchers in real-time, formatted similarly to the popular top program. You may find this a useful aide for debugging.

Shared Watcher Attributes

Watchers are configured with attributes (also known as properties). For example:

$watcher->cb(\&some_code);   # set callback

warn $event->w->desc.": ".$event->hits." events happened; Wow!";

All watchers support the following attributes: cb, cbtime, debug, desc, prio, max_cb_tm, reentrant, repeat, and running. Watcher constructors accept the preceding and additionally: async and nice. All events support: hits, prio, and w. Moreover, watchers also offer extra attributes according to their specialty.

Shared Watcher Methods

The following methods are available for all watchers:

$watcher->start

Activate the watcher. Watchers refuse to start() without sufficient configuration information to generate events. Constructors always invoke start() unless the parked=1> option is requested. You will need to set the parked option if you preallocate unconfigured watchers.

$watcher->again

This is the same as the start except if a watcher has special repeat behavior. For example, repeating timers recalcuate their alarm time using the interval parameter.

$watcher->now

Cause the watcher to generate an event. The callback may or may not run immediately depending upon the event's priority. If you must unconditionally invoke the callback, consider something like

$w->cb->($w);
$watcher->stop

Don't look for events any more. Running events are allowed to complete but pending events are cancelled. Note that a stopped watcher can be reactivated by calling the start or again methods.

Watchers are stopped implicitly if their new configuration deprives them of the ability to generate events. For instance:

my $io_watcher = Event->io(timeout => 1);  # started
$io_watcher->timeout(undef);               # stopped implicitly
$io_watcher->timeout(1);                   # still stopped
$io_watcher->start;                        # restarted
$watcher->cancel

Stop and destroy $watcher. Running events are allowed to complete but pending events are cancelled. Cancelled watchers are no longer valid except for read-only type operations. For example, prio() can return the watcher's priority, but start() will fail.

$watcher->is_cancelled

Reports whether the $watcher has been cancelled.

$watcher->is_active

Reports whether the $watcher has been started. The return value is not affected by suspend.

$watcher->is_suspended

Reports whether the $watcher is suspended.

$watcher->pending

Returns whether this watcher has any events pending in the event queue.

Watcher Types

idle

Extra attributes: min => $seconds, max => $seconds

The callback is invoked only when no events are pending. If there is never a chance to idle, an event will be generated at least every max seconds and not more often than min seconds.

inactivity (EXPERIMENTAL)

Extra attributes: level => $level, timeout => $seconds

Inactivity watchers are similar to idle watchers. The difference is that they judge idleness by whether there have been any events with priority higher than the threshold $level.

If you find these useful, then send email to the mailing list. Otherwise, they might be deprecated.

var

Extra attributes: var => \$var, poll => 'rw'

Var watchers generate events when the given variable is read from or written to. As perl is a concise language, it is often difficult to predict when a variable will be read. For this reason, variable watchers should poll for writes unless you know what you are doing.

timer

Extra attributes: at => $time, interval => $sec, hard => $bool

The $time and $sec are in seconds. Fractional seconds may be used if Time::HiRes is available. The constructor also accepts an after attribute for easier initialization. It might be useful to know the time at the start of today. You can find it with:

use Time::Local;
my $TodaySeconds = int timelocal(0,0,0,(localtime)[3,4,5]);

If interval is set then the watcher will automatically repeat. Be aware that due to lags in the event loop, the interval timeout may already be in the past. If the hard flag is set, the event will be queued for execution relative to the last time the callback was invoke. However, if hard is false the new timeout will be calculated relative to the current time (this is the default).

io

Extra attributes: fd => $fd, poll => 'rwe' [timeout => $seconds, hard => $bool, timeout_cb => \&code]

The callback is invoked when the file descriptor, fd, has data to be read, written, or pending exceptions. fd can be a GLOB, an IO::Handle object, or a file number (file descriptor).

Note that it is your option whether to have multiple watchers per file handle or to use a single watcher for all event conditions.

If timeout_cb is set then timeouts use this alternate callback instead of the main callback.

signal

Extra attribute: signal => $str

semaphore

Not yet implemented.

msg

Not yet implemented.

PRIORITY

Priority is used to sort the event queue. Meaningful priorities range from -1 to 6 inclusive. Lower numbers mean higher priority (-1 is the highest priority and 6 is the lowest). If multiple events get queued, the ones with the highest priority are serviced first. Events with equal priority are serviced in first-in-first-out order.

use Event qw(PRIO_HIGH PRIO_NORMAL);   # some constants

LEVELS: -1      0      1      2      3      4      5      6
        ----------------------+-------------+---------------
                          PRIO_HIGH     PRIO_NORMAL

A negative priority causes the callback to be invoked immediately upon event occurance. Use this with caution. While it may seem advantageous to use negative priorities, they bypass the whole point of having an event queue.

Each watcher has a default priority, assigned by its constructor:

io	   PRIO_NORMAL
signal   PRIO_HIGH
timer    PRIO_NORMAL
var      PRIO_NORMAL

Default priorities are stored in ${"Event::${type}::DefaultPriority"}. If the default priority is not satisfactory for your purposes, the constructor options nice, async, or prio can be used to adjust it. nice specifies an offset from the default priority; async forces the priority to -1; and prio assigns a given priority of your choice. If more than one of these options are given then prio overrides async overrides nice.

WATCHER CONSTRUCTOR ATTRIBUTES

These options are only supported as constructor arguments.

after => $seconds

See the discussion of the timer watcher.

async => $bool

If $bool then the watcher priority is set to -1.

nice => $offset

Offset from the default priority.

parked => $yes

By default, watcher constructors automatically invoke the start() method. If you don't want the watcher started then request parked=1>.

WATCHER ATTRIBUTES

at => $time
cb => \&code
cb => [$class_or_object, $method_name]

The function or method to call when an event is dispatched. The callback is invoked with $event as its only argument.

Perhaps you are wondering what happens if something goes wrong and an untrapped die occurs within your callback? $Event::DIED is just for this purpose. See the full description of DIED below.

cbtime => $time

When the callback was invoked most recently.

debug => $bool

Debugging can be activated globally or per watcher. When debugging is enabled for a particular watcher, $Event::DebugLevel is treated as two levels higher. Levels of 1, 2, 3, or 4 give progressively more diagnostics on STDERR.

desc => $string

An identifying name. If this is not passed explicitly to the constructor, it will be initialized with a string that attempts to identify the location in the source code where the watcher was constructed.

fd => $filehandle
flags => $bits

The flag attribute encodes information about the state of an event. [XXX Fill in exact bits] [DEPRECATED?]

hard => $bool

Determines how repeating timers (or timeouts) are recalculated. The timer is restarted either before or after the callback depending on whether it is true or false, respectively. In long-running callbacks this can make a significant difference.

interval => $seconds

How long between repeating timeouts. The at attribute is recalculated using interval upon callback return.

level => $priority

For inactivity - EXPERIMENTAL.

max => $seconds

The maximum number of seconds to wait before triggering the callback. Similar to a timeout.

max_cb_tm => $seconds

The maximum number of seconds to spend in a callback. If a callback uses more time then it is aborted. Defaults to 1 sec. This feature is normally disabled. See Event::Stats.

min => $seconds

Enforce a minimum number of seconds between triggering events.

poll => $bits

Determines which kinds of events are of interest. This attribute can be set with either strings or bit constants. The bit constants are available via 'use Event::Watcher qw(R W E T);'.

string constant description
------ -------- ---------------
 'r'     R      read
 'w'     W      write
 'e'     E      exception
 't'     T      timeout

Thus, both of these statements enable interest in read:

$w->poll($w->poll . 'r');
$w->poll($w->poll | R);

A given type of watcher may support all or a subset of the available events.

prio => $level

Changes the watcher's priority to the given level. Events generated by a watcher usually inherit the priority of the watcher.

reentrant => $bool

By default, callbacks are allowed to invoke sweep or loop which in turn may invoke the same callback again recursively. This can be useful but can also be confusing. Moreover, if you keep reentering callbacks you will quickly run out of stack space. Disable this feature per watcher by setting reentrant to false. This will cause the watcher to be suspended during recursive calls to sweep or loop.

repeat => $bool

The repeat flag controls whether the callback should either be one-shot or continue waiting for new events. The default setting depends on the type of watcher. io, signal, and var default to true.

running => $int

Zero if the callback is not running. Otherwise, the number of levels that the callback has been entered. This can be greater than one if a reentrant callback invokes loop (or to a lesser extent sweep).

signal => $str

The callback will be invoked when the specified signal is received. The $str string should be something like 'INT' or 'QUIT'. Also see the documentation for %SIG.

suspend => $bool

Don't look for events any more. Running events are allowed to complete but queued events are cancelled and subsequent pending events are ignored. Suspend should be considered a debugging tool. If you actually want to stop a watcher then use the stop method.

timeout => $seconds

The number of seconds before a watcher times out.

timeout_cb => \&code
timeout_cb => [$class_or_object, $method_name]

This is an optional attribute for use when it is desired that timeouts be serviced in a separate code path than normal events. When this attribute is unset, timeouts are serviced by cb.

var => $ref

A reference to the variable being watched.

EVENT ATTRIBUTES

got => $bits

got is available in the callback of watchers with poll. got is in the same format as poll except that it gives what kind of event actually happened. In contrast, poll is just an indication of interest.

hits => $int

A watcher increments hits every time it registers an event. Signals in quick succession can be clumped into a single event.

prio => $level

Be aware that this priority can differ from the watcher's priority. For instance, the watcher's priority may have changed since the event was generated. Moreover, the C extension API offers the freedom to queue events of arbitrary priority.

w => $watcher

This method return the event's watcher. It is read-only.

Customization and Exceptions

The bulk of Event's implementation is in C for maximum performance. However, a broad range of customization hooks are available.

  • $Event::DebugLevel

    Enables progressively more debugging output. Meaningful levels range from 1 (least output) to 5 (most output). Also see debug.

  • $Event::Eval

    Strictly for debugging. Do not enable this unless you know what you are doing.

  • $Event::DIED

    When loop or sweep is called, an exception context is established for the duration of event processing. If an exception is detected then $Event::DIED is invoked:

     $Event::DIED->($event, $@);

    The default hook uses warn to print the exception. After the DIED handler returns, event processing continues as if nothing happened. If you'd like to see more detailed output you can use the verbose handler (below) or write your own.

    $Event::DIED = \&Event::verbose_exception_handler;
  • Event->add_hooks(key => sub { ... }, ...);

    The add_hooks method allows customization at key points in the optimized event processing core. Currently support hooks are detailed below:

    hook          purpose
    ------------- ----------------------------------------------
    prepare	returns minimum time to block (timeable)
    check		assess state after normal return from select/poll
    asynccheck	check for signals, etc
    callback	invoked before each event callback

C API

Event also has a direct API for callbacks written exclusively in C. See Event::MakeMaker.

WHAT ABOUT THREADS?

Event loops and threads are two different solutions to the same problem: asynchronous processing. Event loops have been around since the beginning of computing. They are well understood and proven to be a good solution for many applications.

While event loops make use of basic operating system services, the bulk of their implementation is usually outside the kernel. While an event loop may appear to do many things in parallel, it does not, even on multiprocessor hardware. Actions are always dispatched sequentially. This implies that long running callbacks must be avoided because otherwise event processing is halted.

Event loops work well when actions are short and to the point. Long-running tasks must be broken into short steps and scheduled for execution. Some sort of a state machine is usually required. While a big, complex application server is usually simpler to implement in a multithreaded fashion, a web browser can easily get by without threads. Consider a JPEG file download and render. When some new bytes are available they are sorted to the right place on the screen. Only a little state must be kept to keep track of how much has been rendered and to process subsequent incoming bytes.

Threads can either substitute for an event loop or complement it. Threads are similar to processes in that the operating system manages task switching for you. However, the difference is that all threads share the same address space. This is good and bad. Much higher performance can be acheived but since data is shared between threads extreme care must be taken to access or modify global data. The operating system can switch threads at any moment or can execute multiple threads simultaineously. I hope this sounds dangerous! It is! Threads can introduce maddeningly complicated and hard to debug syncronization problems.

Threads are like rocket fuel. They are essential when you really need them but most applications would be better off with a simple event loop. Even if threads are genuinely needed, consider confining them to the parts of an application where truly scalable performance is really worth the difficulty of a multithreaded implementation. For example, most GUIs applications do not need threads and most scientific compute intensive problems can be isolated from event dispatching. On the other hand, high performance transaction servers generally do mandate a truly multithreaded approach.

Another consideration is that threads are not quite as widely available as event loops. While a few forward-thinking operating systems have offered threads since the beginning, their addition to many popular operating systems is much more recent and some still offer no threads support. If portability is a requirement, one must check that threads support is available and also carefully test a particular threads implementation to see whether it supports the features you need. It is likely that all platforms will have a solid implementation soon but at this point in history it is best to double check.

WHAT ABOUT NON-PREEMPTIVE THREADS?

(Contributed by artur@vogon-solutions.com 12 Jul 1999.)

The Java language is oriented to use non-preemptive threads, yet even Java uses an event-loop for Swing (AFAIK). That is one of the reasons I don't use Java for network-centric applications. My belief is that the benefit of multi-threading is the gain in performance on SMP hardware. In my view, non-preemptive threads (java green-threads) are usually poor design. I find them harder to work with, harder to debug, and slower for a rather marginal gain in readability. I really like working with a state machine. I find it leads to more stable and better code. It also has the benefit of abstracting away how concurrency is achieved.

BUGS

The meaning of $io->timeout(0) might change. Use undef to unset the timeout.

WHY MICROSOFT WINDOWS MIGHT BE FASTER THAN UNIX

http://www.usenix.org/events/usenix99/full_papers/banga/banga_html/index.html

ALSO SEE

Time::HiRes, NetServer::ProcessTop, and Time::Warp.

SUPPORT

If you have insights or complaints then please subscribe to the mailing list! Send email to:

majordomo@perl.org

The body of your message should read:

subscribe perl-loop

This list is archived at

http://www.xray.mpe.mpg.de/mailing-lists/perl-loop/

Thanks!

AUTHORS

Joshua N. Pritikin <bitset@mindspring.com>

Initial 0.01 implementation by Graham Barr <gbarr@pobox.com>. Other contributors include at least those lists below and folks mentioned in the ChangeLog.

Gisle Aas E<lt>F<gisle@aas.no>E<gt>
E<lt>F<jan.dubois@ibm.net>E<gt> (Win32)
E<lt>F<Matija.Grabnar@arnes.si>E<gt> (File::Tail)
Uri Guttman E<lt>F<uri@sysarch.com>E<gt>
Nick Ing-Simmons E<lt>F<nick@ni-s.u-net.com>E<gt> (Tk)
Mark Mielke E<lt>F<Mark.Mielke.markm@nt.com>E<gt>
Sarathy E<lt>F<gsar@engin.umich.edu>E<gt>
E<lt>F<Jochen.Stenzel.gp@icn.siemens.de>E<gt>

COPYRIGHT

Copyright © 1997-2000 Joshua Nathaniel Pritikin & Graham Barr. All rights reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

1 POD Error

The following errors were encountered while parsing the POD:

Around line 687:

Non-ASCII character seen before =encoding in '©'. Assuming CP1252