NAME

Flux - stream processing toolkit

VERSION

version 1.03

SYNOPSIS

            

              
              
use Flux::Simple qw( array_in array_out mapper );
my $in = array_in([ 5, 6, 7 ]);
$in = $in | mapper { shift() * 2 };
my @result;
my $out = array_out(\@result);
$out = mapper { shift() * 3 } | mapper { shift() . "x" } | $out;
$out->write($in->read);
$out->write($in->read);
say for @result;
# Output:
# 30x
# 36x
            
          

DESCRIPTION

Flux is the stream processing framework.

Flux::* module namespace includes:

• groundwork for interoperable input and output stream classes;

• various implementations of input and output streams and storages: in-memory, file-based, db-based and others;

• tools for making these streams work together nicely: mappers, data formatters, overloading syntax sugar, etc;

• Flux::Catalog module for the simple access to your collection of streams.

Flux is a framework, but you can use lower-level parts of it without higher-level parts. For example, you can read and write files with Flux::File without declaring it in the Flux catalog.

INTERFACE STABILITY NOTICE

This distribution and other Flux-* distributions on CPAN are the result of the refactoring of our in-house framework.

It should be stable. We used it in production for years. But remember that:

1) I'm rewriting this in Moo/Moose, and there can be bugs.

2) I can refactor some API aspects in the process.

3) Not all of the code is uploaded yet.

SIMILAR MODULES

Message::Passing is similar to Flux.

Unlike Flux, it's asynchronous (Flux can be made asynchronous by using Coro, but its basic APIs are blocking).

IO::Pipeline syntax is similar to Flux mappers.

I'm sure there're many others. Stream processing is reinvented often.

AUTHOR

Vyacheslav Matyukhin <me@berekuk.ru>

COPYRIGHT AND LICENSE

This software is copyright (c) 2013 by Yandex LLC.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.