NAME
Data::Chronicle::Reader - Provides reading from an efficient data storage for volatile and time-based data
DESCRIPTION
This module contains helper methods which can be used to store and retrieve information on an efficient storage with below properties:
- Timeliness
-
It is assumed that data to be stored are time-based meaning they change over time and the latest version is most important for us.
- Efficient
-
The module uses Redis cache to provide efficient data storage and retrieval.
- Persistent
-
In addition to caching every incoming data, it is also stored in PostgreSQL for future retrieval.
- Transparent
-
This modules hides all the internal details including distribution, caching, and database structure from the developer. He only needs to call a method to save data and another method to retrieve it. All the underlying complexities are handled by the module.
EXAMPLE
my $d = get_some_log_data();
my $chronicle_w = Data::Chronicle::Writer->new(
cache_writer => $writer,
dbic => $dbic);
my $chronicle_r = Data::Chronicle::Reader->new(
cache_reader => $reader,
dbic => $dbic);
#store data into Chronicle - each time we call `set` it will also store
#a copy of the data for historical data retrieval
$chronicle_w->set("log_files", "syslog", $d);
#retrieve latest data stored for syslog under log_files category
my $dt = $chronicle_r->get("log_files", "syslog");
#find historical data for `syslog` at given point in time
my $some_old_data = $chronicle_r->get_for("log_files", "syslog", $epoch1);
METHODS
cache_reader
cache_reader should be an instance of RedisDB.
dbic
dbic should be an instance of DBIx::Connector.
get
Example:
my $data = get("category1", "name1");
Query for the latest data under "category1::name1" from the cache reader. Will return `undef` if the data does not exist.
mget
Example:
my @values = mget([["category1", "name1"], ["category2", "name2"], ...]);
Query for the latest data under "category1::name1", "category2::name2", etc from the cache reader. Will return an arrayref containing results in the same ordering, with `undef` if the data does not exist.
get_for
Example:
my $data = get_for("category1", "name1", 1447401505);
Query Pg archive for the data under "category1::name1" at or exactly before the given epoch/Date::Utility.
get_for_period
Example:
my $data = get_for_period("category1", "name1", 1447401505, 1447401900)
Query Pg historical data and return records whose date is between given period.
get_history
Example:
my $data = get_history("category1", "name1", 1);
Query Pg archive for the data under "category1::name1" at the provided number of revisions in the past.
AUTHOR
Binary.com, <support at binary.com>
BUGS
Please report any bugs or feature requests to bug-data-chronicle at rt.cpan.org
, or through the web interface at http://rt.cpan.org/NoAuth/ReportBug.html?Queue=Data-Chronicle. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes.
SUPPORT
You can find documentation for this module with the perldoc command.
perldoc Data::Chronicle::Reader
You can also look for information at:
RT: CPAN's request tracker (report bugs here)
AnnoCPAN: Annotated CPAN documentation
CPAN Ratings
Search CPAN