/ 
Data-Clean-JSON-0.04
River stage three • 9 direct dependents • 612 total dependents
/ Data::Clean::JSON

NAME

Data::Clean::JSON - Clean data so it is safe to output to JSON

VERSION

version 0.04

SYNOPSIS

use Data::Clean::JSON;
my $cleanser = Data::Clean::JSON->new;    # there are some options
my $data     = { code=>sub {}, re=>qr/abc/i };

my $cleaned;

# modifies data in-place
$cleaned = $cleanser->clean_in_place($data);

# ditto, but deep clone first, return
$cleaned = $cleanser->clone_and_clean($data);

# now output it
use JSON;
print encode_json($cleaned); # prints '{"code":"CODE","re":"(?^i:abc)"}'

DESCRIPTION

This class cleans data from anything that might be problematic when encoding to JSON. This includes coderefs, globs, and so on.

Data that has been cleaned will probably not be convertible back to the original, due to information loss (for example, coderefs converted to string "CODE").

The design goals are good performance, good defaults, and just enough flexibility. The original use-case is for returning JSON response in HTTP API service.

This module is significantly faster than Data::Rmap because with Rmap you repeatedly invoke anonymous subroutine for each data item. This module, on the other hand, generate a cleanser code using eval(), using native Perl for() loops.

The generated cleanser code is logged using Log::Any at trace level. You can see it, e.g. using Log::Any::App:

% TRACE=1 perl -MLog::Any::App -MData::Clean::JSON -e'$c=Data::Clean::JSON->new; ...'

METHODS

new(%opts) => $obj

Create a new instance. For list of known options, see Data::Clean::Base. Data::Clean::JSON sets some defaults.

DateTime  => [call_method => 'epoch']
Regexp    => ['stringify']
SCALAR    => ['deref_scalar']
-ref      => ['replace_with_ref']
-circular => ['detect_circular']

$obj->clean_in_place($data) => $cleaned

Clean $data. Modify data in-place.

$obj->clone_and_clean($data) => $cleaned

Clean $data. Clone $data first.

FAQ

Why clone/modify? Why not directly output JSON?

So that the data can be used for other stuffs, like outputting to YAML, etc.

Why is it slow?

First make sure that you do not construct the Data::Clean::JSON repeatedly, as it during construction it generates the cleanser code using eval(). A short benchmark:

% perl -MBench -MData::Clean::JSON -e'$c=Data::Clean::JSON->new; bench sub { $c->clone_and_clean([1..100]) }, -1'
31641 calls (30358/s), 1.042s (0.0329ms/call)

% perl -MBenchglean::JSON->new->clone_and_clean([1..100]) }, -1'
2999 calls (2714/s), 1.105s (0.369ms/call)

Second, you can turn off some checks if you are sure you will not be getting bad data. For example, if you know that your input will not contain circular references, you can turn off circular detection:

$cleanser = Data::Clean::JSON->new(-circular => 0);

Benchmark:

% perl -MBench -MData::Clean::JSON -e'$c=Data::Clean::JSON->new; $data=[1..100]; bench sub { $c->clean_in_place($data) }, -1'
38461 calls (28086/s), 1.369s (0.0356ms/call)

% perl -MBench -MData::Clean::JSON -e'$c=Data::Clean::JSON->new(-circular=>0); $data=[1..100]; bench sub { $c->clean_in_place($data) }, -1'
45455 calls (32094/s), 1.416s (0.0312ms/call)

The less number of actions you do, the faster the cleansing process will be.

AUTHOR

Steven Haryanto <stevenharyanto@gmail.com>

COPYRIGHT AND LICENSE

This software is copyright (c) 2012 by Steven Haryanto.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.