/ 
Hash-Ordered-0.014
River stage two • 9 direct dependents • 34 total dependents
/ Hash::Ordered

NAME

Hash::Ordered - A fast, pure-Perl ordered hash class

VERSION

version 0.014

SYNOPSIS

use Hash::Ordered;

my $oh = Hash::Ordered->new( a => 1 );

$oh->get( 'a' );
$oh->set( 'a' => 2 );

$oh->exists( 'a' );
$val = $oh->delete( 'a' );

@keys  = $oh->keys;
@vals  = $oh->values;
@pairs = $oh->as_list

$oh->push( c => 3, d => 4 );
$oh->unshift( e => 5, f => 6 );

( $k, $v ) = $oh->pop;
( $k, $v ) = $oh->shift;

$iter = $oh->iterator;
while( ( $k, $v ) = $iter->() ) { ... }

$copy     = $oh->clone;
$subset   = $oh->clone( qw/c d/ );
$reversed = $oh->clone( reverse $oh->keys );

@value_slice = $oh->values(  qw/c f/ ); # qw/3 6/
@pairs_slice = $oh->as_list( qw/f e/ ); # qw/f 6 e 5/

$oh->postinc( 'a' );          # like $oh{a}++
$oh->add( 'a', 5 );           # like $oh{a} += 5
$oh->concat( 'a', 'hello' );  # like $oh{a} .= 'hello'
$oh->or_equals( 'g', '23' );  # like $oh{g} ||= 23
$oh->dor_equals( 'g', '23' ); # like $oh{g} //= 23

DESCRIPTION

This module implements an ordered hash, meaning that it associates keys with values like a Perl hash, but keeps the keys in a consistent order. Because it is implemented as an object and manipulated with method calls, it is much slower than a Perl hash. This is the cost of keeping order.

However, compared to other ordered hash implementations, Hash::Ordered is optimized for getting and setting individual elements and is generally faster at most other tasks as well. For specific details, see Hash::Ordered::Benchmarks.

METHODS

new

$oh = Hash::Ordered->new;
$oh = Hash::Ordered->new( @pairs );

Constructs an object, with an optional list of key-value pairs.

The position of a key corresponds to the first occurrence in the list, but the value will be updated if the key is seen more than once.

Current API available since 0.009.

clone

$oh2 = $oh->clone;
$oh2 = $oh->clone( @keys );

Creates a shallow copy of an ordered hash object. If no arguments are given, it produces an exact copy. If a list of keys is given, the new object includes only those keys in the given order. Keys that aren't in the original will have the value undef.

keys

@keys = $oh->keys;
$size = $oh->keys;

In list context, returns the ordered list of keys. In scalar context, returns the number of elements.

Current API available since 0.005.

values

@values = $oh->values;
@values = $oh->values( @keys );

Returns an ordered list of values. If no arguments are given, returns the ordered values of the entire hash. If a list of keys is given, returns values in order corresponding to those keys. If a key does not exist, undef will be returned for that value.

In scalar context, returns the number of elements.

Current API available since 0.006.

get

$value = $oh->get("some key");

Returns the value associated with the key, or undef if it does not exist in the hash.

set

$oh->set("some key" => "some value");

Associates a value with a key and returns the value. If the key does not already exist in the hash, it will be added at the end.

exists

if ( $oh->exists("some key") ) { ... }

Test if some key exists in the hash (without creating it).

delete

$value = $oh->delete("some key");

Removes a key-value pair from the hash and returns the value.

clear

$oh->clear;

Removes all key-value pairs from the hash. Returns undef in scalar context or an empty list in list context.

Current API available since 0.003.

push

$oh->push( one => 1, two => 2);

Add a list of key-value pairs to the end of the ordered hash. If a key already exists in the hash, it will be deleted and re-inserted at the end with the new value.

Returns the number of keys after the push is complete.

pop

($key, $value) = $oh->pop;
$value = $oh->pop;

Removes and returns the last key-value pair in the ordered hash. In scalar context, only the value is returned. If the hash is empty, the returned key and value will be undef.

unshift

$oh->unshift( one => 1, two => 2 );

Adds a list of key-value pairs to the beginning of the ordered hash. If a key already exists, it will be deleted and re-inserted at the beginning with the new value.

Returns the number of keys after the unshift is complete.

shift

($key, $value) = $oh->shift;
$value = $oh->shift;

Removes and returns the first key-value pair in the ordered hash. In scalar context, only the value is returned. If the hash is empty, the returned key and value will be undef.

merge

$oh->merge( one => 1, two => 2 );

Merges a list of key-value pairs into the ordered hash. If a key already exists, its value is replaced. Otherwise, the key-value pair is added at the end of the hash.

as_list

@pairs = $oh->as_list;
@pairs = $oh->as_list( @keys );

Returns an ordered list of key-value pairs. If no arguments are given, all pairs in the hash are returned. If a list of keys is given, the returned list includes only those key-value pairs in the given order. Keys that aren't in the original will have the value undef.

iterator

$iter = $oh->iterator;
$iter = $oh->iterator( reverse $oh->keys ); # reverse

while ( my ($key,$value) = $iter->() ) { ... }

Returns a code reference that returns a single key-value pair (in order) on each invocation, or the empty list if all keys are visited.

If no arguments are given, the iterator walks the entire hash in order. If a list of keys is provided, the iterator walks the hash in that order. Unknown keys will return undef.

The list of keys to return is set when the iterator is generator. Keys added later will not be returned. Subsequently deleted keys will return undef for the value.

preinc

$oh->preinc($key);      # like ++$hash{$key}

This method is sugar for incrementing a key without having to call set and get explicitly. It returns the new value.

Current API available since 0.005.

postinc

$oh->postinc($key);     # like $hash{$key}++

This method is sugar for incrementing a key without having to call set and get explicitly. It returns the old value.

Current API available since 0.005.

predec

$oh->predec($key);      # like --$hash{$key}

This method is sugar for decrementing a key without having to call set and get explicitly. It returns the new value.

Current API available since 0.005.

postdec

$oh->postdec($key);      # like $hash{$key}--

This method is sugar for decrementing a key without having to call set and get explicitly. It returns the old value.

Current API available since 0.005.

add

$oh->add($key, $n);     # like $hash{$key} += $n

This method is sugar for adding a value to a key without having to call set and get explicitly. With no value to add, it is treated as "0". It returns the new value.

Current API available since 0.005.

subtract

$oh->subtract($key, $n);  # like $hash{$key} -= $n

This method is sugar for subtracting a value from a key without having to call set and get explicitly. With no value to subtract, it is treated as "0". It returns the new value.

Current API available since 0.005.

concat

$oh->concat($key, $str); # like $hash{$key} .= $str

This method is sugar for concatenating a string onto the value of a key without having to call set and get explicitly. It returns the new value. If the value to append is not defined, no concatenation is done and no warning is given.

Current API available since 0.005.

or_equals

$oh->or_equals($key, $str); # like $hash{$key} ||= $str

This method is sugar for assigning to a key if the existing value is false without having to call set and get explicitly. It returns the new value.

Current API available since 0.005.

dor_equals

$oh->dor_equals($key, $str); # like $hash{$key} //= $str

This method is sugar for assigning to a key if the existing value is not defined without having to call set and get explicitly. It returns the new value.

Current API available since 0.005.

OVERLOADING

Boolean

if ( $oh ) { ... }

When used in boolean context, a Hash::Ordered object is true if it has any entries and false otherwise.

String

say "$oh";

When used in string context, a Hash::Ordered object stringifies like typical Perl objects. E.g. Hash::Ordered=ARRAY(0x7f815302cac0)

Current API available since 0.005.

Numeric

$count = 0 + $oh;

When used in numeric context, a Hash::Ordered object numifies as the decimal representation of its memory address, just like typical Perl objects. E.g. 140268162536552

For the number of keys, call the "keys" method in scalar context.

Current API available since 0.005.

Fallback

Other overload methods are derived from these three, if possible.

TIED INTERFACE

Using tie is slower than using method calls directly. But for compatibility with libraries that can only take hashes, it's available if you really need it:

tie my %hash, "Hash::Ordered", @pairs;

If you want to access the underlying object for method calls, use tied:

tied( %hash )->unshift( @data );

Tied hash API available since 0.005.

CAVEATS

Deletion and order modification with push, pop, etc.

This can be expensive, as the ordered list of keys has to be updated. For small hashes with no more than 25 keys, keys are found and spliced out with linear search. As an optimization for larger hashes, the first change to the ordered list of keys will construct an index to the list of keys. Thereafter, removed keys will be marked with a "tombstone" record. Tombstones will be garbage collected whenever the number of tombstones exceeds the number of valid keys.

These internal implementation details largely shouldn't concern you. The important things to note are:

  • The costs of efficient deletion are deferred until you need it

  • Deleting lots of keys will temporarily appear to leak memory until garbage collection occurs

MOTIVATION

For a long time, I used Tie::IxHash for ordered hashes, but I grew frustrated with things it lacked, like a cheap way to copy an IxHash object or a convenient iterator when not using the tied interface. As I looked at its implementation, it seemed more complex than I though it needed, with an extra level of indirection that slows data access.

Given that frustration, I started experimenting with the simplest thing I thought could work for an ordered hash: a hash of key-value pairs and an array with key order.

As I worked on this, I also started searching for other modules doing similar things. What I found fell broadly into two camps: modules based on tie (even if they offered an OO interface), and pure OO modules. They all either lacked features I deemed necessary or else seemed overly-complex in either implementation or API.

Hash::Ordered attempts to find the sweet spot with simple implementation, reasonably good efficiency for most common operations, and a rich, intuitive API.

After discussions with Mario Roy about the potential use of Hash::Ordered with MCE, I optimized deletion of larger hashes and provided a tied interface for compatibility. Mario's suggestions and feedback about optimization were quite valuable. Thank you, Mario!

SEE ALSO

This section describes other ordered-hash modules I found on CPAN. For benchmarking results, see Hash::Ordered::Benchmarks.

Tie modules

The following modules offer some sort of tie interface. I don't like ties, in general, because of the extra indirection involved over a direct method call. Still, you can make any tied interface into a faster OO one with tied:

tied( %tied_hash )->FETCH($key);

Tie::Hash::Indexed is implemented in XS and thus seems promising if pure-Perl isn't a criterion; it generally fails tests on Perl 5.18 and above due to the hash randomization change. Despite being XS, it is slower than Hash::Ordered at everything exception creation and deletion.

Tie::IxHash is probably the most well known and includes an OO API. Given the performance problems it has, "well known" is the only real reason to use it.

These other modules below have very specific designs/limitations and I didn't find any of them suitable for general purpose use:

Other ordered hash modules

Other modules stick with an object-oriented API, with a wide variety of implementation approaches.

Array::AsHash is essentially an inverse implementation from Hash::Ordered. It keeps pairs in an array and uses a hash to index into the array. This indirection would already make hash-like operations slower, but the specific implementation makes it even worse, with abstractions and function calls that make getting or setting individual items up to 10x slower than Hash::Ordered.

However, Array::AsHash takes an arrayref to initialize, which is very fast and can return the list of pairs faster, too. If you mostly create and list out very large ordered hashes and very rarely touch individual entries, I think this could be something to very cautiously consider.

These other modules below have restrictions or particularly complicated implementations (often relying on tie) and thus I didn't think any of them really suitable for use:

  • Array::Assign — arrays with named access; restricted keys

  • Array::OrdHash — overloads array/hash deref and uses internal tied data

  • Data::Pairs — array of key-value hashrefs; allows duplicate keys

  • Data::OMap — array of key-value hashrefs; no duplicate keys

  • Data::XHash — blessed, tied hashref with doubly-linked-list

SUPPORT

Bugs / Feature Requests

Please report any bugs or feature requests through the issue tracker at https://github.com/dagolden/Hash-Ordered/issues. You will be notified automatically of any progress on your issue.

Source Code

This is open source software. The code repository is available for public review and contribution under the terms of the license.

https://github.com/dagolden/Hash-Ordered

git clone https://github.com/dagolden/Hash-Ordered.git

AUTHOR

David Golden <dagolden@cpan.org>

CONTRIBUTORS

  • Andy Lester <andy@petdance.com>

  • Benct Philip Jonsson <bpjonsson@gmail.com>

  • Mario Roy <marioeroy@gmail.com>

COPYRIGHT AND LICENSE

This software is Copyright (c) 2014 by David Golden.

This is free software, licensed under:

The Apache License, Version 2.0, January 2004