NAME

minhash_cmp - uses MinHash & SpeedyFx to compare large text data

VERSION

version 0.013

minhash_cmp [options] FILE1 FILE2

MinHash (or the min-wise independent permutations locality sensitive hashing scheme) is a technique for quickly estimating how similar two sets are.

--help: This.
--epsilon: Expected error value used to compute the number of different hash functions (default: 0.05).
--k: Number of different hash functions to use (default: 400; overrides --epsilon).
--seed: Custom seed (integer).
--bits: How many bits do represent one character. The default value, 8, sacrifices Unicode handling but is fast and low on memory footprint. The value of 18 encompasses Basic Multilingual, Supplementary Multilingual and Supplementary Ideographic planes.

Under bits=18 setting, each initialized hash function consumes ~500KB.

Stanislaw Pusep <stas@sysd.org>

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.

To install Text::SpeedyFx, copy and paste the appropriate command in to your terminal.

cpanm Text::SpeedyFx

perl -MCPAN -e shell
install Text::SpeedyFx

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)