NAME
KinoSearch::Analysis::Analyzer - base class for analyzers
SYNOPSIS
# abstract base class -- you probably want PolyAnalyzer, not this.
DESCRIPTION
In KinoSearch, an Analyzer is a filter which processes text, transforming it from one form into another. For instance, an analyzer might break up a long text into an array of tokens, or it might convert text to lowercase.
TODO
At this time, public subclassing of Analyzer is not supported. If that is to happen, the problem of how to store a collection of tokens both efficiently and elegantly must be solved. An array of tokens, each of which is a hash-based object, is elegant but not efficient. The current scheme is efficient but not elegant.
COPYRIGHT
Copyright 2005-2006 Marvin Humphrey
LICENSE, DISCLAIMER, BUGS, etc.
See KinoSearch version 0.09.