NAME
DTA::TokWrap::Processor::tokenize::tomasotath_02x - DTA tokenizer wrappers: tokenizer: dwds_tomsatotath via command-line
SYNOPSIS
use DTA::TokWrap::Processor::tokenize::tomasotath_02x;
$tz = DTA::TokWrap::Processor::tokenize::tomasotath_02x->new(%args);
$doc_or_undef = $tz->tokenize($doc);
DESCRIPTION
This class is currently just a wrapper for the command-line low-level tokenizer dwds_tomasotath
(ToMaSoTaTh).
Most users should use the high-level DTA::TokWrap wrapper class instead of using this module directly.
Constants
- @ISA
-
DTA::TokWrap::Processor::tokenize::tomasotath_02x inherits from DTA::TokWrap::Processor::tokenize.
Constructors etc.
- new
-
$tz = $CLASS_OR_OBJ->new(%args);
%args, %$tz: (none yet)
- defaults
-
%defaults = CLASS->defaults();
Static class-dependent defaults.
Methods
- tokenize
-
$doc_or_undef = $CLASS_OR_OBJECT->tokenize($doc);
SEE ALSO
DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...
SEE ALSO
DTA::TokWrap::Intro(3pm), dta-tokwrap.perl(1), ...
AUTHOR
Bryan Jurish <moocow@cpan.org>
COPYRIGHT AND LICENSE
Copyright (C) 2009-2018 by Bryan Jurish
This package is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.