NAME

Moot::TokenReader::Native - libmoot: Token I/O: reader: native 1 word/line format

SYNOPSIS

            

              
              
use Moot::TokenReader::Native;
##=====================================================================
## Usage
$tr = Moot::TokenReader::Native->new($fmt);  ##-- constructor
$tr->from_file($filename);                  ##-- open a named file
$sent = $tr->get_sentence();                ##-- read next sentence
$tr->close();                                       ##-- close current input source
#... or any other Moot::TokenReader method
            
          

DESCRIPTION

The Moot::TokenReader::Native module provides wrappers for native 1 word/line word- and sentence-input streams as included in the libmoot library for Hidden Markov Model decoding.

Moot::TokenReader::Native inherits from Moot::TokenReader and supports all Moot::TokenReader API methods.

File Format

            

              
              
FILE       ::= SENTENCE*
SENTENCE   ::= ((TOKEN|COMMENT)*) "\n"
TOKEN      ::= TOKEN_TEXT ("\t" ANALYSIS)* ("\r"*) "\n"
TOKEN_TEXT ::= [^\\t\\r\\n]*
ANALYSIS   ::= (DETAIL*) (COST?) (DETAIL*) "[" TAG ( "]" | " " ) (DETAIL*) (COST?) (DETAIL*)
DETAIL     ::= [^\\t\\r\\n]
COST       ::= "<" FLOAT ">"
COMMENT    ::= "^%%" (.*) "\n"
            
          

SEE ALSO

Moot::TokenReader::XML(3perl), Moot::TokenReader(3perl), Moot::TokenWriter(3perl), Moot::TokenIO(3perl), Moot(3perl), mootfiles(5), moot(1), perl(1).

AUTHOR

Bryan Jurish <moocow@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2013 by Bryan Jurish

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.14.2 or, at your option, any later version of Perl 5 you may have available.