NAME

HTML::Feature - an extractor of feature sentence from HTML

SYNOPSIS

use strict;
use HTML::Feature;

my $f = HTML::Feature->new(ret_num => 10);
my $data = $f->extract( url => 'http://www.perl.com' );

# print result data

print $data->{title}, "\n";
print $data->{description}, "\n";

for(@{$data->{block}}){
    print $_->{score}, "\n";
    print $_->{contents}, "\n";
}

DESCRIPTION

This module extracts some feature blocks from an HTML document. I do not adopt general technique such as "morphological analysis" in this module. By simpler statistics processing, this module will extract a feature blocks. So, it may be able to apply it in a language of any country easily.

METHODS

new([options])

a object is made by using the options.

extract(url => $url | string => $string)

return feature blocks (references) with TITLE and DESCRIPTION.

OPTIONS

    # it is possible to set value to the constructor
    my $f = HTML::Feature->new(
	ret_num => 1, 
	# number of return blocks (default is '1').
	max_bytes => 5000,
	# The upper limit number of bytes of a node to analyze (default is '').
	min_bytes => 10, 
	# The bottom limit number (default is '').
	enc_type => 'euc-jp', 
	# An arbitrary character code, If there is not appointment in particular, I become the character code which an UTF-8 flag is with (default is '').
	look_fine => 1; 
	# return data as "look fine" (default is ''). 
   );

SEE ALSO

HTML::TreeBuilder,Statistics::Lite,Encode::Guess

AUTHOR

Takeshi Miki <miki@cpan.org>

COPYRIGHT AND LICENSE

Copyright (C) 2007 Takeshi Miki

This library is free software; you can redistribute it and/or modify it under the same terms as Perl itself, either Perl version 5.8.8 or, at your option, any later version of Perl 5 you may have available.