NAME
update_Text_Corpus_CNN.pl - Script to update CNN news article corpus.
SYNOPSIS
update_Text_Corpus_CNN.pl [-d corpusDirectory -c -t -h]
DESCRIPTION
The script update_Text_Corpus_CNN.pl
may be used to create or update a temporary corpus of CNN news articles for personal research and testing of information processing techniques. Read the CNN Interactive Service Agreement to ensure you abide by it when using this script.
All errors and warnings are logged using Log::Log4perl to the file corpusDirectory/log.txt
.
OPTIONS
-d corpusDirectory
The option -d
sets the cache directory for the corpus of documents. If the directory does not exist, it will be created. The default is a directory named 'corpus_cnn'
in the current working directory.
-t
If the option -t
is present, parsing tests will be performed on all the documents in the cache.
-v
If the option -v
is present, then after each new document is fetched a message is logged stating the number of documents remaining to fetch and the approximate time to completion.
-h
Causes documentation to be printed.
AUTHOR
Jeff Kubina<jeff.kubina@gmail.com>
COPYRIGHT
Copyright (c) 2009 Jeff Kubina. All rights reserved. This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
The full text of the license can be found in the LICENSE file included with this module.
KEYWORDS
cnn, cable news network, english corpus, information processing
SEE ALSO
Read the CNN Interactive Service Agreement to ensure you abide by it when using this script.CHI, Log::Log4perl, Text::Corpus::CNN, Text::Corpus::CNN::Document