NAME
EBook::Tools - An object class for the manipulation and generation of E-books based on IDPF standards
DESCRIPTION
This module provides an object interface and a number of related procedures intended to create or modify documents centered around the International Digital Publishing Forum (IDPF) standards, currently both OEBPS v1.2 and OPS/OPF v2.0.
SYNOPSIS
use EBook::Tools qw(split_metadata system_tidy_xml);
$EBook::Tools::tidysafety = 2;
my $opffile = split_metadata('ebook.html');
my $otheropffile = 'alternate.opf';
my $retval = system_tidy_xml($opffile,'tidy-backup.xml');
my $ebook = EBook::Tools->new($opffile);
$ebook->fix_opf20;
$ebook->fix_misc;
$ebook->print;
$ebook->save;
$ebook->init($otheropffile);
$ebook->fix_oeb12;
$ebook->gen_epub;
DEPENDENCIES
Perl Modules
- Archive::Zip
- Date::Manip
-
Note that Date::Manip will die on MS Windows system unless the TZ environment variable is set in a specific manner. See:
http://search.cpan.org/perldoc?Date::Manip#TIME_ZONES
- File::MimeInfo
- HTML::Parser
- Tie::IxHash
- Time::Local
- XML::Twig
Other Programs
- Tidy
-
The command "tidy" needs to be available, and ideally on the path. If it isn't on the path, package variable "$tidycmd" can be set to its absolute path. If tidy cannot be found, "system_tidy_xml()" and "system_tidy_xhtml()" will be nonfunctional.
CONFIGURABLE PACKAGE VARIABLES
%dcelements12
-
A tied IxHash mapping an all-lowercase list of Dublin Core metadata element names to the capitalization dictated by the OEB 1.2 specification, used by the fix_oeb12() and fix_oeb12_dcmeta() methods. Changing the tags in this list will change the tags recognized and placed inside the <dc-metadata> element.
Order is preserved and significant -- fix_oeb12 will output DC metadata elements in the same order as in this hash, though order for tags of the same name is preserved from the input file.
%dcelements20
-
A tied IxHash mapping an all-lowercase list of Dublin Core metadata element names to the all-lowercase form dictated by the OPF 2.0 specification (which means it maps the all-lowercase tags to themselves). It is used by the fix_opf20() and fix_opf20_dcmeta() methods. Changing the tags in this list will change the tags recognized and placed directly under the <metadata> element.
Order is preserved and significant -- fix_opf20 will output DC metadata elements in the same order as in this hash, though order for tags of the same name is preserved from the input file.
%nonxmlentity2char
-
This is the %entity2char conversion map from HTML::Entities with the 5 pre-defined XML entities (amp, gt, lt, quot, apos) removed. This is used during by "init()" to sanitize the OPF file data before parsing. This hash can be modified to allow and convert other non-standard entities to unicode characters. See HTML::Entities for details.
%publishermap
-
A hash mapping known variants of publisher names to a canonical form, used by "fix_publisher()", and thus also indirectly by "fix_misc()".
Keys should be entered in lowercase. The hash can also be set empty to prevent fix_publisher() from taking any action at all.
%relatorcodes
-
A hash mapping the MARC Relator Codes (see: http://www.loc.gov/marc/relators/relacode.html) to their descriptive names.
$tidycmd
-
The tidy executable name. This has to be a fully qualified pathname if tidy isn't on the path. Defaults to 'tidy'.
$tidyxhtmlerrors
-
The name of the error output file from system_tidy_xhtml(). Defaults to 'tidyxhtml-errors.txt'
$tidyxmlerrors
-
The name of the error output file from system_tidy_xml(). Defaults to 'tidyxml-errors.txt'
$tidysafety
-
The safety level to use when running tidy (default is 1). Potential values are:
$tidysafety < 1
:-
No checks performed, no error files kept, works like a clean tidy -m
This setting is DANGEROUS!
$tidysafety == 1
:-
Overwrites original file if there were no errors, but even if there were warnings. Keeps a log of errors, but not warnings.
$tidysafety == 2
:-
Overwrites original file if there were no errors, but even if there were warnings. Keeps a log of both errors and warnings.
$tidysafety == 3
:-
Overwrites original file only if there were no errors or warnings. Keeps a log of both errors and warnings.
$tidysafety
= 4>:-
Never overwrites original file. Keeps a log of both errors and warnings.
%validspecs
-
A hash mapping valid specification strings to themselves, primarily used to undefine unrecognized values. Default valid values are 'OEB12' and 'OPF20'.
CONSTRUCTORS AND INITIALIZATION
new($filename)
Instantiates a new EBook::Tools object. If $filename
is specified, it will also immediately initialize itself via the init
method.
init($filename)
Initializes the object from an existing OPF file. If $filename
is specified and exists, the OEB object will be set to read and write to that file before attempting to initialize. Otherwise, if the object currently points to an OPF file it will use that name. If there is no OPF filename data, and $filename
was not specified, it will make a last-ditch attempt to find an OPF file first by looking in META-INF/container.xml, and if nothing is found there, by looking in the current directory for a single OPF file.
If no such files or found (or more than one is found), the initialization croaks.
init_blank(%args)
Initializes an object containing nothing more than the basic OPF framework, suitable for adding new documents when creating an e-book from scratch.
Arguments
init_blank
takes up to three optional named arguments:
opffile
-
This specifies the OPF filename to use. If not specified, defaults to the name of the current working directory with ".opf" appended
-
This specifies the content of the initial dc:creator element. If not specified, defaults to "Unknown Author".
title
-
This specifies the content of the initial dc:title element. If not specified, defaults to "Unknown Title".
Example
init_blank('opffile' => 'newfile.opf',
'title' => 'The Great Unknown');
ACCESSOR METHODS
The following methods return data deeper in the structure than the auto-accessors, but still do not modify any object data or files.
adult()
Returns the text of the Mobipocket-specific <Adult> element, if it exists. Expected values are 'yes' and undef.
contributor_list()
Returns a list containing the text of all dc:contributor elements (case-insensitive) or undef if none are found.
In scalar context, returns the first contributor, not the last.
date_list(%args)
Returns the text of all dc:date elements (case-insensitive) matching the specified attributes.
In scalar context, returns the first match, not the last.
Returns undef if no matches are found.
Arguments
id
- 'id' attribute that must be matched exactly for the result to be added to the listevent
'opf:event' or 'event' attribute that must be matched exactly for the result to be added to the listIf both arguments are specified a value is added to the list if it matches either one (i.e. the logic is OR).
description()
Returns the description of the e-book, if set, or undef otherwise.
element_list(%args)
Returns a list containing the text values of all elements matching the specified criteria.
Arguments
cond
The XML::Twig search condition used to find the elements. Typically this is just the GI (tag) of the element you wish to find, but it can also be a qr// expression, coderef, or anything else that XML::Twig can work with. See the XML::Twig documentation for details.
If this is not specified, an error is added and the method returns undef.
id
(optional)'id' attribute that must be matched exactly for the result to be added to the list
scheme
(optional)'opf:scheme' or 'scheme' attribute that must be matched exactly for the result to be added to the list
event
(optional)'opf:event' or 'event' attribute that must be matched exactly for the result to be added to the list
If more than one of the arguments
id
,scheme
, orevent
are specified a value is added to the list if it matches any one (i.e. the logic is OR).
errors()
Returns an arrayref containing any generated error messages.
identifier()
Returns the text of the dc:identifier element pointed to by the 'unique-identifier' attribute of the root 'package' element, or undef if it could not be located.
isbn_list(%args)
Returns a list of all ISBNs matching the specified attributes. See "twigelt_is_isbn()" for a detailed description of how the ISBN elements are found.
Returns undef if no matches are found.
In scalar context returns the first match, not the last.
See also "isbns(%args)".
Arguments
id
(optional)'id' attribute that must be matched exactly for the result to be added to the list
scheme
(optional)'opf:scheme' or 'scheme' attribute that must be matched exactly for the result to be added to the list
If both arguments are specified a value is added to the list if it matches either one (i.e. the logic is OR).
isbns(%args)
Returns all of the ISBN identifiers matching the specificied attributes as a list of hashrefs, with one hash per ISBN identifier presented in the order that the identifiers are found. The hash keys are 'id' (containing the value of the 'id' attribute), 'scheme' (containing the value of either the 'opf:scheme' or 'scheme' attribute, whichever is found first), and 'isbn' (containing the text of the element).
If no entries are found, returns undef.
In scalar context returns the first match, not the last.
See also "isbn_list(%args)".
Arguments
isbns()
takes two optional named arguments:
id
- 'id' attribute that must be matched exactly for the result to be added to the listscheme
- 'opf:scheme' or 'scheme' attribute that must be matched exactly for the result to be added to the listIf both arguments are specified a value is added to the list if it matches either one (i.e. the logic is OR).
languages()
Returns a list containing the text of all dc:language (case-insensitive) entries, or undef if none are found.
In scalar context returns the first match, not the last.
manifest(%args)
Returns all of the items in the manifest as a list of hashrefs, with one hash per manifest item in the order that they appear, where the hash keys are 'id', 'href', and 'media-type', each returning the appropriate attribute, if any.
In scalar context, returns the first match, not the last.
Arguments
manifest()
takes four optional named arguments:
id
- 'id' attribute to matchhref
- 'href' attribute to matchmtype
- 'media-type' attribute to matchlogic
- logic to use (valid values are 'and' or 'or', default: 'and')
If any of the named arguments are specified, manifest()
will return only items matching the specified criteria. This is an exact case-sensitive match, but it can (especially in the case of mtype) still return multiple elements.
Return values
Returns undef if there is no <manifest> element directly underneath <package>, or if <manifest> contains no items.
See also
Example
@manifest = $ebook->manifest(id => 'ncx',
mtype => 'text/xml',
logic => 'or');
manifest_hrefs()
Returns a list of all of the hrefs in the current OPF manifest, or the empty list if none are found.
In scalar context returns the first href, not the last.
See also: manifest()
, spine_idrefs()
opffile()
Returns the name of the file where the OPF metadata will be stored or undef if no value is found..
primary_author()
Finds the primary author of the book, defined as the first 'dc:creator' entry (case-insensitive) where either the attribute opf:role="aut" or role="aut", or the first 'dc:creator' entry if no entries with either attribute can be found. Entries must actually have text to be considered.
In list context, returns a two-item list, the first of which is the text of the entry (the author name), and the second element of which is the value of the 'opf:file-as' or 'file-as' attribute (where 'opf:file-as' is given precedence if both are present).
In scalar context, returns the text of the entry (the author name).
If no entries are found, returns undef.
Uses "twigelt_is_author()" in the first half of the search.
Example
my ($fileas, $author) = $ebook->primary_author;
my $author = $ebook->primary_author;
print_errors()
Prints the current list of errors to STDERR.
print_warnings()
Prints the current list of warnings to STDERR.
print_opf()
Prints the OPF file to the default filehandle
publishers()
Returns a list containing the text of all dc:publisher (case-insensitive) entries, or undef if none are found.
In scalar context returns the first match, not the last.
retailprice()
Returns a two-scalar list, the first scalar being the text of the Mobipocket-specific <SRP> element, if it exists, and the second being the 'Currency' attribute of that element, if it exists.
In scalar context, returns just the text (price).
Returns undef if the SRP element is not found.
review()
Returns the text of the Mobipocket-specific <Review> element, if it exists. Returns undef if one is not found.
rights('id' =
'identifier')>
Returns a list containing the text of all of dc:rights or dc:copyrights (case-insensitive) entries in the e-book, or undef if none are found.
In scalar context returns the first match, not the last.
If the optional named argument 'id' is specified, it will only return entries where the id attribute matches the specified identifier. Although this still returns a list, if more than one entry is found, a warning is logged.
Note that dc:copyrights is not a valid Dublin Core element -- it is included only because some broken Mobipocket books use it.
search_knownuids()
Searches the OPF twig for the first dc:identifier (case-insensitive) element with an ID matching known UID IDs.
Returns the ID if a match is found, undef otherwise
search_knownuidschemes()
Searches descendants of the OPF twig element for the first <dc:identifier> or <dc:Identifier> subelement with the attribute 'scheme' or 'opf:scheme' matching a known list of schemes for unique IDs
NOTE: this is NOT a case-insensitive search! If you have to deal with really bizarre input, make sure that you run "fix_oeb12()" or "fix_opf20()" before calling "fix_packageid()" or "fix_misc()".
Returns the ID if a match is found, undef otherwise.
spec()
Returns the version of the OEB specification currently in use. Valid values are OEB12
and OPF20
. This value will default to undef until fix_oeb12
or fix_opf20
is called, as there is no way for the object to know what specification is being conformed to (if any) until it attempts to enforce it.
spine()
Returns all of the manifest items referenced in the spine as a list of hashrefs, with one hash per manifest item in the order that they appear, where the hash keys are 'id', 'href', and 'media-type', each returning the appropriate attribute, if any.
In scalar context, returns the first item, not the last.
Returns undef if there is no <spine> element directly underneath <package>, or if <spine> contains no itemrefs. If <spine> exists, but <manifest> does not, or a spine itemref exists but points an ID not found in the manifest, spine() logs an error and returns undef.
See also: "spine_idrefs()", "manifest()"
spine_idrefs()
Returns a list of all of the idrefs in the current OPF spine, or the empty list if none are found.
In scalar context, returns the first idref, not the last.
See also: "spine()", "manifest_hrefs()"
subject_list()
Returns a list containing the text of all dc:subject elements or undef if none are found.
In scalar context, returns the first subject, not the last.
title()
Returns the title of the e-book, or undef if no dc:title element (case-insensitive) exists. If a dc:title element exists, but contains no text, returns an empty string.
twig()
Returns the raw XML::Twig object used to store the OPF metadata.
Although this twig can be manipulated via the standard XML::Twig methods, doing so requires caution and is not recommended. In particular, changing the root element from here will cause the EBook::Tools internal twig and twigroot attributes to become unlinked and the result of any subsequent action is not defined.
twigcheck()
Croaks showing the calling location unless $self
has both a twig and a twigroot, and the twigroot is <package>. Used as a sanity check for methods that use twig or twigroot.
twigroot()
Returns the raw XML::Twig root element used to store the OPF metadata.
This twig element can be manipulated via the standard XML::Twig::Elt methods, but care should be taken not to attempt to cut this element from its twig as doing so will cause the EBook::Tools internal twig and twigroot attributes to become unlinked and the result of any subsequent action is not defined.
warnings()
Returns an arrayref containing any generated warning messages.
MODIFIER METHODS
Unless otherwise specified, all modifier methods return undef if an error was added to the error list, and true otherwise (even if a warning was added to the warning list).
add_document($href,$id,$mediatype)
Adds a document to the OPF manifest and spine, creating <manifest> and <spine> if necessary. To add an item only to the OPF manifest, see add_item().
Arguments
$href
-
The href to the document in question. Usually, this is just a filename (or relative path and filename) of a file in the current working directory. If you are planning to eventually generate a .epub book, all hrefs MUST be in or below the current working directory.
The method returns undef if $href is not defined or empty.
$id
-
The XML ID to use. If not specified, defaults to the href with invalid characters removed.
This must be unique not only to the manifest list, but to every element in the OPF file. If a duplicate ID exists, the method sets an error and returns undef.
$mediatype
(optional)-
The mime type of the document. If not specified, will attempt to autodetect the mime type, and if that fails, will default to 'application/xhtml+xml'.
add_error(@errors)
Adds @errors to the list of object errors. Each member of @errors should be a string containing the entire text of the error, with no ending newline.
SEE ALSO: "add_warning()", "clear_errors()", "clear_warnerr()"
add_identifier(%args)
Creates a new dc:identifier element containing the specified text, id, and scheme.
If a <dc-metadata> element exists underneath <metadata>, the identifier element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns the twig element containing the new identifier.
Arguments
add_identifier()
takes three named arguments, one mandatory, two optional.
text
- the text of the identifier. This is mandatory, and the method croaks if it is not present.scheme
- 'opf:scheme' or 'scheme' attribute to be added (optional)id
- 'id' attribute to be added. If this is specified, and the id is already in use, a warning will be added but the method will continue, removing the id attribute from the element that previously contained it.
add_item($href,$id,$mediatype)
Adds a document to the OPF manifest (but not spine), creating <manifest> if necessary. To add an item only to both the OPF manifest and spine, see add_document().
Arguments
$href
-
The href to the document in question. Usually, this is just a filename (or relative path and filename) of a file in the current working directory. If you are planning to eventually generate a .epub book, all hrefs MUST be in or below the current working directory.
$id
-
The XML ID to use. If not specified, defaults to the href with all nonword characters removed.
This must be unique not only to the manifest list, but to every element in the OPF file. If a duplicate ID exists, the method sets an error and returns undef.
$mediatype
(optional)-
The mime type of the document. If not specified, will attempt to autodetect the mime type, and if that fails, will set an error and return undef.
add_metadata(%args)
Creates a metadata element with the specified text, attributes, and parent.
If a <dc-metadata> element exists underneath <metadata>, the language element will be created underneath the <dc-metadata> and any standard attributes will be created in OEB 1.2 format, otherwise the element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no gi or if no text was specified.
Arguments
gi
-
The generic identifier (tag) of the metadata element to alter or create. If not specified, the method sets an error and returns undef.
parent
-
The generic identifier (tag) of the parent to use for any newly created element. If not specified, defaults to 'dc-metadata' if 'dc-metadata' exists underneath 'metadata', and 'metadata' otherwise.
A newly created element will be created under the first element found with this gi. A modified element will be moved under the first element found with this gi.
Newly created elements will use OPF 2.0 attribute names if the parent is 'metadata' and OEB 1.2 attribute names otherwise.
text
-
This specifies the element text to set. If not specified, the method sets an error and returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
fileas
(optional)-
This specifies the file-as attribute to set on the element.
role
(optional)-
This specifies the role attribute to set on the element.
scheme
(optional)-
This specifies the scheme attribute to set on the element.
Example
$retval = $ebook->add_metadata(gi => 'AuthorNonstandard',
text => 'Element Text',
id => 'customid',
fileas => 'Text, Element',
role => 'xxx',
scheme => 'code');
add_subject(%args)
Creates a new dc:subject element containing the specified text, code, and id.
If a <dc-metadata> element exists underneath <metadata>, the subject element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns the twig element containing the new subject.
Arguments
add_subject()
takes four named arguments, one mandatory, three optional.
text
- the text of the subject. This is mandatory, and the method croaks if it is not present.scheme
(optional) - 'opf:scheme' or 'scheme' attribute to be added. Be warned that neither the OEB 1.2 nor the OPF 2.0 specifications allow a scheme to be added to this element, so if this is specified, the resulting OPF file will fail to validate against either standard.basiccode
(optional) - 'BASICCode' attribute to be added. Be warned that this is a Mobipocket-specific attribute that does not exist in either the OEB 1.2 nor the OPF 2.0 specifications, so if this is specified, the resulting OPF file will fail to validate against either standard.id
(optional) - 'id' attribute to be added. If this is specified, and the id is already in use, a warning will be added but the method will continue, removing the id attribute from the element that previously contained it.
add_warning(@newwarning)
Joins @newwarning to a single string and adds it to the list of object warnings. The warning should not end with a newline newline.
SEE ALSO: "add_error()", "clear_warnings()", "clear_warnerr()"
clear_errors()
Clear the current list of errors
clear_warnerr()
Clear both the error and warning lists
clear_warnings()
Clear the current list of warnings
delete_meta_filepos()
Deletes metadata elements with the attribute 'filepos' underneath the given parent element
These are secondary metadata elements included in the output from mobi2html may that are not used.
fix_dates()
Standardizes all <dc:date> elements via fix_datestring(). Adds a warning to the object for each date that could not be fixed.
Called from "fix_misc()".
fix_guide()
Fixes problems related to the OPF guide elements, specifically:
Deletes empty guide elements
Moves all reference elements directly underneath the guide element
Finds reference elements with a href with only an anchor portion and assigns them to the first spine href. This only works if the spine is in working condition, so it may be wise to run "fix_spine()" before
fix_guide()
if the input is expected to be very badly broken.
Logs a warning if a reference href is found that does not appear in the manifest.
fix_languages()
Checks through the <dc:language> elements (case-insensitive) and removes any duplicates.
TODO: Also convert language names to IANA language and region codes.
fix_links()
Checks through the links in the manifest and checks them for anything they might link to, adding anything missing to the manifest.
A warning is added for every manifest item missing a href.
If no <manifest> element exists directly underneath the <package> root, or <manifest> contains no items, the method logs a warning and returns undef. Otherwise, it returns 1.
fix_manifest()
Finds all <item> elements and moves them underneath <manifest>, creating <manifest> if necessary.
Logs a warning but continues if it finds an <item> with a missing id or href attribute. If both id and href attributes are missing, logs a warning, skips moving the item entirely (unless it was already underneath <manifest>, in which case it is moved to preserve its sort order along all other items under <manifest>), but otherwise continues.
fix_metastructure_basic()
Verifies that <metadata> exists (creating it if necessary), and moves it to be the first child of <package>.
Used in "fix_metastructure_oeb12()", "fix_packageid()", and "set_primary_author(%args)".
fix_metastructure_oeb12()
Verifies the existence of <metadata>, <dc-metadata>, and <x-metadata>, creating them as needed, and making sure that <metadata> is a child of <package>, while <dc-metadata> and <x-metadata> are children of <metadata>.
Used in "fix_oeb12()" and "fix_mobi()".
fix_misc()
Fixes miscellaneous potential problems in OPF data. Specifically, this is a shortcut to calling "delete_meta_filepos()", "fix_packageid()", "fix_dates()", "fix_languages()", "fix_publisher()", "fix_manifest()", "fix_spine()", "fix_guide()", and "fix_links()".
The objective here is that you can run either fix_misc()
and either "fix_oeb12()" or "fix_opf20()" and a perfectly valid OPF file will result from only two calls.
fix_mobi()
Manipulates the twig to fix Mobipocket-specific issues
Force the OEB 1.2 structure (although not the namespace, DTD, or capitalization), so that <dc-metadata> and <x-metadata> are guaranteed to exist.
Find and move all Mobi-specific elements to <x-metadata>
If no <output> element exists, creates one for a utf-8 ebook
Note that the forced creation of <output> will cause the OPF file to become noncompliant with IDPF specifications.
fix_oeb12()
Modifies the OPF data to conform to the OEB 1.2 standard
Specifically, this involves:
adding the OEB 1.2 doctype
removing OPF 2.0 version and namespace attributes
setting the OEB 1.2 namespace on <package>
moving all of the dc-metadata elements underneath an element with tag <dc-metadata>, which itself is forced to be underneath <metadata>, which is created if it doesn't exist.
moving any remaining tags underneath <x-metadata>, again forced to be under <metadata>
making the dc-metadata tags conform to the OEB v1.2 capitalization
fix_oeb12_dcmetatags()
Makes a case-insensitive search for tags matching a known list of DC metadata elements and corrects the capitalization to the OEB 1.2 standard. Also corrects 'dc:Copyrights' to 'dc:Rights'. See global variable $dcelements12.
The "fix_oeb12()" method does this also, but fix_oeb12_dcmetatags() is usable separately for the case where you want DC metadata elements with consistent tag names, but don't want them moved from wherever they are.
fix_opf20()
Modifies the OPF data to conform to the OPF 2.0 standard
Specifically, this involves:
moving all of the dc-metadata and x-metadata elements directly underneath <metadata>
removing the <dc-metadata> and <x-metadata> elements themselves
lowercasing the dc-metadata tags (and fixing dc:copyrights to dc:rights)
setting namespaces on dc-metata OPF attributes
setting version and xmlns attributes on <package>
setting xmlns:dc and xmlns:opf on <metadata>
fix_opf20_dcmetatags()
Makes a case-insensitive search for tags matching a known list of DC metadata elements and corrects the capitalization to the OPF 2.0 standard. Also corrects 'dc:copyrights' to 'dc:rights'. See package variable %dcelements20.
The "fix_opf20()" method does this also, but fix_opf20_dcmetatags()
is usable separately for the case where you want DC metadata elements with consistent tag names, but don't want them moved from wherever they are.
fix_packageid()
Checks the <package> element for the attribute 'unique-identifier', makes sure that it is mapped to a valid dc:identifier subelement, and if not, searches those subelements for an identifier to assign, or creates one if nothing can be found.
Requires that <metadata> exist. Croaks if it doesn't. Run "fix_oeb12()" or "fix_opf20()" before calling this if the input might be very broken.
fix_publisher()
Standardizes publisher names in all dc:publisher entities, mapping known variants of a publisher's name to a canonical form via package variable %publishermap.
Publisher entries with no text are deleted.
fix_spine()
Fixes problems with the OPF spine, specifically:
gen_epub(%args)
Creates a .epub format e-book. This will create (or overwrite) the files 'mimetype' and 'META-INF/container.xml' in the current directory, creating the subdirectory META-INF as needed.
Arguments
This method can take two optional named arguments.
filename
-
The filename of the .epub output file. If not specified, takes the base name of the opf file and adds a .epub extension.
dir
-
The directory to output the .epub file. If not specified, uses the current working directory. If a specified directory does not exist, it will be created, or the method will croak.
Example
gen_epub(filename => 'mybook.epub',
dir => '../epub_books');
gen_epub_files()
Generates the mimetype
and META-INF/container.xml
files expected by a .epub container, but does not actually generate the .epub file itself. This will be called automatically by gen_epub
.
gen_ncx($filename)
Creates a NCX-format table of contents from the package unique-identifier, the dc:title, dc:creator, and spine elements, and then add the NCX entry to the manifest if it is not already referenced.
Adds an error and fails if any of those cannot be found. The first available dc:title is taken, but will prioritize dc:creator elements with opf:role="aut" over those with no role attribute (see twigelt_is_author() for details).
WARNING: This method REQUIRES that the e-book be in OPF 2.0 format to function correctly. Call fix_opf20() before calling gen_ncx(). gen_ncx() will log an error and fail if $self{spec} is not set to OPF20.
Arguments
This method will overwrite any existing file.
Returns a twig containing the NCX XML, or undef on failure.
save()
Saves the OPF file to disk. Existing files are backed up to filename.backup.
set_adult($bool)
Sets the Mobipocket-specific <Adult> element, creating or deleting it as necessary. If $bool
is true, the text is set to 'yes'. If it is defined but false, any existing elements are deleted. If it is undefined, the method immediately returns.
If a new element has to be created, "fix_metastructure_oeb12" is called to ensure that <x-metadata> exists and the element is created under <x-metadata>, as Mobipocket elements are not recognized by Mobipocket's software when placed directly under <metadata>
set_date(%args)
Sets the date metadata for a given event. If more than one dc:date or dc:Date element is present with the specified event attribute, sets the first. If no dc:date element is present with the specified event attribute, a new element is created.
If a <dc-metadata> element exists underneath <metadata>, the date element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, logs an error and returns undef if no text or event was specified.
Arguments
text
-
This specifies the description to use as the text of the element. If not specified, the method sets an error and returns undef.
event
-
This specifies the event attribute for the date. If not specified, the method sets an error and returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
set_description(%args)
Sets the text and optionally ID of the first dc:description element found (case-insensitive). Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the description element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no publisher was specified.
Arguments
set_description()
takes one required and one optional named argument
text
-
This specifies the description to use as the text of the element. If not specified, the method returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
Example
$retval = $ebook->set_description('text' => 'A really good book',
'id' => 'mydescid');
set_language(%args)
Sets the text and optionally the ID of the first dc:language element found (case-insensitive). Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the language element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no text was specified.
Arguments
text
-
This specifies the language set as the text of the element. If not specified, the method sets an error and returns undef. This should be an IANA language code, and it will be lowercased before it is set.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
Example
$retval = $ebook->set_language('text' => 'en-us',
'id' => 'langid');
set_metadata(%args)
Sets the text and optionally the ID of the first specified element type found (case-insensitive). Creates the element if one did not exist (with the exact capitalization specified).
If a <dc-metadata> element exists underneath <metadata>, the language element will be created underneath the <dc-metadata> and any standard attributes will be created in OEB 1.2 format, otherwise the element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no gi or if no text was specified.
Arguments
gi
-
The generic identifier (tag) of the metadata element to alter or create. If not specified, the method sets an error and returns undef.
parent
-
The generic identifier (tag) of the parent to use for any newly created element. If not specified, defaults to 'dc-metadata' if 'dc-metadata' exists underneath 'metadata', and 'metadata' otherwise.
A newly created element will be created under the first element found with this gi. A modified element will be moved under the first element found with this gi.
Newly created elements will use OPF 2.0 attribute names if the parent is 'metadata' and OEB 1.2 attribute names otherwise.
text
-
This specifies the element text to set. If not specified, the method sets an error and returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
fileas
(optional)-
This specifies the file-as attribute to set on the element.
role
(optional)-
This specifies the role attribute to set on the element.
scheme
(optional)-
This specifies the scheme attribute to set on the element.
Example
$retval = $ebook->set_metadata(gi => 'AuthorNonstandard',
text => 'Element Text',
id => 'customid',
fileas => 'Text, Element',
role => 'xxx',
scheme => 'code');
set_opffile($filename)
Sets the filename used to store the OPF metadata.
Returns 1 on success; sets an error message and returns undef if no filename was specified.
set_retailprice(%args)
Sets the Mobipocket-specific <SRP> element (Suggested Retail Price), creating or deleting it as necessary.
If a new element has to be created, "fix_metastructure_oeb12" is called to ensure that <x-metadata> exists and the element is created under <x-metadata>, as Mobipocket elements are not recognized by Mobipocket's software when placed directly under <metadata>
Arguments
text
The price to set as the text of the element. If this is undefined, the method sets an error and returns undef. If it is set but false, any existing <SRP> element is deleted.
currency
(optional)The value to set on the 'Currency' attribute. If not provided, defaults to 'USD' (US Dollars)
set_primary_author(%args)
Sets the text, id, file-as, and role attributes of the primary author element (see "primary_author()" for details on how this is found), or if no primary author exists, creates a new element containing the information.
This method calls "fix_metastructure_basic()" to enforce the presence of the <metadata> element. When creating a new element, the method will use the OEB 1.2 element name and create the element underneath <dc-metadata> if an existing <dc-metadata> element is found underneath <metadata>. If no existing <dc-metadata> element is found, the new element will be created with the OPF 2.0 element name directly underneath <metadata>. Regardless, it is probably a good idea to call "fix_oeb12()" or "fix_opf20()" after calling this method to ensure a consistent scheme.
Arguments
Three optional named arguments can be passed:
text
Specifies the author text to set. If omitted and a primary author element exists, the text will be left as is; if omitted and a primary author element cannot be found, an error message will be generated and the method will return undef.
fileas
Specifies the 'file-as' attribute to set. If omitted and a primary author element exists, any existing attribute will be left untouched; if omitted and a primary author element cannot be found, the newly created element will not have this attribute.
id
Specifies the 'id' attribute to set. If this is specified, and the id is already in use, a warning will be added but the method will continue, removing the id attribute from the element that previously contained it.
If this is omitted and a primary author element exists, any existing id will be left untouched; if omitted and a primary author element cannot be found, the newly created element will not have an id set.
If called with no arguments, the only effect this method has is to enforce that either an 'opf:role' or 'role' attribute is set to 'aut' on the primary author element.
Return values
Returns 1 if successful, returns undef and sets an error message if the author argument is missing and no primary author element was found.
set_publisher(%args)
Sets the text and optionally the ID of the first dc:publisher element found (case-insensitive). Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the publisher element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no publisher was specified.
Arguments
set_publisher()
takes one required and one optional named argument
text
-
This specifies the publisher name to set as the text of the element. If not specified, the method returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
Example
$retval = $ebook->set_publisher('text' => 'My Publishing House',
'id' => 'mypubid');
set_review(%args)
Sets the text and optionally ID of the first <Review> element found (case-insensitive), creating the element if one did not exist.
This is a Mobipocket-specific element and if it needs to be created it will always be created under <x-metadata> with "fix_metastructure_oeb12()" called to ensure that <x-metadata> exists.
Returns 1 on success, returns undef if no review text was specified
Arguments
text
-
This specifies the description to use as the text of the element. If not specified, the method returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
Example
$retval = $ebook->set_review('text' => 'This book is perfect!',
'id' => 'revid');
set_rights(%args)
Sets the text of the first dc:rights or dc:copyrights element found (case-insensitive). If the element found has the gi of dc:copyrights, it will be changed to dc:rights. This is to correct certain noncompliant Mobipocket files.
Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the title element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no rights string was specified.
Arguments
text
This specifies the text of the element. If not specified, the method returns undef.
id
(optional)This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged but the method continues anyway.
set_spec($spec)
Sets the OEB specification to match when modifying OPF data. Allowable values are 'OEB12', 'OPF20', and 'MOBI12'.
Returns 1 if successful; returns undef and sets an error message if an unknown specification was set.
set_title(%args)
Sets the text or id of the first dc:title element found (case-insensitive). Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the title element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Arguments
set_title() takes two optional named arguments. If neither is specified, the method will do nothing.
text
This specifies the text of the element. If not specified, and no title element is found, an error will be set and the method will return undef -- set_title() will refuse to create a dc:title element with no text.
id
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged but the method continues anyway.
set_type(%args)
Sets the text and optionally the ID of the first dc:type element found (case-insensitive). Creates the element if one did not exist. If a <dc-metadata> element exists underneath <metadata>, the publisher element will be created underneath the <dc-metadata> in OEB 1.2 format, otherwise the title element is created underneath <metadata> in OPF 2.0 format.
Returns 1 on success, returns undef if no publisher was specified.
Arguments
set_type()
takes one required and one optional named argument
text
-
This specifies the publisher name to set as the text of the element. If not specified, the method returns undef.
id
(optional)-
This specifies the ID to set on the element. If set and the ID is already in use, a warning is logged and the ID is removed from the other location and assigned to the element.
Example
$retval = $ebook->set_type('text' => 'Short Story',
'id' => 'mytypeid');
PROCEDURES
All procedures are exportable, but none are exported by default.
create_epub_container($opffile)
Creates the XML file META-INF/container.xml pointing to the specified OPF file.
Creates the META-INF directory if necessary. Will destroy any non-directory file named 'META-INF' in the current directory. If META-INF/container.xml already exists, it will rename that file to META-INF/container.xml.backup.
Arguments
- $opffile
-
The OPF filename (and path, if necessary) to use in the container. If not specified, looks for a sole OPF file in the current working directory. Fails if more than one is found.
Return values
create_epub_mimetype()
Creates a file named 'mimetype' in the current working directory containing 'application/epub+zip' (no trailing newline)
Destroys and overwrites that file if it exists.
Returns the mimetype string if successful, undef otherwise.
debug($level,@message)
Prints a debugging message to STDERR
if package variable $debug
is greater than or equal to $level
. A trailing newline is appended, and should not be part of @message.
Returns true or dies.
find_links($filename)
Searches through a file for href and src attributes, and returns a list of unique links with any named anchors removed (e.g. 'myfile.html#part7' returns as just 'myfile.html'). If no links are found, or the file does not exist, returns undef.
Does not check to see if the links are local. Requires that links be surrounded by double quotes, not single or left bare. Assumes that any link will not be broken across multiple lines, so it will (for example) fail to find:
<img src=
"myfile.jpg">
though it can find:
<img
src="myfile.jpg">
This also does not distinguish between local files and remote links.
fix_datestring($datestring)
Takes a date string and attempts to convert it to the limited subset of ISO8601 allowed by the OPF standard (YYYY, YYYY-MM, or YYYY-MM-DD).
In the special case of finding MM/DD/YYYY, it assumes that it was a Mobipocket-mangled date, and not only converts it, but will strip the day information if the day is '01', and both the month and day information if both month and day are '01'. This is because Mobipocket Creator enforces a complete MM/DD/YYYY even if the month and day aren't known, and it is common practice to use 01 for an unknown value.
Arguments
Returns $fixeddate
get_container_rootfile($container)
Opens and parses an OPS/epub container, extracting the 'full-path' attribute of element 'rootfile'
Arguments
Return values
print_memory($label)
Checks /proc/$PID/statm and prints out a line to STDERR showing the current memory usage. This is a debugging tool that will likely fail to do anything useful on a system without a /proc system compatible with Linux.
Arguments
Returns 1 on success, undef otherwise.
split_metadata($metahtmlfile, $metafile)
Takes a psuedo-HTML containing one or more <metadata>...</metadata> blocks and splits out the metadata blocks into an XML file ready to be used as an OPF document. The input HTML file is rewritten without the metadata.
If $metafile (or the temporary HTML-only file created during the split) already exists, it will be moved to filename.backup.
Arguments
$metahtmlfile
-
The filename of the pseudo-HTML file
$metafile
(optional)-
The filename to write out any extracted metadata. If not specified, will default to the basename of $metahtmlfile with '.opf' appended.
Returns the filename the metadata was written to, or undef if no metadata was found.
split_pre($htmlfile,$outfilebase)
Splits <pre>...</pre> blocks out of a source HTML file into their own separate HTML files including required headers. Each block will be written to its own file following the naming format $outfilebase-###.html
, where ### is a three-digit number beginning at 001 and incrementing for each block found. If $outfilebase
is not specified, it defaults to the basename of $htmlfile
with "-pre-###.html" appended. The
Returns a list containing all filenames created.
system_tidy_xhtml($infile,$outfile)
Runs tidy on a XHTML file semi-safely (using a secondary file)
Converts HTML to XHTML if necessary
Arguments
- $infile
-
The filename to tidy
- $outfile
-
The filename to use for tidy output if the safety condition to overwrite the input file isn't met.
Defaults to
infile-tidy.ext
if not specified.
Global variables used
- $tidycmd
-
the location of the tidy executable
- $tidyxhtmlerrors
-
the filename to use to output errors
- $tidysafety
-
the safety factor to use (see CONFIGURABLE GLOBAL VARIABLES, above)
Return Values
Returns the return value from tidy
system_tidy_xml($infile,$outfile)
Runs tidy on an XML file semi-safely (using a secondary file)
Arguments
$infile
-
The filename to tidy
$outfile
(optional)-
The filename to use for tidy output if the safety condition to overwrite the input file isn't met.
Defaults to
infile-tidy.ext
if not specified.
Global variables used
$tidycmd
-
the name of the tidy executable
$tidyxmlerrors
-
the filename to use to output errors
$tidysafety
-
the safety factor to use (see CONFIGURABLE GLOBAL VARIABLES, above)
Return values
Returns the return value from tidy
trim
Removes any whitespace characters from the beginning or end of every string in @list (also works on scalars).
trim; # trims $_ inplace
$new = trim; # trims (and returns) a copy of $_
trim $str; # trims $str inplace
$new = trim $str; # trims (and returns) a copy of $str
trim @list; # trims @list inplace
@new = trim @list; # trims (and returns) a copy of @list
This was shamelessly copied from japhy's example at perlmonks.org:
http://www.perlmonks.org/?node_id=36684
If needed for large lists, it would probably be better to use String::Strip.
twigelt_create_uuid($gi)
Creates an unlinked element with the specified gi (tag), and then assigns it the id and scheme attributes 'UUID'.
Arguments
Returns the element.
twigelt_detect_duplicate($element1, $element2)
Takes two twig elements and returns 1 if they have the same GI (tag), text, and attributes, but are not actually the same element. The GI comparison is case-insensitive. The others are case-sensitive.
Returns 0 otherwise.
Croaks if passed anything but twig elements.
twigelt_fix_oeb12_atts($element)
Checks the attributes in a twig element to see if they match OPF names with an opf: namespace, and if so, removes the namespace. Used by the fix_oeb12() method.
Takes as a sole argument a twig element.
Returns that element with the modified attributes, or undef if the element didn't exist. Returns an unmodified element if both att and opf:att exist.
twigelt_fix_opf20_atts($element)
Checks the attributes in a twig element to see if they match OPF names, and if so, prepends the OPF namespace. Used by the fix_opf20() method.
Takes as a sole argument a twig element.
Returns that element with the modified attributes, or undef if the element didn't exist.
twigelt_is_author($element)
Takes as an argument a twig element. Returns true if the element is a dc:creator (case-insensitive) with either a opf:role="aut" or role="aut" attribute defined. Returns undef otherwise, and also if the element has no text.
Croaks if fed no argument, or fed an argument that isn't a twig element.
Intended to be used as a twig search condition.
Example
my @elements = $ebook->twigroot->descendants(\&twigelt_is_author);
twigelt_is_isbn($element)
Takes as an argument a twig element. Returns true if the element is a dc:identifier (case-insensitive) where any of the id, opf:scheme, or scheme attributes start with 'isbn', '-isbn', 'eisbn', or 'e-isbn' (again case-insensitive).
Returns undef otherwise, and also if the element has no text.
Croaks if fed no argument, or fed an argument that isn't a twig element.
Intended to be used as a twig search condition.
Example
my @elements = $ebook->twigroot->descendants(\&twigelt_is_isbn);
ymd_validate($year,$month,$day)
Make sure month and day have valid values. Return the passed values if they are, return 3 undefs if not. Testing of month or day can be skipped by passing undef in that spot.
BUGS/TODO
fix_links() could be improved to download remote URIs instead of ignoring them.
fix_links() needs to check the <reference> links under <guide>
Need to implement fix_tours() that should collect the related elements and delete the parent if none are found. Empty <tours> elements aren't allowed.
fix_languages() needs to convert language names into IANA language codes.
set_language() should add a warning if the text isn't a valid IANA language code.
NCX generation only generates from the spine. It should be possible to use a TOC html file for generation instead. In the long term, it should be possible to generate one from the headers and anchors in arbitrary HTML files.
It might be better to use sysread / index / substr / syswrite in &split_metadata to handle the split in 10k chunks, to avoid massive memory usage on large files.
This may not be worth the effort, since the average size for most books is less than 500k, and the largest books are rarely over 10M.
The only generator is currently for .epub books. PDF, PalmDoc, Mobipocket, Plucker, and iSiloX are eventually planned.
Although I like keeping warnings associated with the ebook object, it may be better to throw exceptions on errors and catch them later. This probably won't be implemented until it bites someone who complains, though.
Unit tests are incomplete
AUTHOR
Zed Pobre <zed@debian.org>
COPYRIGHT
Copyright 2008 Zed Pobre
Licensed to the public under the terms of the GNU GPL, version 2
6 POD Errors
The following errors were encountered while parsing the POD:
- Around line 910:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'
- Around line 1042:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'
- Around line 1146:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'
- Around line 1248:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'
- Around line 2387:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'
- Around line 2741:
You forgot a '=back' before '=head2'
You forgot a '=back' before '=head2'