Name
Data::Table::Text - Write data in tabular text format.
Synopsis
use Data::Table::Text;
# Print a table:
my $d =
[[qq(a), qq(b\nbb), qq(c\ncc\nccc\n)],
[qq(1), qq(1\n22), qq(1\n22\n333\n)],
];
my $t = formatTable($d, [qw(A BB CCC)]);
ok $t eq <<END;
A BB CCC
1 a b c
bb cc
ccc
2 1 1 1
22 22
333
END
# Print a table containing tables and make it into a report:
my $D = [[qq(See the\ntable\nopposite), $t],
[qq(Or\nthis\none), $t],
];
my $T = formatTable($D, [qw(Description Table)], head=><<END);
Table of Tables.
Table has NNNN rows each of which contains a table.
END
ok $T eq <<END;
Table of Tables.
Table has 2 rows each of which contains a table.
Description Table
1 See the A BB CCC
table 1 a b c
opposite bb cc
ccc
2 1 1 1
22 22
333
2 Or A BB CCC
this 1 a b c
one bb cc
ccc
2 1 1 1
22 22
333
END
# Print an array of arrays:
my $aa = formatTable
([[qw(A B C )],
[qw(AA BB CC )],
[qw(AAA BBB CCC)],
[qw(1 22 333)]],
[qw (aa bb cc)]);
ok $aa eq <<END;
aa bb cc
1 A B C
2 AA BB CC
3 AAA BBB CCC
4 1 22 333
END
# Print an array of hashes:
my $ah = formatTable
([{aa=> "A", bb => "B", cc => "C" },
{aa=> "AA", bb => "BB", cc => "CC" },
{aa=> "AAA", bb => "BBB", cc => "CCC" },
{aa=> 1, bb => 22, cc => 333 }]);
ok $ah eq <<END;
aa bb cc
1 A B C
2 AA BB CC
3 AAA BBB CCC
4 1 22 333
END
# Print a hash of arrays:
my $ha = formatTable
({"" => ["aa", "bb", "cc"],
"1" => ["A", "B", "C"],
"22" => ["AA", "BB", "CC"],
"333" => ["AAA", "BBB", "CCC"],
"4444" => [1, 22, 333]},
[qw(Key A B C)]
);
ok $ha eq <<END;
Key A B C
aa bb cc
1 A B C
22 AA BB CC
333 AAA BBB CCC
4444 1 22 333
END
# Print a hash of hashes:
my $hh = formatTable
({a => {aa=>"A", bb=>"B", cc=>"C" },
aa => {aa=>"AA", bb=>"BB", cc=>"CC" },
aaa => {aa=>"AAA", bb=>"BBB", cc=>"CCC" },
aaaa => {aa=>1, bb=>22, cc=>333 }});
ok $hh eq <<END;
aa bb cc
a A B C
aa AA BB CC
aaa AAA BBB CCC
aaaa 1 22 333
END
# Print an array of scalars:
my $a = formatTable(["a", "bb", "ccc", 4], [q(#), q(Col)]);
ok $a eq <<END;
# Col
0 a
1 bb
2 ccc
3 4
END
# Print a hash of scalars:
my $h = formatTable({aa=>"AAAA", bb=>"BBBB", cc=>"333"}, [qw(Key Title)]);
ok $h eq <<END;
Key Title
aa AAAA
bb BBBB
cc 333
END
Description
Write data in tabular text format.
The following sections describe the methods in each functional area of this module. For an alphabetic listing of all methods by name see Index.
Time stamps
Date and timestamps as used in logs of long running commands.
dateTimeStamp()
Year-monthNumber-day at hours:minute:seconds
Example:
ok dateTimeStamp =~ m(\A\d{4}-\d\d-\d\d at \d\d:\d\d:\d\d\Z);
dateStamp()
Year-monthName-day
Example:
ok dateStamp =~ m(\A\d{4}-\w{3}-\d\d\Z);
versionCode()
YYYYmmdd-HHMMSS
Example:
ok versionCode =~ m(\A\d{8}-\d{6}\Z);
versionCodeDashed()
YYYY-mm-dd-HH:MM:SS
Example:
ok versionCodeDashed =~ m(\A\d{4}-\d\d-\d\d-\d\d:\d\d:\d\d\Z);
timeStamp()
hours:minute:seconds
Example:
ok timeStamp =~ m(\A\d\d:\d\d:\d\d\Z);
microSecondsSinceEpoch()
Micro seconds since unix epoch.
Example:
ok microSecondsSinceEpoch > 47*365*24*60*60*1e6;
Command execution
Various ways of processing commands.
xxx(@)
Execute a shell command. The command to execute is specified as one or more strings which are joined together after removing any new lines. Optionally the last string can be a regular expression that is used to test the output generated by the execution the command: if the regular expression fails the command output is printed, else it is suppressed as being uninteresting.
Parameter Description
1 @cmd Command to execute followed by an optional regular expression to test the results
Example:
{ok xxx("echo aaa") =~ /aaa/;
yyy($)
Execute a block of shell commands line by line after removing comments - stop if there is a non zero return code from any command.
Parameter Description
1 $cmd Commands to execute separated by new lines
Example:
ok !yyy <<END;
echo aaa
echo bbb
END
zzz($$$$)
Execute lines of commands after replacing new lines with && then check that the pipeline execution results in a return code of zero and that the execution results match the optional regular expression if one has been supplied; confess() to an error if either check fails.
Parameter Description
1 $cmd Commands to execute - one per line with no trailing &&
2 $success Optional regular expression to check for acceptable results
3 $returnCode Optional regular expression to check the acceptable return codes
4 $message Message of explanation if any of the checks fail
Example:
ok zzz(<<END, qr(aaa\s*bbb)s);
echo aaa
echo bbb
END
parseCommandLineArguments(&$$)
Classify the specified array of words referred to by $args into positional and keyword parameters, call the specified sub with a reference to an array of positional parameters followed by a reference to a hash of keywords and their values then return the value returned by this sub. The keywords names will be validated if $valid is either a reference to an array of valid keywords names or a hash of valid keyword names => textual descriptions. Confess with a table of valid keywords definitions if the $valid keywords are specified and an invalid one is presented.
Parameter Description
1 $sub Sub to call
2 $args List of arguments to parse
3 $valid Optional list of valid parameters else all parameters will be accepted
Example:
my $r = parseCommandLineArguments {[@_]}
[qw( aaa bbb -c --dd --eee=EEEE -f=F), q(--gg=g g), q(--hh=h h)];
is_deeply $r,
[["aaa", "bbb"],
{c=>undef, dd=>undef, eee=>"EEEE", f=>"F", gg=>"g g", hh=>"h h"},
];
call(&@)
Call the specified sub in a separate process, wait for it to complete, copy back the named our variables, free the memory used.
Parameter Description
1 $sub Sub to call
2 @our Our variable names with preceding sigils to copy back
Example:
ˢ{our $a = q(1);
our @a = qw(1);
our %a = (a=>1);
our $b = q(1);
for(2..4) {
call {$a = $_ x 1000; $a[0] = $_; $a{a} = $_; $b = 2;} qw($a @a %a);
ok $a == $_ x 1000;
ok $a[0] == $_;
ok $a{a} == $_;
ok $b == 1;
}
};
Files and paths
Operations on files and paths.
Statistics
Information about each file.
fileSize($)
Get the size of a file.
Parameter Description
1 $file File name
Example:
my $f = writeFile("zzz.data", "aaa");
ok fileSize($f) == 3;
fileModTime($)
Get the modified time of a file in seconds since the epoch.
Parameter Description
1 $file File name
Example:
ok fileModTime($0) =~ m(\A\d+\Z)s;
fileOutOfDate(&$@)
Calls the specified sub once for each source file that is missing, then calls the sub for the target if there were any missing files or if the target is older than any of the non missing source files or if the target does not exist. The file name is passed to the sub each time in $_. Returns the files to be remade in the order they should be made.
Parameter Description
1 $make Make with this sub
2 $target Target file
3 @source Source files
Example:
if (0) {
my @Files = qw(a b c);
my @files = (@Files, qw(d));
writeFile($_, $_), sleep 1 for @Files;
my $a = '';
my @a = fileOutOfDate {$a .= $_} q(a), @files;
ok $a eq 'da';
is_deeply [@a], [qw(d a)];
my $b = '';
my @b = fileOutOfDate {$b .= $_} q(b), @files;
ok $b eq 'db';
is_deeply [@b], [qw(d b)];
my $c = '';
my @c = fileOutOfDate {$c .= $_} q(c), @files;
ok $c eq 'dc';
is_deeply [@c], [qw(d c)];
my $d = '';
my @d = fileOutOfDate {$d .= $_} q(d), @files;
ok $d eq 'd';
is_deeply [@d], [qw(d)];
my @A = fileOutOfDate {} q(a), @Files;
my @B = fileOutOfDate {} q(b), @Files;
my @C = fileOutOfDate {} q(c), @Files;
is_deeply [@A], [qw(a)];
is_deeply [@B], [qw(b)];
is_deeply [@C], [];
unlink for @Files;
}
firstFileThatExists(@)
Returns the name of the first file that exists or undef if none of the named files exist.
Parameter Description
1 @files Files to check
Example:
my $d = temporaryFolder;
ok $d eq firstFileThatExists("$d/$d", $d);
Components
File names and components.
Fusion
Create file names from file name components.
filePath(@)
Create a file name from an array of file name components. If all the components are blank then a blank file name is returned. Identical to fpf.
Parameter Description
1 @file File name components
Example:
if (1) {
ok filePath (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok filePathDir(qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok filePathDir('', qw(aaa)) eq "aaa/";
ok filePathDir('') eq "";
ok filePathExt(qw(aaa xxx)) eq "aaa.xxx";
ok filePathExt(qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
ok fpd (qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok fpf (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok fpe (qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
}
fpf is a synonym for filePath.
filePathDir(@)
Create a directory name from an array of file name components. If all the components are blank then a blank file name is returned. Identical to fpd.
Parameter Description
1 @file Directory name components
Example:
if (1) {
ok filePath (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok filePathDir(qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok filePathDir('', qw(aaa)) eq "aaa/";
ok filePathDir('') eq "";
ok filePathExt(qw(aaa xxx)) eq "aaa.xxx";
ok filePathExt(qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
ok fpd (qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok fpf (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok fpe (qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
}
fpd is a synonym for filePathDir.
filePathExt(@)
Create a file name from an array of file name components the last of which is an extension. Identical to fpe.
Parameter Description
1 @File File name components and extension
Example:
if (1) {
ok filePath (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok filePathDir(qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok filePathDir('', qw(aaa)) eq "aaa/";
ok filePathDir('') eq "";
ok filePathExt(qw(aaa xxx)) eq "aaa.xxx";
ok filePathExt(qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
ok fpd (qw(/aaa bbb ccc ddd)) eq "/aaa/bbb/ccc/ddd/";
ok fpf (qw(/aaa bbb ccc ddd.eee)) eq "/aaa/bbb/ccc/ddd.eee";
ok fpe (qw(aaa bbb xxx)) eq "aaa/bbb.xxx";
}
fpe is a synonym for filePathExt.
Fission
Get file name components from file names.
fp($)
Get path from file name.
Parameter Description
1 $file File name
Example:
ok fp (q(a/b/c.d.e)) eq q(a/b/);
fpn($)
Remove extension from file name.
Parameter Description
1 $file File name
Example:
ok fpn(q(a/b/c.d.e)) eq q(a/b/c.d);
fn($)
Remove path and extension from file name.
Parameter Description
1 $file File name
Example:
ok fn (q(a/b/c.d.e)) eq q(c.d);
fne($)
Remove path from file name.
Parameter Description
1 $file File name
Example:
ok fne(q(a/b/c.d.e)) eq q(c.d.e);
fe($)
Get extension of file name.
Parameter Description
1 $file File name
Example:
ok fe (q(a/b/c.d.e)) eq q(e);
checkFile($)
Return the name of the specified file if it exists, else confess the maximum extent of the path that does exist.
Parameter Description
1 $file File to check
Example:
my $d = filePath (my @d = qw(a b c d));
my $f = filePathExt(qw(a b c d e x));
my $F = filePathExt(qw(a b c e d));
createEmptyFile($f);
ok checkFile($d);
ok checkFile($f);
quoteFile($)
Quote a file name.
Parameter Description
1 $file File name
Example:
ok quoteFile(fpe(qw(a b c))) eq q("a/b.c");
removeFilePrefix($@)
Removes a file prefix from an array of files.
Parameter Description
1 $prefix File prefix
2 @files Array of file names
Example:
is_deeply [qw(a b)], [&removeFilePrefix(qw(a/ a/a a/b))];
is_deeply [qw(b)], [&removeFilePrefix("a/", "a/b")];
titleToUniqueFileName($$$$)
Create a file name from a title that is unique within the set %uniqueNames.
Parameter Description
1 $uniqueFileNames Unique file names hash {} which will be updated by this method
2 $title Title
3 $suffix File name suffix
4 $ext File extension
Example:
ˢ{my $f = {};
ok q(a_p.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_p_2.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_p_3.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_q.txt) eq &titleToUniqueFileName($f, qw(a q txt));
ok q(a_q_5.txt) eq &titleToUniqueFileName($f, qw(a q txt));
ok q(a_q_6.txt) eq &titleToUniqueFileName($f, qw(a q txt));
};
ok q(a_p.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_p_2.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_p_3.txt) eq &titleToUniqueFileName($f, qw(a p txt));
ok q(a_q.txt) eq &titleToUniqueFileName($f, qw(a q txt));
ok q(a_q_5.txt) eq &titleToUniqueFileName($f, qw(a q txt));
ok q(a_q_6.txt) eq &titleToUniqueFileName($f, qw(a q txt));
Position
Position in the file system.
currentDirectory()
Get the current working directory.
Example:
currentDirectory;
currentDirectoryAbove()
The path to the folder above the current working folder.
Example:
currentDirectoryAbove;
parseFileName($)
Parse a file name into (path, name, extension).
Parameter Description
1 $file File name to parse
Example:
is_deeply [parseFileName "a.b/c.d.e"], [qw(a.b/ c.d e)];
fullFileName()
Full name of a file.
Example:
fullFileName(fpe(qw(a txt)));
absFromAbsPlusRel($$)
Create an absolute file from an absolute file and a relative file.
Parameter Description
1 $a Absolute file name
2 $f Relative file name
Example:
ok "/home/la/perl/aaa.pl" eq absFromAbsPlusRel("/home/la/perl/bbb", "aaa.pl");
ok "/home/la/perl/aaa.pl" eq absFromAbsPlusRel("/home/il/perl/bbb.pl", "../../la/perl/aaa.pl");
relFromAbsAgainstAbs($$)
Derive a relative file name for the first absolute file name relative to the second absolute file name.
Parameter Description
1 $f Absolute file to be made relative
2 $a Absolute file name to make relative to.
Example:
ok "bbb.pl" eq relFromAbsAgainstAbs("/home/la/perl/bbb.pl", "/home/la/perl/aaa.pl");
ok "../perl/bbb.pl" eq relFromAbsAgainstAbs("/home/la/perl/bbb.pl", "/home/la/java/aaa.jv");
Temporary
Temporary files and folders
temporaryFile()
Create a temporary file that will automatically be unlinked during END processing.
Example:
my $f = temporaryFile;
temporaryFolder()
Create a temporary folder that will automatically be rmdired during END processing.
Example:
my $D = temporaryFolder;
temporaryDirectory is a synonym for temporaryFolder.
Find
Find files and folders below a folder.
findFiles($$)
Find all the files under a folder and optionally filter the selected files with a regular expression.
Parameter Description
1 $dir Folder to start the search with
2 $filter Optional regular expression to filter files
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
is_deeply [sort map {fne $_} findFiles($d, qr(txt\Z))], [qw(a.txt b.txt c.txt)];
findDirs($$)
Find all the folders under a folder and optionally filter the selected folders with a regular expression.
Parameter Description
1 $dir Folder to start the search with
2 $filter Optional regular expression to filter files
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
is_deeply [findDirs($D)], [$D, $d];
fileList($)
Files that match a given search pattern handed to bsd_glob.
Parameter Description
1 $pattern Search pattern
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
is_deeply [sort map {fne $_} fileList("$d/*.txt")],
["a.txt", "b.txt", "c.txt"];
searchDirectoryTreesForMatchingFiles(@)
Search the specified directory trees for the files (not folders) that match the specified extensions. The argument list should include at least one path name to be useful. If no file extension is supplied then all the files below the specified paths are returned.
Parameter Description
1 @foldersandExtensions Mixture of folder names and extensions
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
is_deeply [sort map {fne $_} searchDirectoryTreesForMatchingFiles($d)],
["a.txt", "b.txt", "c.txt"];
matchPath($)
Given an absolute path find out how much of the path actually exists.
Parameter Description
1 $file File name
Example:
my $d = filePath (my @d = qw(a b c d));
ok matchPath($d) eq $d;
findFileWithExtension($@)
Find the first extension from the specified extensions that produces a file that exists when appended to the specified file.
Parameter Description
1 $file File name minus extensions
2 @ext Possible extensions
Example:
my $f = createEmptyFile(fpe(my $d = temporaryFolder, qw(a jpg)));
my $F = findFileWithExtension(fpf($d, q(a)), qw(txt data jpg));
ok $F eq "jpg";
clearFolder($$)
Remove all the files and folders under and including the specified folder as long as the number of files to be removed is less than the specified limit.
Parameter Description
1 $folder Folder
2 $limitCount Maximum number of files to remove to limit damage
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
clearFolder($D, 5);
ok !-e $_ for @f;
ok !-d $D;
Read and write files
Read and write strings from and to files creating paths as needed.
readFile($)
Read a file containing unicode in utf8.
Parameter Description
1 $file Name of file to read
Example:
my $f = writeFile(undef, "aaa");
my $s = readFile($f);
ok $s eq "aaa";
appendFile($f, "bbb");
my $S = readFile($f);
ok $S eq "aaabbb";
evalFile($)
Read a file containing unicode in utf8, evaluate it, confess to any errors and then return any result - an improvement on do which silently ignores any problems.
Parameter Description
1 $file File to read
Example:
my $f = dumpFile(undef, [qw(aaa bbb ccc)]);
my $s = evalFile($f);
is_deeply $s, [qw(aaa bbb ccc)];
evalGZipFile($)
Read a file containing compressed utf8, evaluate it, confess to any errors or return any result.
Parameter Description
1 $file File to read
Example:
if (1) {
my $d = [1, 2, 3=>{a=>4, b=>5}];
my $file = dumpGZipFile(q(zzz.zip), $d);
ok -e $file;
my $D = evalGZipFile($file);
is_deeply $d, $D;
unlink $file;
}
readBinaryFile($)
Read binary file - a file whose contents are not to be interpreted as unicode.
Parameter Description
1 $file File to read
Example:
my $f = writeBinaryFile(undef, 0xff x 8);
my $s = readBinaryFile($f);
ok $s eq 0xff x 8;
readGZipFile($)
Read the specified $file, containing compressed utf8, through gzip
Parameter Description
1 $file File to read.
Example:
if (1) {
my $s = '𝝰'x1e3;
my $file = writeGZipFile(q(zzz.zip), $s);
ok -e $file;
my $S = readGZipFile($file);
ok $s eq $S;
ok length($s) == length($S);
unlink $file;
}
makePath($)
Make the path for the specified file name or folder.
Parameter Description
1 $file File
Example:
my $d = fpd(my $D = temporaryDirectory, qw(a));
my $f = fpe($d, qw(bbb txt));
ok !-d $d;
makePath($f);
ok -d $d;
overWriteFile($$)
Write a unicode utf8 string to a file after creating a path to the file if necessary and return the name of the file on success else confess. If the file already exists it is overwritten.
Parameter Description
1 $file File to write to or B<undef> for a temporary file
2 $string Unicode string to write
Example:
my $f = dumpFile(undef, [qw(aaa bbb ccc)]);
ok overWriteFile($f, q({qw(aaa bbb ccc)]));
owf is a synonym for overWriteFile.
writeFile($$)
Write a unicode utf8 string to a new file that does not already exist after creating a path to the file if necessary and return the name of the file on success else confess if a problem occurred or the file does already exist.
Parameter Description
1 $file New file to write to or B<undef> for a temporary file
2 $string String to write
Example:
my $f = writeFile(undef, "aaa");
my $s = readFile($f);
ok $s eq "aaa";
appendFile($f, "bbb");
my $S = readFile($f);
ok $S eq "aaabbb";
dumpFile($$)
Dump a data structure to a file
Parameter Description
1 $file File to write to or B<undef> for a temporary file
2 $struct Address of data structure to write
Example:
my $f = dumpFile(undef, [qw(aaa bbb ccc)]);
my $s = evalFile($f);
is_deeply $s, [qw(aaa bbb ccc)];
writeGZipFile($$)
Write a unicode utf8 string through gzip to a file.
Parameter Description
1 $file File to write to
2 $string String to write
Example:
if (1) {
my $s = '𝝰'x1e3;
my $file = writeGZipFile(q(zzz.zip), $s);
ok -e $file;
my $S = readGZipFile($file);
ok $s eq $S;
ok length($s) == length($S);
unlink $file;
}
dumpGZipFile($$)
Write a data structure through gzip to a file.
Parameter Description
1 $file File to write
2 $data Reference to data
Example:
if (1) {
my $d = [1, 2, 3=>{a=>4, b=>5}];
my $file = dumpGZipFile(q(zzz.zip), $d);
ok -e $file;
my $D = evalGZipFile($file);
is_deeply $d, $D;
unlink $file;
}
writeFiles($$)
Write the values of a hash into files identified by the key of each value using overWriteFile
Parameter Description
1 $hash Hash of key value pairs representing files and data
2 $folder Optional folder to contain files else the current folder
Example:
my $h =
{"aaa/1.txt"=>"1111",
"aaa/2.txt"=>"2222",
};
writeFiles($h);
for(sort keys %$h)
{ok -e $_;
ok readFile($_) eq $h->{$_};
}
appendFile($$)
Append a unicode utf8 string to a file, possibly creating the file and the path to the file if necessary and return the name of the file on success else confess.
Parameter Description
1 $file File to append to
2 $string String to append
Example:
my $f = writeFile(undef, "aaa");
my $s = readFile($f);
ok $s eq "aaa";
appendFile($f, "bbb");
my $S = readFile($f);
ok $S eq "aaabbb";
writeBinaryFile($$)
Write a non unicode string to a file in after creating a path to the file if necessary and return the name of the file on success else confess.
Parameter Description
1 $file File to write to or B<undef> for a temporary file
2 $string Non unicode string to write
Example:
my $f = writeBinaryFile(undef, 0xff x 8);
my $s = readBinaryFile($f);
ok $s eq 0xff x 8;
createEmptyFile($)
Create an empty file - writeFile complains if no data is written to the file - and return the name of the file on success else confess.
Parameter Description
1 $file File to create or B<undef> for a temporary file
Example:
my $D = temporaryFolder;
my $d = fpd($D, q(ddd));
my @f = map {createEmptyFile(fpe($d, $_, qw(txt)))} qw(a b c);
is_deeply [sort map {fne $_} findFiles($d, qr(txt\Z))], [qw(a.txt b.txt c.txt)];
numberOfLinesInFile($)
The number of lines in a file
Parameter Description
1 $file File
Example:
my $f = writeFile(undef, "a
b
");
ok numberOfLinesInFile($f) == 2;
Images
Image operations.
imageSize($)
Return (width, height) of an image obtained via Imagemagick.
Parameter Description
1 $image File containing image
Example:
my ($width, $height) = imageSize(fpe(qw(a image jpg)));
convertImageToJpx($$$)
Convert an image to jpx format using Imagemagick.
Parameter Description
1 $source Source file
2 $target Target folder (as multiple files will be created)
3 $Size Optional size of each tile - defaults to 256
Example:
convertImageToJpx(fpe(qw(a image jpg)), fpe(qw(a image jpg)), 256);
convertDocxToFodt($$)
Convert a docx file to fodt using unoconv which must not be running elsewhere at the time. Unoconv can be installed via:
sudo apt install sharutils unoconv
Parameters:
Parameter Description
1 $inputFile Input file
2 $outputFile Output file
Example:
convertDocxToFodt(fpe(qw(a docx)), fpe(qw(a fodt)));
cutOutImagesInFodtFile($$$)
Cut out the images embedded in a fodt file, perhaps produced via convertDocxToFodt, placing them in the specified folder and replacing them in the source file with:
<image href="$imageFile" outputclass="imageType">
This conversion requires that you have both Imagemagick and unoconv installed on your system:
sudo apt install sharutils imagemagick unoconv
Parameters:
Parameter Description
1 $inputFile Input file
2 $outputFolder Output folder for images
3 $imagePrefix A prefix to be added to image file names
Example:
cutOutImagesInFodtFile(fpe(qw(source fodt)), fpd(qw(images)), q(image));
Encoding and Decoding
Encode and decode using Json and Mime.
encodeJson($)
Encode Perl to Json.
Parameter Description
1 $string Data to encode
Example:
my $A = encodeJson(my $a = {a=>1,b=>2, c=>[1..2]});
my $b = decodeJson($A);
is_deeply $a, $b;
decodeJson($)
Decode Perl from Json.
Parameter Description
1 $string Data to decode
Example:
my $A = encodeJson(my $a = {a=>1,b=>2, c=>[1..2]});
my $b = decodeJson($A);
is_deeply $a, $b;
encodeBase64($)
Encode a string in base 64.
Parameter Description
1 $string String to encode
Example:
my $A = encodeBase64(my $a = "Hello World" x 10);
my $b = decodeBase64($A);
ok $a eq $b;
decodeBase64($)
Decode a string in base 64.
Parameter Description
1 $string String to decode
Example:
my $A = encodeBase64(my $a = "Hello World" x 10);
my $b = decodeBase64($A);
ok $a eq $b;
convertUnicodeToXml($)
Convert a string with unicode points that are not directly representable in ascii into string that replaces these points with their representation on Xml making the string usable in Xml documents.
Parameter Description
1 $s String to convert
Example:
ok convertUnicodeToXml('setenta e três') eq q(setenta e três);
Numbers
Numeric operations,
powerOfTwo($)
Test whether a number is a power of two, return the power if it is else undef.
Parameter Description
1 $n Number to check
Example:
ok powerOfTwo(1) == 0;
ok powerOfTwo(2) == 1;
ok !powerOfTwo(3);
ok powerOfTwo(4) == 2;
containingPowerOfTwo($)
Find log two of the lowest power of two greater than or equal to a number.
Parameter Description
1 $n Number to check
Example:
ok containingPowerOfTwo(1) == 0;
ok containingPowerOfTwo(2) == 1;
ok containingPowerOfTwo(3) == 2;
ok containingPowerOfTwo(4) == 2;
Sets
Set operations.
setIntersectionOfTwoArraysOfWords($$)
Intersection of two arrays of words.
Parameter Description
1 $a Reference to first array of words
2 $b Reference to second array of words
Example:
is_deeply [qw(a b c)],
[setIntersectionOfTwoArraysOfWords([qw(e f g a b c )], [qw(a A b B c C)])];
setUnionOfTwoArraysOfWords($$)
Union of two arrays of words.
Parameter Description
1 $a Reference to first array of words
2 $b Reference to second array of words
Example:
is_deeply [qw(a b c)],
[setUnionOfTwoArraysOfWords([qw(a b c )], [qw(a b)])];
contains($@)
Returns the indices at which an item matches elements of the specified array. If the item is a regular expression then it is matched as one, else it is a number it is matched as a number, else as a string.
Parameter Description
1 $item Item
2 @array Array
Example:
is_deeply [1], [contains(1,0..1)];
is_deeply [1,3], [contains(1, qw(0 1 0 1 0 0))];
is_deeply [0, 5], [contains('a', qw(a b c d e a b c d e))];
is_deeply [0, 1, 5], [contains(qr(a+), qw(a baa c d e aa b c d e))];
Minima and Maxima
Find the smallest and largest elements of arrays.
min(@)
Find the minimum number in a list.
Parameter Description
1 @n Numbers
Example:
ok min(1) == 1;
ok min(5,4,2,3) == 2;
max(@)
Find the maximum number in a list.
Parameter Description
1 @n Numbers
Example:
ok !max;
ok max(1) == 1;
ok max(1,4,2,3) == 4;
Format
Format data structures as tables.
maximumLineLength($)
Find the longest line in a string
Parameter Description
1 $string String of lines of text
Example:
ok 3 == maximumLineLength(<<END);
a
bb
ccc
END
formatTableBasic($)
Tabularize an array of arrays of text.
Parameter Description
1 $data Reference to an array of arrays of data to be formatted as a table.
Example:
my $d = [[qw(a 1)], [qw(bb 22)], [qw(ccc 333)], [qw(dddd 4444)]];
ok formatTableBasic($d) eq <<END;
a 1
bb 22
ccc 333
dddd 4444
END
formatTable($$%)
Format various data structures as a table. Optionally create a report from the table using the following optional report options:
file=>$file the name of a file to write the report to.
head=>$head a header line in which DDDD will be replaced with the data and time and NNNN will be replaced with the number of rows in the table.
zero=>$zero if true the report will be written to the specified file even if empty.
Parameters:
Parameter Description
1 $data Data to be formatted
2 $title Optional reference to an array of titles
3 %options Options
Example:
ok formatTable
([[qw(A B C D )],
[qw(AA BB CC DD )],
[qw(AAA BBB CCC DDD )],
[qw(AAAA BBBB CCCC DDDD)],
[qw(1 22 333 4444)]], [qw(aa bb cc)]) eq <<END;
aa bb cc
1 A B C D
2 AA BB CC DD
3 AAA BBB CCC DDD
4 AAAA BBBB CCCC DDDD
5 1 22 333 4444
END
ok formatTable
([[qw(1 B C)],
[qw(22 BB CC)],
[qw(333 BBB CCC)],
[qw(4444 22 333)]], [qw(aa bb cc)]) eq <<END;
aa bb cc
1 1 B C
2 22 BB CC
3 333 BBB CCC
4 4444 22 333
END
ok formatTable
([{aa=>'A', bb=>'B', cc=>'C'},
{aa=>'AA', bb=>'BB', cc=>'CC'},
{aa=>'AAA', bb=>'BBB', cc=>'CCC'},
{aa=>'1', bb=>'22', cc=>'333'}
]) eq <<END;
aa bb cc
1 A B C
2 AA BB CC
3 AAA BBB CCC
4 1 22 333
END
ok formatTable
({''=>[qw(aa bb cc)],
1=>[qw(A B C)],
22=>[qw(AA BB CC)],
333=>[qw(AAA BBB CCC)],
4444=>[qw(1 22 333)]}) eq <<END;
aa bb cc
1 A B C
22 AA BB CC
333 AAA BBB CCC
4444 1 22 333
END
ok formatTable
({1=>{aa=>'A', bb=>'B', cc=>'C'},
22=>{aa=>'AA', bb=>'BB', cc=>'CC'},
333=>{aa=>'AAA', bb=>'BBB', cc=>'CCC'},
4444=>{aa=>'1', bb=>'22', cc=>'333'}}) eq <<END;
aa bb cc
1 A B C
22 AA BB CC
333 AAA BBB CCC
4444 1 22 333
END
ok formatTable({aa=>'A', bb=>'B', cc=>'C'}, [qw(aaaa bbbb)]) eq <<END;
aaaa bbbb
aa A
bb B
cc C
END
if (1) {
my $file = fpe(qw(report txt)); # Create a report
my $t = formatTable
([["a",undef], [undef, "b0ac"]], # Data - please replace 0a with a new line
[undef, "BC"], # Column titles
file=>$file, # Output file
head=><<END); # Header
Sample report.
Table has NNNN rows.
END
ok -e $file;
ok readFile($file) eq $t;
unlink $file;
ok $t eq <<END;
Sample report.
Table has 2 rows.
This file: report.txt
BC
1 a
2 b
c
END
}
keyCount($$)
Count keys down to the specified level.
Parameter Description
1 $maxDepth Maximum depth to count to
2 $ref Reference to an array or a hash
Example:
my $a = [[1..3], {map{$_=>1} 1..3}];
my $h = {a=>[1..3], b=>{map{$_=>1} 1..3}};
ok keyCount(2, $a) == 6;
ok keyCount(2, $h) == 6;
Lines
Load data structures from lines.
loadArrayFromLines($)
Load an array from lines of text in a string.
Parameter Description
1 $string The string of lines from which to create an array
Example:
my $s = loadArrayFromLines <<END;
a a
b b
END
is_deeply $s, [q(a a), q(b b)];
ok formatTable($s) eq <<END;
0 a a
1 b b
END
loadHashFromLines($)
Load a hash: first word of each line is the key and the rest is the value.
Parameter Description
1 $string The string of lines from which to create a hash
Example:
my $s = loadHashFromLines <<END;
a 10 11 12
b 20 21 22
END
is_deeply $s, {a => q(10 11 12), b =>q(20 21 22)};
ok formatTable($s) eq <<END;
a 10 11 12
b 20 21 22
END
loadArrayArrayFromLines($)
Load an array of arrays from lines of text: each line is an array of words.
Parameter Description
1 $string The string of lines from which to create an array of arrays
Example:
my $s = loadArrayArrayFromLines <<END;
A B C
AA BB CC
END
is_deeply $s, [[qw(A B C)], [qw(AA BB CC)]];
ok formatTable($s) eq <<END;
1 A B C
2 AA BB CC
END
loadHashArrayFromLines($)
Load a hash of arrays from lines of text: the first word of each line is the key, the remaining words are the array contents.
Parameter Description
1 $string The string of lines from which to create a hash of arrays
Example:
my $s = loadHashArrayFromLines <<END;
a A B C
b AA BB CC
END
is_deeply $s, {a =>[qw(A B C)], b => [qw(AA BB CC)] };
ok formatTable($s) eq <<END;
a A B C
b AA BB CC
END
loadArrayHashFromLines($)
Load an array of hashes from lines of text: each line is an hash of words.
Parameter Description
1 $string The string of lines from which to create an array of arrays
Example:
my $s = loadArrayHashFromLines <<END;
A 1 B 2
AA 11 BB 22
END
is_deeply $s, [{A=>1, B=>2}, {AA=>11, BB=>22}];
ok formatTable($s) eq <<END;
A AA B BB
1 1 2
2 11 22
END
loadHashHashFromLines($)
Load a hash of hashes from lines of text: the first word of each line is the key, the remaining words are the sub hash contents.
Parameter Description
1 $string The string of lines from which to create a hash of arrays
Example:
my $s = loadHashHashFromLines <<END;
a A 1 B 2
b AA 11 BB 22
END
is_deeply $s, {a=>{A=>1, B=>2}, b=>{AA=>11, BB=>22}};
ok formatTable($s) eq <<END;
A AA B BB
a 1 2
b 11 22
END
checkKeys($$)
Check the keys in a hash.
Parameter Description
1 $test The hash to test
2 $permitted A hash of the permitted keys and their meanings
Example:
eval q{checkKeys({a=>1, b=>2, d=>3}, {a=>1, b=>2, c=>3})};
ok nws($@) =~ m(\AInvalid options chosen: d Permitted.+?: a 1 b 2 c 3);
LVALUE methods
Replace $a->{value} = $b with $a->value = $b which reduces the amount of typing required, is easier to read and provides a hard check that {value} is spelled correctly.
genLValueScalarMethods(@)
Generate lvalue scalar methods in the current package, A method whose value has not yet been set will return a new scalar with value undef. Suffixing X to the scalar name will confess if a value has not been set.
Parameter Description
1 @names List of method names
Example:
package Scalars;
my $a = bless{};
Data::Table::Text::genLValueScalarMethods(qw(aa bb cc));
$a->aa = 'aa';
Test::More::ok $a->aa eq 'aa';
Test::More::ok !$a->bb;
Test::More::ok $a->bbX eq q();
$a->aa = undef;
Test::More::ok !$a->aa;
addLValueScalarMethods(@)
Generate lvalue scalar methods in the current package if they do not already exist. A method whose value has not yet been set will return a new scalar with value undef. Suffixing X to the scalar name will confess if a value has not been set.
Parameter Description
1 @names List of method names
Example:
my $class = "Data::Table::Text::Test";
my $a = bless{}, $class;
addLValueScalarMethods(qq(${class}::$_)) for qw(aa bb aa bb);
$a->aa = 'aa';
ok $a->aa eq 'aa';
ok !$a->bb;
ok $a->bbX eq q();
$a->aa = undef;
ok !$a->aa;
genLValueScalarMethodsWithDefaultValues(@)
Generate lvalue scalar methods with default values in the current package. A reference to a method whose value has not yet been set will return a scalar whose value is the name of the method.
Parameter Description
1 @names List of method names
Example:
package ScalarsWithDefaults;
my $a = bless{};
Data::Table::Text::genLValueScalarMethodsWithDefaultValues(qw(aa bb cc));
Test::More::ok $a->aa eq 'aa';
genLValueArrayMethods(@)
Generate lvalue array methods in the current package. A reference to a method that has no yet been set will return a reference to an empty array.
Parameter Description
1 @names List of method names
Example:
package Arrays;
my $a = bless{};
Data::Table::Text::genLValueArrayMethods(qw(aa bb cc));
$a->aa->[1] = 'aa';
Test::More::ok $a->aa->[1] eq 'aa';
genLValueHashMethods(@)
Generate lvalue hash methods in the current package. A reference to a method that has no yet been set will return a reference to an empty hash.
Parameter Description
1 @names Method names
Example:
package Hashes;
my $a = bless{};
Data::Table::Text::genLValueHashMethods(qw(aa bb cc));
$a->aa->{a} = 'aa';
Test::More::ok $a->aa->{a} eq 'aa';
genHash($%)
Return a $blessed hash with the specified $attributes. updateDocumentation will generate documentation at "Hash Definitions" for the hash defined by the call to genHash if the call is laid out as in the example below.
Parameter Description
1 $bless Package name
2 %attributes Hash of attribute names and values
Example:
if (1) {
my $o = genHash(q(TestHash), # Definition of a blessed hash.
a=>q(aa), # Definition of attribute aa.
b=>q(bb), # Definition of attribute bb.
);
ok $o->a eq q(aa);
is_deeply $o, {a=>"aa", b=>"bb"};
my $p = genHash(q(TestHash),
c=>q(cc), # Definition of attribute cc.
);
ok $p->c eq q(cc);
ok $p->a = q(aa);
ok $p->a eq q(aa);
is_deeply $p, {a=>"aa", c=>"cc"};
loadHash($p, a=>11, b=>22); # Load the hash
is_deeply $p, {a=>11, b=>22, c=>"cc"};
my $r = eval {loadHash($p, d=>44)}; # Try to load the hash
ok $@ =~ m(Cannot load attribute: d);
}
loadHash($%)
Load the specified $hash generated with genHash with %attributes. Confess to any unknown attribute names.
Parameter Description
1 $hash Hash
2 %attributes Hash of attribute names and values to be loaded
Example:
if (1) {
my $o = genHash(q(TestHash), # Definition of a blessed hash.
a=>q(aa), # Definition of attribute aa.
b=>q(bb), # Definition of attribute bb.
);
ok $o->a eq q(aa);
is_deeply $o, {a=>"aa", b=>"bb"};
my $p = genHash(q(TestHash),
c=>q(cc), # Definition of attribute cc.
);
ok $p->c eq q(cc);
ok $p->a = q(aa);
ok $p->a eq q(aa);
is_deeply $p, {a=>"aa", c=>"cc"};
loadHash($p, a=>11, b=>22); # Load the hash
is_deeply $p, {a=>11, b=>22, c=>"cc"};
my $r = eval {loadHash($p, d=>44)}; # Try to load the hash
ok $@ =~ m(Cannot load attribute: d);
}
assertPackageRefs($@)
Confirm that the specified references are to the specified package
Parameter Description
1 $package Package
2 @refs References
Example:
if (1) {
eval q{assertPackageRefs(q(bbb), bless {}, q(aaa))};
ok $@ =~ m(\AWanted reference to bbb, but got aaa);
}
assertRef(@)
Confirm that the specified references are to the package into which this routine has been exported.
Parameter Description
1 @refs References
Example:
if (1) {
eval q{assertRef(bless {}, q(aaa))};
ok $@ =~ m(\AWanted reference to Data::Table::Text, but got aaa);
}
ˢ(&)
Immediately executed inline sub to allow a code block before if.
Parameter Description
1 $sub Sub enclosed in {} without the word "sub"
Example:
ok ˢ{1} == 1;
ok ˢ{1};
ˢ{my $s =
ˢ{if (1)
{return q(aa) if 1;
q(bb);
}
};
ok $s eq q(aa);
};
Strings
Actions on strings.
indentString($$)
Indent lines contained in a string or formatted table by the specified string.
Parameter Description
1 $string The string of lines to indent
2 $indent The indenting string
Example:
my $t = [qw(aa bb cc)];
my $d = [[qw(A B C)], [qw(AA BB CC)], [qw(AAA BBB CCC)], [qw(1 22 333)]];
ok $s eq <<END;
1 A B C
2 AA BB CC
3 AAA BBB CCC
4 1 22 333
END
isBlank($)
Test whether a string is blank.
Parameter Description
1 $string String
Example:
ok isBlank("");
ok isBlank("
");
trim($)
Remove any white space from the front and end of a string.
Parameter Description
1 $string String
Example:
ok trim(" a b ") eq join ' ', qw(a b);
pad($$$)
Pad a string with blanks or the specified padding character to a multiple of a specified length.
Parameter Description
1 $string String
2 $length Tab width
3 $pad Padding char
Example:
ok pad('abc ', 2).'=' eq "abc =";
ok pad('abc ', 3).'=' eq "abc=";
ok pad('abc ', 4, q(.)).'=' eq "abc.=";
firstNChars($$)
First N characters of a string.
Parameter Description
1 $string String
2 $length Length
Example:
ok firstNChars(q(abc), 2) eq q(ab);
ok firstNChars(q(abc), 4) eq q(abc);
nws($$)
Normalize white space in a string to make comparisons easier. Leading and trailing white space is removed; blocks of white space in the interior are reduced to a single space. In effect: this puts everything on one long line with never more than one space at a time. Optionally a maximum length is applied to the normalized string.
Parameter Description
1 $string String to normalize
2 $length Maximum length of result
Example:
ok nws(qq(a b c)) eq q(a b c);
stringsAreNotEqual($$)
Return the two non equal tails of non equal strings or an empty list if the strings are equal.
Parameter Description
1 $a First string
2 $b Second string
Example:
if (1) {
ok !stringsAreNotEqual(q(abc), q(abc));
ok stringsAreNotEqual(q(abc), q(abd));
is_deeply [stringsAreNotEqual(q(abc), q(abd))], [qw(c d)];
is_deeply [stringsAreNotEqual(q(ab), q(abd))], ['', q(d)];
}
javaPackage($)
Extract the package name from a java string or file.
Parameter Description
1 $java Java file if it exists else the string of java
Example:
overWriteFile($f, <<END);
// Test
package com.xyz;
END
ok javaPackage($f) eq "com.xyz";
javaPackageAsFileName($)
Extract the package name from a java string or file and convert it to a file name.
Parameter Description
1 $java Java file if it exists else the string of java
Example:
overWriteFile($f, <<END);
// Test
package com.xyz;
END
ok javaPackageAsFileName($f) eq "com/xyz";
perlPackage($)
Extract the package name from a perl string or file.
Parameter Description
1 $perl Perl file if it exists else the string of perl
Example:
overWriteFile($f, <<END);
package a::b;
END
ok perlPackage($f) eq "a::b";
printQw(@)
Print an array of words in qw() format.
Parameter Description
1 @words Array of words
Example:
ok printQw(qw(a b c)) eq q(qw(a b c));
numberOfLinesInString($)
The number of lines in a string.
Parameter Description
1 $string String
Example:
ok numberOfLinesInString("a
b
") == 2;
Unicode
Translate ascii alphanumerics in strings to various Unicode blocks.
boldString($)
Convert alphanumerics in a string to bold.
Parameter Description
1 $string String to convert
Example:
ok boldString(q(zZ)) eq q(𝘇𝗭);
boldStringUndo($)
Undo alphanumerics in a string to bold.
Parameter Description
1 $string String to convert
Example:
if (1)
{my $n = 1234567890;
ok boldStringUndo (boldString($n)) == $n;
ok enclosedStringUndo (enclosedString($n)) == $n;
ok enclosedReversedStringUndo(enclosedReversedString($n)) == $n;
ok superScriptStringUndo (superScriptString($n)) == $n;
ok subScriptStringUndo (subScriptString($n)) == $n;
}
enclosedString($)
Convert alphanumerics in a string to enclosed alphanumerics.
Parameter Description
1 $string String to convert
Example:
ok enclosedString(q(hello world 1234)) eq q(ⓗⓔⓛⓛⓞ ⓦⓞⓡⓛⓓ ①②③④);
enclosedStringUndo($)
Undo alphanumerics in a string to enclosed alphanumerics.
Parameter Description
1 $string String to convert
Example:
if (1)
{my $n = 1234567890;
ok boldStringUndo (boldString($n)) == $n;
ok enclosedStringUndo (enclosedString($n)) == $n;
ok enclosedReversedStringUndo(enclosedReversedString($n)) == $n;
ok superScriptStringUndo (superScriptString($n)) == $n;
ok subScriptStringUndo (subScriptString($n)) == $n;
}
enclosedReversedString($)
Convert alphanumerics in a string to enclosed reversed alphanumerics.
Parameter Description
1 $string String to convert
Example:
ok enclosedReversedString(q(hello world 1234)) eq q(🅗🅔🅛🅛🅞 🅦🅞🅡🅛🅓 ➊➋➌➍);
enclosedReversedStringUndo($)
Undo alphanumerics in a string to enclosed reversed alphanumerics.
Parameter Description
1 $string String to convert
Example:
if (1)
{my $n = 1234567890;
ok boldStringUndo (boldString($n)) == $n;
ok enclosedStringUndo (enclosedString($n)) == $n;
ok enclosedReversedStringUndo(enclosedReversedString($n)) == $n;
ok superScriptStringUndo (superScriptString($n)) == $n;
ok subScriptStringUndo (subScriptString($n)) == $n;
}
superScriptString($)
Convert alphanumerics in a string to super scripts
Parameter Description
1 $string String to convert
Example:
ok superScriptString(1234567890) eq q(¹²³⁴⁵⁶⁷⁸⁹⁰);
superScriptStringUndo($)
Undo alphanumerics in a string to super scripts
Parameter Description
1 $string String to convert
Example:
if (1)
{my $n = 1234567890;
ok boldStringUndo (boldString($n)) == $n;
ok enclosedStringUndo (enclosedString($n)) == $n;
ok enclosedReversedStringUndo(enclosedReversedString($n)) == $n;
ok superScriptStringUndo (superScriptString($n)) == $n;
ok subScriptStringUndo (subScriptString($n)) == $n;
}
subScriptString($)
Convert alphanumerics in a string to sub scripts
Parameter Description
1 $string String to convert
Example:
ok subScriptString(1234567890) eq q(₁₂₃₄₅₆₇₈₉₀);
subScriptStringUndo($)
Undo alphanumerics in a string to sub scripts
Parameter Description
1 $string String to convert
Example:
if (1)
{my $n = 1234567890;
ok boldStringUndo (boldString($n)) == $n;
ok enclosedStringUndo (enclosedString($n)) == $n;
ok enclosedReversedStringUndo(enclosedReversedString($n)) == $n;
ok superScriptStringUndo (superScriptString($n)) == $n;
ok subScriptStringUndo (subScriptString($n)) == $n;
}
Cloud Cover
Useful for operating across the cloud.
makeDieConfess()
Force die to confess where the death occurred
Example:
makeDieConfess
ipAddressViaArp($)
Get the ip address of a server on the local network by hostname via arp
Parameter Description
1 $hostName Host name
Example:
ipAddressViaArp(q(secarias));
saveCodeToS3($$$$)
Save source code files.
Parameter Description
1 $saveCodeEvery Save every seconds
2 $zipFileName Zip file name
3 $bucket Bucket/key
4 $S3Parms Additional S3 parameters like profile or region as a string
Example:
saveCodeToS3(1200, q(projectName), q(bucket/folder), q(--only-show-errors));
addCertificate($)
Add a certificate to the current ssh session.
Parameter Description
1 $file File containing certificate
Example:
addCertificate(fpf(qw(.ssh cert)));
hostName()
The name of the host we are running on.
Example:
hostName;
userId()
The userid we are currently running under.
Example:
userId;
wwwEncode($)
Replace spaces in a string with %20 .
Parameter Description
1 $string String
Example:
ok wwwEncode(q(a b c)) eq q(a%20%20b%20c);
startProcess(&\%$)
Start new processes while the number of child processes recorded in %$pids is less than the specified $maximum. Use waitForAllStartedProcessesToFinish to wait for all these processes to finish.
Parameter Description
1 $sub Sub to start
2 $pids Hash in which to record the process ids
3 $maximum Maximum number of processes to run at a time
Example:
if (0) {
my %pids;
ˢ{startProcess {} %pids, 1; ok 1 >= keys %pids} for 1..8;
waitForAllStartedProcessesToFinish(%pids);
ok !keys(%pids)
}
waitForAllStartedProcessesToFinish(\%)
Wait until all the processes started by startProcess have finished.
Parameter Description
1 $pids Hash of started process ids
Example:
if (0) {
my %pids;
ˢ{startProcess {} %pids, 1; ok 1 >= keys %pids} for 1..8;
waitForAllStartedProcessesToFinish(%pids);
ok !keys(%pids)
}
newServiceIncarnation($$)
Create a new service incarnation to record the start up of a new instance of a service and return the description as a Data::Exchange::Service Definition hash.
Parameter Description
1 $service Service name
2 $file Optional details file
Example:
if (1)
{my $s = newServiceIncarnation("aaa", q(bbb.txt));
is_deeply $s->check, $s;
my $t = newServiceIncarnation("aaa", q(bbb.txt));
is_deeply $t->check, $t;
ok $t->start >= $s->start+1;
ok !$s->check(1);
unlink q(bbb.txt);
}
Data::Exchange::Service::check($$)
Check that we are the current incarnation of the named service with details obtained from newServiceIncarnation. If the optional $continue flag has been set then return the service details if this is the current service incarnation else undef. Otherwise if the $continue flag is false confess unless this is the current service incarnation thus bringing the earlier version of this service to an abrupt end.
Parameter Description
1 $s Current service details
2 $continue Return result if B<$continue> is true else confess if the service has been replaced
Example:
if (1)
{my $s = newServiceIncarnation("aaa", q(bbb.txt));
is_deeply $s->check, $s;
my $t = newServiceIncarnation("aaa", q(bbb.txt));
is_deeply $t->check, $t;
ok $t->start >= $s->start+1;
ok !$s->check(1);
unlink q(bbb.txt);
}
Documentation
Extract, format and update documentation for a perl module.
htmlToc($@)
Generate a table of contents for some html.
Parameter Description
1 $replace Sub-string within the html to be replaced with the toc
2 $html String of html
Example:
ok nws(htmlToc("XXXX", <<END)), 'htmlToc'
<h1 id="1" otherprops="1">Chapter 1</h1>
<h2 id="11" otherprops="11">Section 1</h1>
<h1 id="2" otherprops="2">Chapter 2</h1>
XXXX
END
eq nws(<<END);
<h1 id="1" otherprops="1">Chapter 1</h1>
<h2 id="11" otherprops="11">Section 1</h1>
<h1 id="2" otherprops="2">Chapter 2</h1>
<table cellspacing=10 border=0>
<tr><td>
<tr><td align=right>1<td> <a href="#1">Chapter 1</a>
<tr><td align=right>2<td> <a href="#11">Section 1</a>
<tr><td>
<tr><td align=right>3<td> <a href="#2">Chapter 2</a>
</table>
END
updateDocumentation($)
Update documentation from the comments in a perl script. Comments between the lines marked with:
#Dn title # description
and:
#D
where n is either 1, 2 or 3 indicating the heading level of the section and the # is in column 1.
Methods are formatted as:
sub name(signature) #FLAGS comment describing method
{my ($parameters) = @_; # comments for each parameter separated by commas.
FLAGS can be chosen from:
- I
-
method of interest to new users
- P
-
private method
- r
-
optionally replaceable method
- R
-
required replaceable method
- S
-
static method
- X
-
die rather than received a returned undef result
Other flags will be handed to the method extractDocumentationFlags(flags to process, method name) found in the file being documented, this method should return [the additional documentation for the method, the code to implement the flag].
Text following 'Example:' in the comment (if present) will be placed after the parameters list as an example. Lines containing comments consisting of '#T'.methodName will also be aggregated and displayed as examples for that method.
Lines formatted as:
BEGIN{*source=*target}
starting in column 1 will define a synonym for a method.
Lines formatted as:
#C emailAddress text
will be aggregated in the acknowledgments section at the end of the documentation.
The character sequence \n in the comment will be expanded to one new line, \m to two new lines and L<$_>,L<confess>,L<die>,L<eval>,L<lvalueMethod> to links to the perl documentation.
Search for '#D1': in https://metacpan.org/source/PRBRENAN/Data-Table-Text-20180810/lib/Data/Table/Text.pm to see more examples of such documentation in action - although it is quite difficult to see as it looks just like normal comments placed in the code.
Parameters:
Parameter Description
1 $perlModule Optional file name with caller's file being the default
Example:
{my $s = updateDocumentation(<<'END' =~ s(#) (#)gsr =~ s(~) ()gsr);
package Sample::Module;
#D1 Samples # Sample methods.
sub sample($@) #R Documentation for the: sample() method. See also L<Data::Table::Text::sample2|/Data::Table::Text::sample2>. #Tsample
{my ($node, @context) = @_; # Node, optional context
1
}
~BEGIN{*smpl=*sample}
sub Data::Table::Text::sample2(\&@) #PS Documentation for the sample2() method.
{my ($sub, @context) = @_; # Sub to call, context.
1
}
ok sample(undef, qw(a b c)) == 1; #Tsample
if (1) #Tsample
{ok sample(q(a), qw(a b c)) == 2;
ok sample(undef, qw(a b c)) == 1;
}
ok sample(<<END2)) == 1; #Tsample
sample data
END2
ok $s =~ m'=head2 sample28\$\@29';
Hash Definitions
Data::Exchange::Service Definition
Service details.
file - The file in which the service start details is being recorded.
service - The name of the service.
start - The time this service was started time plus a minor hack to simplify testing.
TestHash Definition
Definition of a blessed hash.
a - Definition of attribute aa.
b - Definition of attribute bb.
Private Methods
denormalizeFolderName($)
Remove any trailing folder separator from a folder name component.
Parameter Description
1 $name Name
renormalizeFolderName($)
Normalize a folder name component by adding a trailing separator.
Parameter Description
1 $name Name
trackFiles($@)
Track the existence of files.
Parameter Description
1 $label Label
2 @files Files
printFullFileName()
Print a file name on a separate line with escaping so it can be used easily from the command line.
readUtf16File($)
Read a file containing unicode in utf-16 format.
Parameter Description
1 $file Name of file to read
binModeAllUtf8()
Set STDOUT and STDERR to accept utf8 without complaint.
Example:
binModeAllUtf8;
convertImageToJpx690($$$)
Convert an image to jpx format using versions of Imagemagick version 6.9.0 and above.
Parameter Description
1 $source Source file
2 $target Target folder (as multiple files will be created)
3 $Size Optional size of each tile - defaults to 256
formatTableMultiLine($$)
Tabularize text that has new lines in it.
Parameter Description
1 $data Reference to an array of arrays of data to be formatted as a table
2 $separator Optional line separator to use instead of new line for each row.
formatTableAA($$)
Tabularize an array of arrays.
Parameter Description
1 $data Data to be formatted
2 $title Optional reference to an array of titles
formatTableHA($$)
Tabularize a hash of arrays.
Parameter Description
1 $data Data to be formatted
2 $title Optional titles
formatTableAH($)
Tabularize an array of hashes.
Parameter Description
1 $data Data to be formatted
formatTableHH($)
Tabularize a hash of hashes.
Parameter Description
1 $data Data to be formatted
formatTableA($$)
Tabularize an array.
Parameter Description
1 $data Data to be formatted
2 $title Optional title
formatTableH($$)
Tabularize a hash.
Parameter Description
1 $data Data to be formatted
2 $title Optional title
saveSourceToS3($$)
Save source code.
Parameter Description
1 $aws Aws target file and keywords
2 $saveIntervalInSeconds Save internal
extractTest($)
Remove example markers from test code.
Parameter Description
1 $string String containing test line
docUserFlags($$$$)
Generate documentation for a method by calling the extractDocumentationFlags method in the package being documented, passing it the flags for a method and the name of the method. The called method should return the documentation to be inserted for the named method.
Parameter Description
1 $flags Flags
2 $perlModule File containing documentation
3 $package Package containing documentation
4 $name Name of method to be processed
updatePerlModuleDocumentation($)
Update the documentation in a perl file and show said documentation in a web browser.
Parameter Description
1 $perlModule File containing the code of the perl module
Synonyms
fpd is a synonym for filePathDir - Create a directory name from an array of file name components.
fpe is a synonym for filePathExt - Create a file name from an array of file name components the last of which is an extension.
fpf is a synonym for filePath - Create a file name from an array of file name components.
owf is a synonym for overWriteFile - Write a unicode utf8 string to a file after creating a path to the file if necessary and return the name of the file on success else confess.
temporaryDirectory is a synonym for temporaryFolder - Create a temporary folder that will automatically be rmdired during END processing.
Index
1 absFromAbsPlusRel - Create an absolute file from an absolute file and a relative file.
2 addCertificate - Add a certificate to the current ssh session.
3 addLValueScalarMethods - Generate lvalue scalar methods in the current package if they do not already exist.
4 appendFile - Append a unicode utf8 string to a file, possibly creating the file and the path to the file if necessary and return the name of the file on success else confess.
5 assertPackageRefs - Confirm that the specified references are to the specified package
6 assertRef - Confirm that the specified references are to the package into which this routine has been exported.
7 binModeAllUtf8 - Set STDOUT and STDERR to accept utf8 without complaint.
8 boldString - Convert alphanumerics in a string to bold.
9 boldStringUndo - Undo alphanumerics in a string to bold.
10 call - Call the specified sub in a separate process, wait for it to complete, copy back the named our variables, free the memory used.
11 checkFile - Return the name of the specified file if it exists, else confess the maximum extent of the path that does exist.
12 checkKeys - Check the keys in a hash.
13 clearFolder - Remove all the files and folders under and including the specified folder as long as the number of files to be removed is less than the specified limit.
14 containingPowerOfTwo - Find log two of the lowest power of two greater than or equal to a number.
15 contains - Returns the indices at which an item matches elements of the specified array.
16 convertDocxToFodt - Convert a docx file to fodt using unoconv which must not be running elsewhere at the time.
17 convertImageToJpx - Convert an image to jpx format using Imagemagick.
18 convertImageToJpx690 - Convert an image to jpx format using versions of Imagemagick version 6.
19 convertUnicodeToXml - Convert a string with unicode points that are not directly representable in ascii into string that replaces these points with their representation on Xml making the string usable in Xml documents.
20 createEmptyFile - Create an empty file - writeFile complains if no data is written to the file - and return the name of the file on success else confess.
21 currentDirectory - Get the current working directory.
22 currentDirectoryAbove - The path to the folder above the current working folder.
23 cutOutImagesInFodtFile - Cut out the images embedded in a fodt file, perhaps produced via convertDocxToFodt, placing them in the specified folder and replacing them in the source file with:
<image href="$imageFile" outputclass="imageType">
This conversion requires that you have both Imagemagick and unoconv
24 Data::Exchange::Service::check - Check that we are the current incarnation of the named service with details obtained from newServiceIncarnation.
25 dateStamp - Year-monthName-day
26 dateTimeStamp - Year-monthNumber-day at hours:minute:seconds
27 decodeBase64 - Decode a string in base 64.
28 decodeJson - Decode Perl from Json.
29 denormalizeFolderName - Remove any trailing folder separator from a folder name component.
30 docUserFlags - Generate documentation for a method by calling the extractDocumentationFlags method in the package being documented, passing it the flags for a method and the name of the method.
31 dumpFile - Dump a data structure to a file
32 dumpGZipFile - Write a data structure through gzip to a file.
33 enclosedReversedString - Convert alphanumerics in a string to enclosed reversed alphanumerics.
34 enclosedReversedStringUndo - Undo alphanumerics in a string to enclosed reversed alphanumerics.
35 enclosedString - Convert alphanumerics in a string to enclosed alphanumerics.
36 enclosedStringUndo - Undo alphanumerics in a string to enclosed alphanumerics.
37 encodeBase64 - Encode a string in base 64.
38 encodeJson - Encode Perl to Json.
39 evalFile - Read a file containing unicode in utf8, evaluate it, confess to any errors and then return any result - an improvement on do which silently ignores any problems.
40 evalGZipFile - Read a file containing compressed utf8, evaluate it, confess to any errors or return any result.
41 extractTest - Remove example markers from test code.
42 fe - Get extension of file name.
43 fileList - Files that match a given search pattern handed to bsd_glob.
44 fileModTime - Get the modified time of a file in seconds since the epoch.
45 fileOutOfDate - Calls the specified sub once for each source file that is missing, then calls the sub for the target if there were any missing files or if the target is older than any of the non missing source files or if the target does not exist.
46 filePath - Create a file name from an array of file name components.
47 filePathDir - Create a directory name from an array of file name components.
48 filePathExt - Create a file name from an array of file name components the last of which is an extension.
49 fileSize - Get the size of a file.
50 findDirs - Find all the folders under a folder and optionally filter the selected folders with a regular expression.
51 findFiles - Find all the files under a folder and optionally filter the selected files with a regular expression.
52 findFileWithExtension - Find the first extension from the specified extensions that produces a file that exists when appended to the specified file.
53 firstFileThatExists - Returns the name of the first file that exists or undef if none of the named files exist.
54 firstNChars - First N characters of a string.
55 fn - Remove path and extension from file name.
56 fne - Remove path from file name.
57 formatTable - Format various data structures as a table.
58 formatTableA - Tabularize an array.
59 formatTableAA - Tabularize an array of arrays.
60 formatTableAH - Tabularize an array of hashes.
61 formatTableBasic - Tabularize an array of arrays of text.
62 formatTableH - Tabularize a hash.
63 formatTableHA - Tabularize a hash of arrays.
64 formatTableHH - Tabularize a hash of hashes.
65 formatTableMultiLine - Tabularize text that has new lines in it.
66 fp - Get path from file name.
67 fpn - Remove extension from file name.
68 fullFileName - Full name of a file.
69 genHash - Return a $blessed hash with the specified $attributes.
70 genLValueArrayMethods - Generate lvalue array methods in the current package.
71 genLValueHashMethods - Generate lvalue hash methods in the current package.
72 genLValueScalarMethods - Generate lvalue scalar methods in the current package, A method whose value has not yet been set will return a new scalar with value undef.
73 genLValueScalarMethodsWithDefaultValues - Generate lvalue scalar methods with default values in the current package.
74 hostName - The name of the host we are running on.
75 htmlToc - Generate a table of contents for some html.
76 imageSize - Return (width, height) of an image obtained via Imagemagick.
77 indentString - Indent lines contained in a string or formatted table by the specified string.
78 ipAddressViaArp - Get the ip address of a server on the local network by hostname via arp
79 isBlank - Test whether a string is blank.
80 javaPackage - Extract the package name from a java string or file.
81 javaPackageAsFileName - Extract the package name from a java string or file and convert it to a file name.
82 keyCount - Count keys down to the specified level.
83 loadArrayArrayFromLines - Load an array of arrays from lines of text: each line is an array of words.
84 loadArrayFromLines - Load an array from lines of text in a string.
85 loadArrayHashFromLines - Load an array of hashes from lines of text: each line is an hash of words.
86 loadHash - Load the specified $hash generated with genHash with %attributes.
87 loadHashArrayFromLines - Load a hash of arrays from lines of text: the first word of each line is the key, the remaining words are the array contents.
88 loadHashFromLines - Load a hash: first word of each line is the key and the rest is the value.
89 loadHashHashFromLines - Load a hash of hashes from lines of text: the first word of each line is the key, the remaining words are the sub hash contents.
90 makeDieConfess - Force die to confess where the death occurred
91 makePath - Make the path for the specified file name or folder.
92 matchPath - Given an absolute path find out how much of the path actually exists.
93 max - Find the maximum number in a list.
94 maximumLineLength - Find the longest line in a string
95 microSecondsSinceEpoch - Micro seconds since unix epoch.
96 min - Find the minimum number in a list.
97 newServiceIncarnation - Create a new service incarnation to record the start up of a new instance of a service and return the description as a Data::Exchange::Service Definition hash.
98 numberOfLinesInFile - The number of lines in a file
99 numberOfLinesInString - The number of lines in a string.
100 nws - Normalize white space in a string to make comparisons easier.
101 overWriteFile - Write a unicode utf8 string to a file after creating a path to the file if necessary and return the name of the file on success else confess.
102 pad - Pad a string with blanks or the specified padding character to a multiple of a specified length.
103 parseCommandLineArguments - Classify the specified array of words referred to by $args into positional and keyword parameters, call the specified sub with a reference to an array of positional parameters followed by a reference to a hash of keywords and their values then return the value returned by this sub.
104 parseFileName - Parse a file name into (path, name, extension).
105 perlPackage - Extract the package name from a perl string or file.
106 powerOfTwo - Test whether a number is a power of two, return the power if it is else undef.
107 printFullFileName - Print a file name on a separate line with escaping so it can be used easily from the command line.
108 printQw - Print an array of words in qw() format.
109 quoteFile - Quote a file name.
110 readBinaryFile - Read binary file - a file whose contents are not to be interpreted as unicode.
111 readFile - Read a file containing unicode in utf8.
112 readGZipFile - Read the specified $file, containing compressed utf8, through gzip
113 readUtf16File - Read a file containing unicode in utf-16 format.
114 relFromAbsAgainstAbs - Derive a relative file name for the first absolute file name relative to the second absolute file name.
115 removeFilePrefix - Removes a file prefix from an array of files.
116 renormalizeFolderName - Normalize a folder name component by adding a trailing separator.
117 saveCodeToS3 - Save source code files.
118 saveSourceToS3 - Save source code.
119 searchDirectoryTreesForMatchingFiles - Search the specified directory trees for the files (not folders) that match the specified extensions.
120 setIntersectionOfTwoArraysOfWords - Intersection of two arrays of words.
121 setUnionOfTwoArraysOfWords - Union of two arrays of words.
122 startProcess - Start new processes while the number of child processes recorded in %$pids is less than the specified $maximum.
123 stringsAreNotEqual - Return the two non equal tails of non equal strings or an empty list if the strings are equal.
124 subScriptString - Convert alphanumerics in a string to sub scripts
125 subScriptStringUndo - Undo alphanumerics in a string to sub scripts
126 superScriptString - Convert alphanumerics in a string to super scripts
127 superScriptStringUndo - Undo alphanumerics in a string to super scripts
128 temporaryFile - Create a temporary file that will automatically be unlinked during END processing.
129 temporaryFolder - Create a temporary folder that will automatically be rmdired during END processing.
130 timeStamp - hours:minute:seconds
131 titleToUniqueFileName - Create a file name from a title that is unique within the set %uniqueNames.
132 trackFiles - Track the existence of files.
133 trim - Remove any white space from the front and end of a string.
134 updateDocumentation - Update documentation from the comments in a perl script.
135 updatePerlModuleDocumentation - Update the documentation in a perl file and show said documentation in a web browser.
136 userId - The userid we are currently running under.
137 versionCode - YYYYmmdd-HHMMSS
138 versionCodeDashed - YYYY-mm-dd-HH:MM:SS
139 waitForAllStartedProcessesToFinish - Wait until all the processes started by startProcess have finished.
140 writeBinaryFile - Write a non unicode string to a file in after creating a path to the file if necessary and return the name of the file on success else confess.
141 writeFile - Write a unicode utf8 string to a new file that does not already exist after creating a path to the file if necessary and return the name of the file on success else confess if a problem occurred or the file does already exist.
142 writeFiles - Write the values of a hash into files identified by the key of each value using overWriteFile
143 writeGZipFile - Write a unicode utf8 string through gzip to a file.
144 wwwEncode - Replace spaces in a string with %20 .
145 xxx - Execute a shell command.
146 yyy - Execute a block of shell commands line by line after removing comments - stop if there is a non zero return code from any command.
147 zzz - Execute lines of commands after replacing new lines with && then check that the pipeline execution results in a return code of zero and that the execution results match the optional regular expression if one has been supplied; confess() to an error if either check fails.
148 ˢ - Immediately executed inline sub to allow a code block before if.
Installation
This module is written in 100% Pure Perl and, thus, it is easy to read, comprehend, use, modify and install via cpan:
sudo cpan install Data::Table::Text
Author
Copyright
Copyright (c) 2016-2018 Philip R Brenan.
This module is free software. It may be used, redistributed and/or modified under the same terms as Perl itself.
Acknowledgements
Thanks to the following people for their help with this module:
- mim@cpan.org
-
Testing on windows
1 POD Error
The following errors were encountered while parsing the POD:
- Around line 5517:
Unterminated L<...> sequence