NAME

Games::Golf::TestSuite - An object that can run a suite of tests.

SYNOPSIS

use Games::Golf;

# "hole" is the file holding the test suite
my $test = new Games::Golf::TestSuite( "hole" );

# $entry is a Games::Golf::Entry object
$test->check( $entry );

DESCRIPTION

!!FIXME!!

Methods

$test = Games::Golf::TestSuite->new( 'hole.t' );

Constructs a Games::Golf::TestSuite object with the tests held in the file given as an argument.

A test suite is a perl script written as follow:

# first test: does the script at least compile?
$test->compile;
# check 
$in   = 'some input to give the script';
$out  = 'the script expected output';
$err  = '';    # don't expect anything on STDERR
$exit = undef; # don't care for exit code
$test->ioee( $in, $out, $err, $exit );

# use other Games::Golf::TestSuite method
# to create as many subtests as needed

$test->run( @entries );

Run the testsuite on the given list of Games::Golf::Entry objects. This method simply loops on @entries with check() method.

$test->check( $entry );

Run the testsuite on a single Games::Golf::Entry object, update the object and return the results of the test. The result attribute of the Games::Golf::Entry object is updated.

Available tests for testing scripts

These tests are Games::Golf::TestSuite methods that hole makers can use in their hole test scripts.

$test->compile;

Does the player script at least compile? This does count as a test in the testsuite.

$test->ioee( $in, $out, $err, $exit, time => $time, stdout => $limit, stderr => $limit );

Given $in, the script should output $out on STDOUT, $err on STDERR and return the exit code $exit. If you don't care about any of the tree outputs (stdout, stderr or exit code), just pass undef.

You can pass further three limits to tune the test:

o

A time limit for each test (default 30 seconds).

o

A data limit for stdout (default 1 megabyte).

o

A data limit for stderr (default 1 megabyte).

WARNING! This sub is a minimal workaround, and may deadlock on big input sets, since we do not check via select if we can write.

Available tests for testing subs

If the hole requires a sub, the testsuite must first create the sub with makesub(), and then can use it.

The sub is stored in the sub attribute of the Games::Golf::TestSuite object, and is named after the hole, in the Games::Golf::TestSuite::Sandbox package (in case the sub calls itself).

$test->makesub;

Create a subroutine named after the hole in the sandbox. It can then be used through $test->sub( ... ) or by calling it directly by its name (the hole name).

This does count as a test in the testsuite. The sub should at least be valid Perl, shouldn't it?

$test->sub( ... );

Call the subroutine defined with makesub().

$test->ok( $result, $expected );

Similar to the ok() sub used in the Test module. The two parameters are in scalar context.

The following examples are straight from Test.pm:

$test->ok(0,1);             # failure: '0' ne '1'
$test->ok('broke','fixed'); # failure: 'broke' ne 'fixed'
$test->ok('fixed','fixed'); # success: 'fixed' eq 'fixed'
$test->ok('fixed',qr/x/);   # success: 'fixed' =~ qr/x/

$test->ok(sub { 1+1 }, 2);  # success: '2' eq '2'
$test->ok(sub { 1+1 }, 3);  # failure: '2' ne '3'
$test->ok(0, int(rand(2));  # (just kidding :-)

$test->ok 'segmentation fault', '/(?i)success/'; # regex match

Other test for the code itself

These tests are Games::Golf::TestSuite methods that hole makers can use in their hole test scripts.

The subtests use the code stored in attribute code, and update the attribute result.

$test->not_string( $s );

Test that the code in the entry doesn't contain the string $s.

$test->not_match( $regex );

Test that the code in the entry doesn't match $regex.

$test->not_op( $op );

Test that the code in the entry doesn't use the given opcode. (TODO)

BUGS

Please report all bugs to:

http://rt.cpan.org/NoAuth/Bugs.html?Dist=Games-Golf

TODO

Arrange for the entry script to be run with use strict; and warnings. (right now, they are run in a no strict, no warnings sandbox.)

AUTHORS

Philippe 'BooK' Bruhat <book@cpan.org>

Dave Hoover <dave@redsquirreldesign.com>

Steffen Müller <tsee@gmx.net>

Jonathan E. Paton <jonathanpaton@yahoo.com>

Jérôme Quelin <jquelin@cpann.org>

Eugène Van der Pijll <E.C.vanderPijll@phys.uu.nl>

COPYRIGHT

This module is free software. It may be used, redistributed and/or modified under the same terms as Perl itself.

SEE ALSO

perl, Games::Golf, Games::Golf::Entry.

cpanm Games::Golf

perl -MCPAN -e shell
install Games::Golf