NAME

Test::Module::Runnable - A runnable framework on Moose for running tests

SYNOPSIS

package YourTestSuite;
use Moose;
use Test::More 0.96;

extends 'Test::Module::Runnable';

sub helper { } # Not called

sub testExample { } # Automagically called due to 'test' prefix.

package main;

my $tester = new YourTestSuite;
return $tester->run;

Deprecated alternative:

my $tester = new YourTestSuite;
plan tests => $tester->testCount;
foreach my $name ($tester->testMethods) {
	subtest $name => $tester->$name;
}

DESCRIPTION

A test framework based on Moose introspection to automagically call all methods matching a user-defined pattern. Supports per-test setup and tear-down routines and easy early "BAIL_OUT" in Test::Builder using Test::More.

ATTRIBUTES

sut

System under test - a generic slot for an object you are testing, which could be re-initialized under the setUp routine, but this entry may be ignored.

mocker

This slot can be used during "setUpBeforeClass" to set up a Test::MockModule for the "sut" class being tested. If set, mocker->unmock_all() will be called automagically, just after each test method is executed. This will allow different methods to to be mocked, which are not directly relevant to the test method being executed.

By default, this slot is undef

pattern

The pattern which defines which user-methods are considered tests. Defaults to ^test. Methods matching this pattern will be returned from "methodNames"

logger

A generic slot for a loggger, to be initialized with your logging framework, or a mock logging system.

This slot is not touched by this package, but might be passed on to your "sut", or you may wish to clear it between tests by sub-classing this package.

METHODS

methodNames

Returns a list of all names of test methods which should be called by /subtest, ie. all method names beginning with 'test', or the user-defined "pattern".

If you use "run", this is handled automagically.

debug

Call Test::Builder::diag with a user-defined message, if and only if the TEST_VERBOSE environment variable is set.

mock($class, $method, $return)

This mocks the given method on the specified class, with the specified return value, described below. Additionally, stores internally a log of all method calls, and their arguments. Note that the first argument is not saved, i.e. the object on which the method was called, as this is rarely useful in a unit test comparison.

The return value, $return, may be specified in one of two ways:

A CODE reference

In which case the code reference is simply called each time, with all arguments as passed to the mocked function, and the return value passed as-is to the caller. Note that care is taken that if the mocked method is called in array context, the code reference is called in array context, and likewise for scalar context.

An ARRAY reference

In which case, a value is shifted from the front of the array. If the value removed is itself a CODE ref the code reference is called, and its return value returned, as described above, otherwise the value is returned as-is.

Note that you cannot return a list by adding it to an array, so if you need to use the array form, and also return a list, you will need to add a CODE reference into the array:

$self->mock($class, $method, [
	1,                       # first call returns scalar '1'
	[2,3,4],                 # second call returns array reference
	sub { return (5,6,7) },  # third call returns a list
]);

If no value is specified, or if the specified array is exhaused, then either undef or an empty array is returned, depending on context.

Calls including arguments and return values are passed to the "debug" method.

unmock([class], [$method])

Clears all mock objects.

If no arguments are specified "clearMocks" in Test::Module::Runnable::Base is called.

Is a class is specified, only that class is cleared.

If a method is specified too, only that method of that mocked class is cleared (not methods by the same name under other classes).

It is not legal to unmock a method in many or unspecified classes, doing so will invoke die().

The reference to the the tester is returned.

mockCalls($class, $method)

Return a reference to an array of the calls made to the specified mocked function. Each entry in the arrayref is an arrayref of the arguments to that call, excluding the object reference itself (i.e. $self).

mockCallsWithObject($class, $method)

Return a reference to an array of the calls made to the specified mocked function. Each entry in the arrayref is an arrayref of the arguments to that call, including the object reference itself (i.e. $self).

This method is strongly encouraged in preference to "mockCalls($class, $method)" if your test constructs multiple instances of the same class, so that you know that the right method calls were actually made on the right object.

Normal usage:

cmp_deeply($self->mockCallsWithObject($class, $method), [
	[ shallow($instance1), $arg1, $arg2 ],
	[ shallow($instance2), $otherArg1, $otherArg2 ],
	...
], 'correct method calls');
unique

Returns a unique, integer ID, which is predictable.

An optional $domain can be specified, which is a discrete sequence, isolated from any other domain. If not specified, a default domain is used. The actual name for this domain is opaque.

A special domain; rand can be used for random numbers which will not repeat.

methodCount

Returns the number of tests to pass to plan If you use "run", this is handled automagically.

clearMocks

Forcibly clear all mock objects, if required e.g. in tearDown.

PROTECTED METHODS

_mockdump

Helper method for dumping arguments and return values from mock function.

USER DEFINED METHODS

setUpBeforeClass

If you need to initialize your test suite before any tests run, this hook is your opportunity. If the setup fails, you should return EXIT_FAILURE. you must return EXIT_SUCCESS in order for tests to proceed.

Don't write code here! Override the method in your test class.

The default action is to do nothing.

tearDownAfterClass

If you need to finalize any cleanup for your test suite, after all tests have completed running, this hook is your opportunity. If the cleanup fails, you should return EXIT_FAILURE. If cleanup succeeds, you should return EXIT_SUCCESS. You can also perform final sanity checking here, because retuning EXIT_FAILURE causes the suite to call "BAIL_OUT" in Test::Builder.

Don't write code here! Override the method in your test class.

The default action is to do nothing.

setUp

If you need to perform per-test setup, ie. before individual test methods run, you should override this hook. You must return EXIT_SUCCESS from the hook, otherwise the entire test suite will be aborted via "BAIL_OUT" in Test::Builder.

Don't write code here! Override the method in your test class.

The default action is to do nothing.

tearDown

If you need to perform per-test cleanup, ie. after individual test methods run, you should override this hook. You must return EXIT_SUCCESS from the hook, otherwise the entire test suite will be aborted via "BAIL_OUT" in Test::Builder.

Don't write code here! Override the method in your test class.

The default action is to do nothing.

uniqueStr([$length])

Return a unique alphanumeric string which shall not be shorter than the specified $length, which is 1 by default. The string is guaranteed to evaluate true in a boolean context.

The numerical value of each character is obtained from "unique".

Note that the strings returned from this function are only guaranteed to be in monotonically increasing lexicographical order if they are all of the same length. Therefore if this is a concern, specify a length which will be long enough to include all the strings you wish to generate, for example uniqueStr(4) would produce 62**4 (over 14 million) strings in increasing order.

Can be called statically and exported in the same way as "unique".

uniqueStrCI($length)

Works exactly the same as "uniqueStr([$length])" except that the results are case sensitively identical. Note that the strings are not guaranteed to be all lowercase or all uppercase, you may get "A" or "a", but you will never get both. No assumption should be made about the case.

uniqueDomain([$options])

Returns a unique, fake domain-name. No assumptions should be made about the domain name or TLD returned, except that this domain cannot be registered via a domain registrar, is lower-case and is unique per test suite run.

The optional $options, if specified, must be a HASH ref, and it may contain the following keys:

length

The length of the first part of the hostname. This ensures correct lexicographic ordering.

lettersOnly

Ensure that hostname parts only contain letters, not numbers. This is also useful to ensure correct lexicographic ordering.

uniqueLetters($length)

Return a unique string containing letters only, which shall not be shorter than the specified $length, which is 1 by default. The string is guaranteed to evaluate true in a boolean context.

Note that the strings returned from this function are only guaranteed to be in monotonically increasing lexicographical order if they are all of the same length. Therefore if this is a concern, specify a length which will be long enough to include all the strings you wish to generate, for example uniqueStr(4) would produce 62**4 (over 14 million) strings in increasing order.

modeName

If set, this routine will be called from the internal "__generateMethodName" in Test::Module::Runnable::Base method, which is used to generate the method name displyed to the user. This name should represent the mode of testing currently in use, for example. you may be re-running all the tests to test a different database driver.

If undef or an empty string is returned, the result is ignored, as if you had not defined this method.

SEE ALSO "modeSwitch"

This is a dummy method which just returns undef. User test classes can override this.

modeSwitch

If set, this routine will be called between test runs. This is typically used by setting an n value of at least 2. Every time the test suite finishes, this routine is called, and you can replace a "sut" or set a flag so that all tests can then run with an underlying assumption shared between the tests inverted, for example, with a different database driver.

The return value from your registered modeSwitch CODE reference should be zero to indicate success. Your routine will be passed the current n iteration, starting with zero.

This is the default action for switching the mode of the test between iterations is to report success but do nothing. Testers which are subclasses may override this method.

run

Executes all of the tests, in a random order An optional override may be passed with the tests parameter.

* tests
  An ARRAY ref which contains the inclusive list of all tests
  to run.  If not passed, all tests are run. If an empty list
  is passed, no tests are run.  If a test does not exist, C<confess>
  is called.

* n
  Number of times to iterate through the tests.
  Defaults to 1.  Setting to a higher level is useful if you want to
  prove that the random ordering of tests does not break, but you do
  not want to type 'make test' many times.

Returns: The return value is always EXIT_SUCCESS, which you can pass straight to exit

AUTHOR

Duncan Ross Palmer, 2E0EOL mailto:palmer@overchat.org

LICENCE

Daybo Logic Shared Library Copyright (c) 2015-2024, Duncan Ross Palmer (2E0EOL), Daybo Logic All rights reserved.

Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

* Redistributions of source code must retain the above copyright notice,
  this list of conditions and the following disclaimer.

* Redistributions in binary form must reproduce the above copyright
  notice, this list of conditions and the following disclaimer in the
  documentation and/or other materials provided with the distribution.

* Neither the name of the Daybo Logic nor the names of its contributors
  may be used to endorse or promote products derived from this software
  without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

AVAILABILITY

https://metacpan.org/release/Test-Module-Runnable https://git.sr.ht/~m6kvm/libtest-module-runnable-perl http://www.daybologic.co.uk/software.php?content=libtest-module-runnable-perl

CAVEATS

None known.