String-Tokenizer-0.05

Changes for version 0.05

added support for whitespace tokens, feature requested by Stephan Tobias.
- added tests for this
- added documenation for this
fixed bug where the '0' token got ignored, also thanks to Stephan Tobias for this.

A simple string tokenizer.

in lib/String/Tokenizer.pm

To install String::Tokenizer, copy and paste the appropriate command in to your terminal.

cpanm String::Tokenizer

perl -MCPAN -e shell
install String::Tokenizer

For more information on module installation, please visit the detailed CPAN module installation guide.

	Global
`s`	Focus search bar
`?`	Bring up this help dialog

	GitHub
`g` `p`	Go to pull requests
`g` `i`	go to github issues (only if github is preferred repository)

	Search terms
module: (e.g. module:Plugin)
distribution: (e.g. distribution:Dancer auth)
author: (e.g. author:SONGMU Redis)
version: (e.g. version:1.00)