NAME
Pistachio::Token::Constructor::Perl5 - provides text_to_tokens(), which turns source code text into an array of Pistachio::Tokens
VERSION
version 0.10
SYNPOSIS
use Pistachio::Token::Constructor::Perl5 'text_to_tokens';
my $tokens = text_to_tokens(\"use strict; ...;");
for my $token (@$tokens) {
print $token->type, ': ', $token->value, "\n";
}
NOTES
This module uses PPI::Tokenizer to tokenize Perl5 source code.
AUTHOR
Joel Dalley <joeldalley@gmail.com>
COPYRIGHT AND LICENSE
This software is copyright (c) 2014 by Joel Dalley.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.