Tokenizer is a tool that uses regular expressions to split given string into tokens. What the hell is that good for, you might ask? Well, you can create your own languages! Tokenizer is used in Latte for example.
To use this library, you just have to add, in your project:
require_once '/usr/share/php/Nette/Tokenizer/autoload.php';
Please login to add feedback.
This update has been submitted for testing by remi.
This update has been pushed to testing.
remi edited this update.
This update has reached 14 days in testing and can be pushed to stable now if the maintainer wishes
This update has been submitted for stable by remi.
This update has been pushed to stable.