Skip to content

Releases: Tanuel/php-tokenizer

Performance improvements

06 Oct 09:07
Compare
Choose a tag to compare
  • Use Regex Marks instead of iteratively matching each token independently. Thanks @nikic for the Feedback!
  • Use strstr and substr instead of regexps in some cases
  • Remove AbstractTokenDefinition->getRegex() as it is no longer used

First Release

05 Oct 07:49
Compare
Choose a tag to compare

This marks the first release of this tokenizer. For the most part it is ready for v1, but some minor things might change around.