NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
Packagist · #58 most downloaded on Packagist
A small library for converting tokenized PHP source code into XML and potentially other formats
Last release 10 months ago
08 Dec 2025
Release timing varies
gaps range from 3 weeks to 2.3 years
Nearly every release is documented
notes for 13 of 13 stable releases
Nothing withdrawn
no release was ever pulled
10 years old
13 releases · first in 2017
Removed the custom token T_AMPERSAND as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.
T_AMPERSAND as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.Full Changelog: 2.0.0...2.0.1
Utilize PhpToken::tokenize() - requires PHP8+ by @staabm in #35
PhpToken::tokenize() - requires PHP8+ by @staabm in #35Full Changelog: 1.3.1...2.0.0
One column per quarter.
This release bumps the minimum version required to PHP 8.1.
XMLSerializer::appendToWriter to allow easier integration and better performance when writing fragments (Thanks @staabm)PHPToken::tokenize in favor of token_get_all (requires PHP 8+) (Thanks @staabm)Fix #37 : v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)
Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
Do not use implict nullable type (thanks @sebastianbergmann ), this should make things work on PHP 8.4
Fixed #18 : Tokenizer fails on protobuf metadata files
### Fixed * #13: Fatal error when tokenizing files that contain only a single empty line
This release is now PHP 8.0 compliant.
This release is now PHP 8.0 compliant.
TokenCollection) is now consistentTokenizer to deal with changed whitespace handling in PHP 8.0
The XMLSerializer was unaffected.Ensure XMLSerializer can deal with empty token collections
Revert PHPUnit 8 update to stay PHP 7.0 compliant.
Revert PHPUnit 8 update to stay PHP 7.0 compliant.
This release does not include any functionality change otherwise.
Tests should now be PHPUnit 8 compliant
Allow use of custom namespace for XML serialization
[1.3.1]: https://github.com/theseer/tokenizer/compare/1.3.0...1.3.1 [1.3.0]: https://github.com/theseer/tokenizer/compare/1.2.3...1.3.0 [1.2.3]: https
Initial Release
Your coding agent can read these notes before it upgrades. Set up the MCP server →