theseer/tokenizer

• Removed the custom token T_AMPERSAND as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.

Full Changelog: 2.0.0...2.0.1

Fixed

• Removed the custom token T_AMPERSAND as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.

What's Changed

• Utilize PhpToken::tokenize() - requires PHP8+ by @staabm in #35
• Add XMLSerializer->appendToWriter() by @staabm in #38

Full Changelog: 1.3.1...2.0.0

This release bumps the minimum version required to PHP 8.1.

Added

• New API XMLSerializer::appendToWriter to allow easier integration and better performance when writing fragments (Thanks @staabm)

Changed

• Internal change: Now uses PHPToken::tokenize in favor of token_get_all (requires PHP 8+) (Thanks @staabm)

• Fix #37: v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)

Fixed

• #37: v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)

• Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
• Merge various performance improvements provided by @staabm
• Merge some code cleanups provided by @staabm

Changed

• Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
• Merge various performance improvements provided by @staabm
• Merge some code cleanups provided by @staabm

Changed

• Do not use implict nullable type (thanks @sebastianbergmann), this should make things work on PHP 8.4

Changed

• Do not use implicitly nullable parameters

Fixed

• #18: Tokenizer fails on protobuf metadata files

Fixed

• #18: Tokenizer fails on protobuf metadata files

Fixed

• #13: Fatal error when tokenizing files that contain only a single empty line

This release is now PHP 8.0 compliant.

Fixed

• Whitespace handling in general (only noticeable in the intermediate TokenCollection) is now consistent

Changed

• Updated Tokenizer to deal with changed whitespace handling in PHP 8.0 The XMLSerializer was unaffected.

Changed

• Ensure XMLSerializer can deal with empty token collections

Fixed

• #2: Fatal error in infection / phpunit

Revert PHPUnit 8 update to stay PHP 7.0 compliant.

This release does not include any functionality change otherwise.

Changed

• Reverted PHPUnit 8 test update to stay PHP 7.0 compliant

Fixed

• #1: Empty file causes invalid array read

Changed

• Tests should now be PHPUnit 8 compliant

Added

• Allow use of custom namespace for XML serialization

Initial Release