NewYour coding agent can read the release notes before it upgrades.Set up the MCP server →
PyPI · #5156 most downloaded on PyPI
Lightweight piece tokenization library
Last release 1 months ago
24 Aug 2026
Ships unpredictably
gaps range from 3 weeks to 2.4 years
Nearly every release is documented
notes for 9 of 10 stable releases
Nothing withdrawn
no release was ever pulled
3 years old
12 releases · first in 2023
One column per quarter.
Nothing published for this version
Improve Byte BPE encoding speed
Set minimum version of Python to 3.9
Set version to 2.0.0.dev0
Set minimum version of Python to 3.9
Also update CI to test 3.9 as the lowest version.
Make piece processors picklable (#53, #54).
Support loading the ByteBPEProcessor and SentencePieceProcessor from files (#51).
Bump version to 0.9.0
Bump version to 0.9.0 (#48)
We decided that we want to do a 0.9.0 release of Curated Transformers before the final 1.0.0 release. Also reflect this in the version of Curated Toke
We decided that we want to do a 0.9.0 release of Curated Transformers
before the final 1.0.0 release. Also reflect this in the version of
Curated Tokenizers.
Backport build fixes for Python 3.13/3.14 wheels
Backport build fixes for Python 3.13/3.14 wheels
- Pin Cython to >=3.0,<3.2 (3.3.0 has a compiler crash in
OptimizeBuiltinCalls; 3.0.x/3.1.x verified to work)
- Add cibuildwheel workflow using explosion/gha-cibuildwheel with
submodule checkout for the vendored sentencepiece sources
- Raise python_requires to >=3.9, update classifiers and test matrix
- Set version to 0.0.10
Make piece processors picklable (#53, #54).
Set version to 0.0.8
Set version to 0.0.8 (#47)
The cutlery package is renamed to curated-tokenizers.
The cutlery package is renamed to curated-tokenizers.
Add docstrings, piece_to_id and id_to_piece to SentencePieceProcessor (https://github.com/explosion/cutlery/pull/37).
piece_to_id and id_to_piece to SentencePieceProcessor (https://github.com/explosion/cutlery/pull/37).Your coding agent can read these notes before it upgrades. Set up the MCP server →