curated-tokenizers

Source code: https://github.com/explosion/curated-tokenizers

Select version:

pip install curated-tokenizers --index-url https://pypi.riseproject.dev/simple/

License: MIT

Download files: curated-tokenizers-v2.0.1-20260907102742