While building and installing tokenizers Python bindings from source with Python3.13t, I am encountering failures stemming from dependency incompatibilities between the numpy create an pyo3.
I’ve already filed an issue here Tokenizers fails to build in Python3.13t (NoGIL build) · Issue #1749 · huggingface/tokenizers · GitHub, and a PR resolving it here Update dependency versions to fix NoGIL Python package install by vinayakdsci · Pull Request #1750 · huggingface/tokenizers · GitHub.
This is my first PR to tokenizers, so I need maintainer approval before CI workflows can start running. If anyone can approve the workflows I’d really appreciate it.