[issue3353] make built-in tokenizer available via Python C API

[Anthony Sottile]

Anthony Sottile <asottile at umich.edu> added the comment:

Serhiy Storchaka is this still blocked?  it's been a few years on either this or the linked issue and I'm reaching for this one :)

----------
nosy: +Anthony Sottile

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue3353>
_______________________________________