[docs] [issue28418] Raise Deprecation warning for tokenize.generate_tokens

[Martin Panter]

Martin Panter added the comment:

There is related discussion in Issue 12486 about supporting unencoded text input. The current patch there actually already raises a warning and removes call sites from the Python library, though it does not add a doc string.

----------
nosy: +martin.panter

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue28418>
_______________________________________