[issue9712] tokenize yield an ERRORTOKEN if the identifier starts with a non-ascii char

[Benjamin Peterson]

Benjamin Peterson <benjamin at python.org> added the comment:

r84364

----------
nosy: +benjamin.peterson
resolution:  -> fixed
status: open -> closed

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue9712>
_______________________________________