[issue21765] Idle: make 3.x HyperParser work with non-ascii identifiers.

[Martin v. Löwis]

Martin v. Löwis added the comment:

I think you are misinterpreting the grammar. Your code declares that U+00B2 (SUPERSCRIPT TWO, ²) is an identifier character. Its category is No, so it is actually not. However, its normalization is U+0032 (DIGIT TWO, 2), which is an identifier character - but that doesn't make SUPERSCRIPT TWO a member of XID_Continue.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue21765>
_______________________________________