[issue21765] Idle: make 3.x HyperParser work with non-ascii identifiers.

[Terry J. Reedy]

New submission from Terry J. Reedy:

idlelib.HyperParser.Hyperparser has these lines
    _whitespace_chars = " \t\n\\"
    _id_chars = string.ascii_letters + string.digits + "_"
    _id_first_chars = string.ascii_letters + "_"
used in _eat_identifier() and get_expression. At least the latter two should be turned into functions that access the unicode datebase. (Such functions, if not already present in the stdlib, should be. But adding something elsewhere would be another issue.)

----------
messages: 220593
nosy: taleinat, terry.reedy
priority: normal
severity: normal
stage: test needed
status: open
title: Idle: make 3.x HyperParser work with non-ascii identifiers.
type: behavior
versions: Python 3.4, Python 3.5

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue21765>
_______________________________________