[issue35975] Put back the ability to parse files where async/await aren't keywords

[Yury Selivanov]

Yury Selivanov <yselivanov at gmail.com> added the comment:

> And the same tokenizer trick that detects 'async def' could detect 'async for' easily.

Exactly.  I just never thought that we could support async generator expressions with the kind of hacks in tokenizer we had in 3.5-3.6.  FWIW I still believe that it's better for async & await tokens to be proper keywords, but in case we ever realize we want them to become "soft" keywords we apparently have options.

----------

_______________________________________
Python tracker <report at bugs.python.org>
<https://bugs.python.org/issue35975>
_______________________________________