Stéphane Wirtel added the comment: With python 3.5, async is a token with the ASYNC type.

...

...

tokens = tokenize.generate_tokens(io.StringIO('async def foo').readline) pprint.pprint(list(tokens)) [TokenInfo(type=55 (ASYNC), string='async', start=(1, 0), end=(1, 5), line='async def foo'), TokenInfo(type=1 (NAME), string='def', start=(1, 6), end=(1, 9), line='async def foo'), TokenInfo(type=1 (NAME), string='foo', start=(1, 10), end=(1, 13), line='async def foo'), TokenInfo(type=0 (ENDMARKER), string='', start=(2, 0), end=(2, 0), line='')]

---------- nosy: +matrixise _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

SilentGhost added the comment: I've added versionchanged, since this is what's done in os, for similar lists. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

Yury Selivanov added the comment: ASYNC/AWAIT tokens are temporary and will be removed in 3.7 ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

Yury Selivanov added the comment:

Are you suggesting that the note should state that these two are temporary?

Yes, that would be great.

Or is this information available somewhere else, in What's new, for example?

Not directly, I think. It was detailed to some extent in PEP 492. In what's new of 3.5 & 3.6 it's stated that async/await will be keywords in 3.7. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

Martin Panter added the comment: Will they really be removed? What are the compatibility implications? Maybe it would be better to alias them to NAME, or keep them as unused values. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

Yury Selivanov added the comment:

My only background here is via the tokenize module, which seems to currently behave as described in <https://www.python.org/dev/peps/pep-0492/#transition-plan>: async and await are either NAME tokens (like ordinary identifiers and other reserved keywords) outside a coroutine definition, but they become special ASYNC and AWAIT tokens inside a coroutine.

Exactly. And in 3.7 they will be NAME tokens in any context. That's why I'm reluctant to document them atm. ---------- _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________

Roundup Robot added the comment: New changeset aa79b2a5b2e1 by Yury Selivanov in branch '3.5': docs: Document ASYNC/AWAIT tokens (issue #25580) https://hg.python.org/cpython/rev/aa79b2a5b2e1 ---------- nosy: +python-dev _______________________________________ Python tracker <report@bugs.python.org> <http://bugs.python.org/issue25580> _______________________________________