[Python-Dev] Lexical analysis and NEWLINE tokens
Phillip J. Eby
pje at telecommunity.com
Thu Oct 6 18:11:17 CEST 2005
At 07:36 AM 10/6/2005 -0500, Matthew F. Barnes wrote:
>I posted this question to python-help, but I think I have a better chance
>of getting the answer here.
>I'm looking for clarification on when NEWLINE tokens are generated during
>lexical analysis of Python source code.
If you're talking about the "tokenize" module, NEWLINE is only generated
following a logical line, which is one that contains code.
More information about the Python-Dev