[Python-Dev] Lexical analysis and NEWLINE tokens

Phillip J. Eby pje at telecommunity.com
Thu Oct 6 18:11:17 CEST 2005

At 07:36 AM 10/6/2005 -0500, Matthew F. Barnes wrote:
>I posted this question to python-help, but I think I have a better chance
>of getting the answer here.
>I'm looking for clarification on when NEWLINE tokens are generated during
>lexical analysis of Python source code.

If you're talking about the "tokenize" module, NEWLINE is only generated 
following a logical line, which is one that contains code.

More information about the Python-Dev mailing list