[Python-Dev] Lexical analysis and NEWLINE tokens

[Phillip J. Eby]

At 07:36 AM 10/6/2005 -0500, Matthew F. Barnes wrote:
>I posted this question to python-help, but I think I have a better chance
>of getting the answer here.
>
>I'm looking for clarification on when NEWLINE tokens are generated during
>lexical analysis of Python source code.

If you're talking about the "tokenize" module, NEWLINE is only generated 
following a logical line, which is one that contains code.