[issue2182] tokenize: does not allow CR for a newline

[Guido van Rossum]

Guido van Rossum <guido at python.org> added the comment:

I recommend that you only care about \n and consider everything else
unspecified.

__________________________________
Tracker <report at bugs.python.org>
<http://bugs.python.org/issue2182>
__________________________________