[New-bugs-announce] [issue2495] tokenize doesn't handle __future__.unicode_literals correctly

[Christian Heimes]

New submission from Christian Heimes <lists at cheimes.de>:

See r61976

Clear the blacklist and run the test with 

  ./python Lib/test/regrtest.py -uall test_tokenize

to reproduce the issue.

----------
components: Library (Lib)
messages: 64582
nosy: tiran
priority: normal
severity: normal
status: open
title: tokenize doesn't handle __future__.unicode_literals correctly
versions: Python 2.6

__________________________________
Tracker <report at bugs.python.org>
<http://bugs.python.org/issue2495>
__________________________________