[issue12675] tokenize module happily tokenizes code with syntax errors

Gareth Rees report at bugs.python.org
Thu Aug 4 14:26:06 CEST 2011

Gareth Rees <gdr at garethrees.org> added the comment:

Ah ... TokenInfo is a *subclass* of namedtuple, so I can add extra properties to it without breaking consumers that expect it to be a 5-tuple.


Python tracker <report at bugs.python.org>

More information about the Python-bugs-list mailing list