[New-bugs-announce] [issue3078] tokenize.py improvements

[Aristotelis Mikropoulos]

New submission from Aristotelis Mikropoulos <amikrop at gmail.com>:

Various tokenize.py performance boosts and code clarifications.

----------
components: Library (Lib)
files: tokenize.py.patch
keywords: patch
messages: 67965
nosy: Indy
severity: normal
status: open
title: tokenize.py improvements
type: performance
versions: Python 2.5
Added file: http://bugs.python.org/file10581/tokenize.py.patch

_______________________________________
Python tracker <report at bugs.python.org>
<http://bugs.python.org/issue3078>
_______________________________________