[New-bugs-announce] [issue34428] tokenize

Luke Kenneth Casson Leighton report at bugs.python.org
Sat Aug 18 06:29:27 EDT 2018

New submission from Luke Kenneth Casson Leighton <lkcl at lkcl.net>:


the following two lines of code are not parseable by tokenize.py:

co = re.compile(

the combination of:
* being split on two lines
* having a backslash inside quotes
* having a bracket inside quotes

is an edge-case that _tokenize cannot cope with.

components: Library (Lib)
messages: 323698
nosy: lkcl
priority: normal
severity: normal
status: open
title: tokenize
type: crash
versions: Python 3.6, Python 3.7

Python tracker <report at bugs.python.org>

More information about the New-bugs-announce mailing list