Where find regexs needed to build lexical analyzer for Python source code?

Hao Lian me at haolian.org
Sat Sep 12 06:41:18 CEST 2009

Chris Seberino writes with great flourish:

> I'd like to build a lexer aka lexical analyzer aka tokenizer for
> Python source code as a learning exercise.
> Where can I find the regexs that define the tokens of Python source?
> (I am aware of tokenizer.py but I was hoping there was a web page w/ a
> list somewhere.)
> cs

The tokenize library! bum bum bum


More information about the Python-list mailing list