Where find regexs needed to build lexical analyzer for Python source code?

Chris Seberino cseberino at gmail.com
Fri Sep 11 20:13:03 CEST 2009

I'd like to build a lexer aka lexical analyzer aka tokenizer for
Python source code as a learning exercise.

Where can I find the regexs that define the tokens of Python source?
(I am aware of tokenizer.py but I was hoping there was a web page w/ a
list somewhere.)


More information about the Python-list mailing list