Where regexs listed for Python language's tokenizer/lexer?

Paul McGuire ptmcg at austin.rr.com
Sat Sep 12 16:58:11 EDT 2009


On Sep 12, 1:10 am, Chris Seberino <cseber... at gmail.com> wrote:
> Where regexs listed for Python language's tokenizer/lexer?
>
> If I'm not mistaken, the grammar is not sufficient to specify the
> language....
> you also need to specify the regexs that define the tokens
> right?..where is that?

I think the OP is asking for the regexs that define the terminals
referenced in the Python grammar, similar to those found in yacc token
definitions.  He's not implying that there are regexs that implement
the whole grammar.

-- Paul



More information about the Python-list mailing list