tokenize module

Tim Roberts timr at
Mon Jun 29 23:42:22 EDT 2009

bootkey <cook_jim at> wrote:
>Thanks for the reply.  I wonder why the tokenizer classifies all
>operators simply as OP, instead of the various operators listed in the
>tok_name dictionary.

I imagine it's just an exercise left to the reader.  It's not that hard of
an extension.
Tim Roberts, timr at
Providenza & Boekelheide, Inc.

More information about the Python-list mailing list