ka-ping yee tokenizer.py

Karl Kobata karl.kobata at syncira.com
Mon Sep 15 22:47:03 CEST 2008

I have enjoyed using ka-ping yee's tokenizer.py.  I would like to replace
the readline parameter input with my own and pass a list of strings to the
tokenizer.  I understand it must be a callable object and iteratable but it
is obvious with errors I am getting, that this is not the only functions


 Being new to python, I am looking for help.

1)       I would like to create a class called 

a.       Class ReadStringList:

b.      I would like to pass this class a list.  Each element of the list is
a string.

c.       I would like to pass this <object>.readline( <listOfString> ) as
the 'readline' parameter for the tokenizer

d.      What functions other than __init__(self, inputList) and readline,
will I need to write?

e.       Where can I find the definition requirements for these other
functions required?

f.        Better yet, where can I find an example.


Please help.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20080915/d3c15573/attachment.html>

More information about the Python-list mailing list