[Python-checkins] python/dist/src/Misc NEWS,1.1299,1.1300

rhettinger@users.sourceforge.net rhettinger at users.sourceforge.net
Fri Jun 10 13:05:20 CEST 2005


Update of /cvsroot/python/python/dist/src/Misc
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv2829/Misc

Modified Files:
	NEWS 
Log Message:
Add untokenize() function to allow full round-trip tokenization.

Should significantly enhance the utility of the module by supporting
the creation of tools that modify the token stream and writeback the
modified result.



Index: NEWS
===================================================================
RCS file: /cvsroot/python/python/dist/src/Misc/NEWS,v
retrieving revision 1.1299
retrieving revision 1.1300
diff -u -d -r1.1299 -r1.1300
--- NEWS	4 Jun 2005 09:20:03 -0000	1.1299
+++ NEWS	10 Jun 2005 11:05:16 -0000	1.1300
@@ -141,6 +141,11 @@
 Library
 -------
 
+- The tokenize module has a new untokenize() function to support a full
+  roundtrip from lexed tokens back to Python sourcecode.  In addition,
+  the generate_tokens() function now accepts a callable argument that
+  terminates by raising StopIteration.
+
 - Bug #1196315: fix weakref.WeakValueDictionary constructor.
 
 - Bug #1213894: os.path.realpath didn't resolve symlinks that were the first



More information about the Python-checkins mailing list