[Python-checkins] python/dist/src/Misc NEWS,1.1286,1.1287

doerwalter at users.sourceforge.net doerwalter at users.sourceforge.net
Thu Apr 21 23:32:06 CEST 2005

Update of /cvsroot/python/python/dist/src/Misc
In directory sc8-pr-cvs1.sourceforge.net:/tmp/cvs-serv20403/Misc

Modified Files:
Log Message:
If the data read from the bytestream in readline() ends in a '\r' read one more
byte, even if the user has passed a size parameter. This extra byte shouldn't
cause a buffer overflow in the tokenizer. The original plan was to return a line
ending in '\r', which might be recognizable as a complete line and skip any '\n'
that was read afterwards. Unfortunately this didn't work, as the tokenizer only
recognizes '\n' as line ends, which in turn lead to joined lines and
SyntaxErrors, so this special treatment of a split '\r\n' has been dropped. (It
can only happen with a temporarily exhausted bytestream now anyway.)
Fixes parts of SF bugs #1163244 and #1175396.

Index: NEWS
RCS file: /cvsroot/python/python/dist/src/Misc/NEWS,v
retrieving revision 1.1286
retrieving revision 1.1287
diff -u -d -r1.1286 -r1.1287
--- NEWS	19 Apr 2005 23:43:37 -0000	1.1286
+++ NEWS	21 Apr 2005 21:32:00 -0000	1.1287
@@ -266,6 +266,12 @@
 - Bug #1149508: ``textwrap`` now handles hyphenated numbers (eg. "2004-03-05")
+- Partial fixes for SF bugs #1163244 and #1175396: If a chunk read by
+  ``codecs.StreamReader.readline()`` has a trailing "\r", read one more
+  character even if the user has passed a size parameter to get a proper
+  line ending. Remove the special handling of a "\r\n" that has been split
+  between two lines.

More information about the Python-checkins mailing list