[Python-3000] Move to a "py3k" branch DONE

Fri Aug 10 09:31:29 CEST 2007

Bah, who needs sleep anyways.  This list of problems should be fairly
complete when running with -R.  (it skips the fatal error from
test_datetime though)

Code to trigger a leak:   b'\xff'.decode("utf8", "ignore")

Leaks:
test_array leaked [11, 11, 11] references, sum=33
test_bytes leaked [4, 4, 4] references, sum=12
test_codeccallbacks leaked [21, 21, 21] references, sum=63
test_codecs leaked [260, 260, 260] references, sum=780
test_ctypes leaked [-22, 43, 10] references, sum=31
test_multibytecodec leaked [72, 72, 72] references, sum=216
test_parser leaked [5, 5, 5] references, sum=15
test_unicode leaked [4, 4, 4] references, sum=12
test_xml_etree leaked [128, 128, 128] references, sum=384
test_xml_etree_c leaked [128, 128, 128] references, sum=384
test_zipimport leaked [29, 29, 29] references, sum=87

Failures with -R:

test test_collections failed -- errors occurred; run in verbose mode for details

test test_gzip failed -- Traceback (most recent call last):
 File "/home/neal/python/dev/py3k/Lib/test/test_gzip.py", line 77, in
test_many_append
   ztxt = zgfile.read(8192)
 File "/home/neal/python/dev/py3k/Lib/gzip.py", line 236, in read
   self._read(readsize)
 File "/home/neal/python/dev/py3k/Lib/gzip.py", line 301, in _read
   self._read_eof()
 File "/home/neal/python/dev/py3k/Lib/gzip.py", line 317, in _read_eof
   crc32 = read32(self.fileobj)
 File "/home/neal/python/dev/py3k/Lib/gzip.py", line 40, in read32
   return struct.unpack("<l", input.read(4))[0]
 File "/home/neal/python/dev/py3k/Lib/struct.py", line 97, in unpack
   return o.unpack(s)
struct.error: unpack requires a string argument of length 4

test test_runpy failed -- Traceback (most recent call last):
 File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 230,
in test_run_module
   self._check_module(depth)
 File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 168,
in _check_module
   d2 = run_module(mod_name) # Read from bytecode
 File "/home/neal/python/dev/py3k/Lib/runpy.py", line 72, in run_module
   raise ImportError("No module named %s" % mod_name)
ImportError: No module named runpy_test

test test_shelve failed -- errors occurred; run in verbose mode for details

test test_structmembers failed -- errors occurred; run in verbose mode
for details

test_univnewlines skipped -- This Python does not have universal newline support

Traceback (most recent call last):
  File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 222, in
handle_request
    self.process_request(request, client_address)
  File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 241, in
process_request
    self.finish_request(request, client_address)
  File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 254, in
finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 522, in __init__
    self.handle()
  File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 316, in handle
    self.handle_one_request()
  File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 303,
in handle_one_request
    if not self.parse_request(): # An error code has been sent, just exit
  File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 281,
in parse_request
    self.headers = self.MessageClass(self.rfile, 0)
  File "/home/neal/python/dev/py3k/Lib/mimetools.py", line 16, in __init__
    rfc822.Message.__init__(self, fp, seekable)
  File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 104, in __init__
    self.readheaders()
  File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 172, in readheaders
    headerseen = self.isheader(line)
  File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 202, in isheader
    return line[:i].lower()
AttributeError: 'bytes' object has no attribute 'lower'

On 8/9/07, Neal Norwitz <nnorwitz at gmail.com> wrote:
> I wonder if a lot of the refleaks may have the same cause as this one:
>
>   b'\xff'.decode("utf8", "ignore")
>
> No leaks jumped out at me.  Here is the rest of the leaks that have
> been reported so far.  I don't know how many have the same cause.
>
> test_multibytecodec leaked [72, 72, 72] references, sum=216
> test_parser leaked [5, 5, 5] references, sum=15
>
> The other failures that occurred with -R:
>
> test test_collections failed -- errors occurred; run in verbose mode for details
>
> test test_gzip failed -- Traceback (most recent call last):
>   File "/home/neal/python/dev/py3k/Lib/test/test_gzip.py", line 77, in
> test_many_append
>     ztxt = zgfile.read(8192)
>   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 236, in read
>     self._read(readsize)
>   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 301, in _read
>     self._read_eof()
>   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 317, in _read_eof
>     crc32 = read32(self.fileobj)
>   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 40, in read32
>     return struct.unpack("<l", input.read(4))[0]
>   File "/home/neal/python/dev/py3k/Lib/struct.py", line 97, in unpack
>     return o.unpack(s)
> struct.error: unpack requires a string argument of length 4
>
> test test_runpy failed -- Traceback (most recent call last):
>   File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 230,
> in test_run_module
>     self._check_module(depth)
>   File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 168,
> in _check_module
>     d2 = run_module(mod_name) # Read from bytecode
>   File "/home/neal/python/dev/py3k/Lib/runpy.py", line 72, in run_module
>     raise ImportError("No module named %s" % mod_name)
> ImportError: No module named runpy_test
>
> test_textwrap was the last test to complete.  test_thread was still running.
>
> n
> --
> On 8/9/07, Neal Norwitz <nnorwitz at gmail.com> wrote:
> > On 8/9/07, Guido van Rossum <guido at python.org> wrote:
> > > This is done. The new py3k branch is ready for business.
> > >
> > > Left to do:
> > >
> > > - switch the buildbot and the doc builder to use the new branch (Neal)
> >
> > I've updated to use the new branch.  I got the docs building, but
> > there are many more problems.  I won't re-enable the cronjob until
> > more things are working.
> >
> > > There are currently about 7 failing unit tests left:
> > >
> > > test_bsddb
> > > test_bsddb3
> > > test_email
> > > test_email_codecs
> > > test_email_renamed
> > > test_sqlite
> > > test_urllib2_localnet
> >
> > Ok, I disabled these, so if only they fail, mail shouldn't be sent
> > (when I enable the script).
> >
> > There are other problems:
> >  * had to kill test_poplib due to taking all cpu without progress
> >  * bunch of tests leak (./python ./Lib/test/regrtest.py -R 4:3:
> > test_foo test_bar ...)
> >  * at least one test fails with a fatal error
> >  * make install fails
> >
> > Here are the details (probably best to update the wiki with status
> > before people start working on these):
> >
> > I'm not sure what was happening with test_poplib.  I had to kill
> > test_poplib due to taking all cpu without progress.  When I ran it by
> > itself, it was fine.  So there was some bad interaction with another
> > test.
> >
> > Ref leaks and fatal error (see
> > http://docs.python.org/dev/3.0/results/make-test-refleak.out):
> > test_array leaked [11, 11, 11] references, sum=33
> > test_bytes leaked [4, 4, 4] references, sum=12
> > test_codeccallbacks leaked [21, 21, 21] references, sum=63
> > test_codecs leaked [260, 260, 260] references, sum=780
> > test_ctypes leaked [10, 10, 10] references, sum=30
> > Fatal Python error:
> > /home/neal/python/py3k/Modules/datetimemodule.c:1175 object at
> > 0xb60b19c8 has negative ref count -4
> >
> > There are probably more, but I haven't had a chance to run more after
> > test_datetime.
> >
> > This failure occurred while running with -R:
> >
> > test test_coding failed -- Traceback (most recent call last):
> >   File "/tmp/python-test-3.0/local/lib/python3.0/test/test_coding.py",
> > line 12, in test_bad_coding2
> >     self.verify_bad_module(module_name)
> >   File "/tmp/python-test-3.0/local/lib/python3.0/test/test_coding.py",
> > line 20, in verify_bad_module
> >     text = fp.read()
> >   File "/tmp/python-test-3.0/local/lib/python3.0/io.py", line 1148, in read
> >     res += decoder.decode(self.buffer.read(), True)
> >   File "/tmp/python-test-3.0/local/lib/python3.0/encodings/ascii.py",
> > line 26, in decode
> >     return codecs.ascii_decode(input, self.errors)[0]
> > UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position
> > 0: ordinal not in range(128)
> >
> >
> > See http://docs.python.org/dev/3.0/results/make-install.out for this failure:
> >
> > Compiling /tmp/python-test-3.0/local/lib/python3.0/test/test_pep263.py ...
> > Traceback (most recent call last):
> >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > 162, in <module>
> >     exit_status = int(not main())
> >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > 152, in main
> >     force, rx, quiet):
> >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > 89, in compile_dir
> >     if not compile_dir(fullname, maxlevels - 1, dfile, force, rx, quiet):
> >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > 65, in compile_dir
> >     ok = py_compile.compile(fullname, None, dfile, True)
> >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > 144, in compile
> >     py_exc = PyCompileError(err.__class__,err.args,dfile or file)
> >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > 49, in __init__
> >     tbtext = ''.join(traceback.format_exception_only(exc_type, exc_value))
> >   File "/tmp/python-test-3.0/local/lib/python3.0/traceback.py", line
> > 179, in format_exception_only
> >     filename = value.filename or "<string>"
> > AttributeError: 'tuple' object has no attribute 'filename'
> >
> > I'm guessing this came from the change in exception args handling?
> >
> >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > 144, in compile
> >     py_exc = PyCompileError(err.__class__,err.args,dfile or file)
> >
> > n
> >
>

[Python-3000] Move to a "py3k" branch *DONE*

[Python-3000] Move to a "py3k" branch DONE