Mailman 3 April 2013 - pypy-issue

[issue1445] Major regression since 2.0 beta
by Florian Apolloner April 26, 2014

April 26, 2014

New submission from Florian Apolloner <florian(a)apolloner.eu>: Alex asked me to open the bug, I am myself not 100% sure it's pypy's fault -- but I am somewhat out of debugging options. Django's testsuite gets a lot of memory allocation errors under pypy like: ====================================================================== ERROR: test_complex_app (admin_scripts.tests.ManageValidate) manage.py validate does not raise an ImportError validating a complex app with nested calls to load_app ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/florian/sources/django.git/tests/admin_scripts/tests.py", line 1073, in test_complex_app out, err = self.run_manage(args) File "/home/florian/sources/django.git/tests/admin_scripts/tests.py", line 176, in run_manage return self.run_test('./manage.py', args, settings_file) File "/home/florian/sources/django.git/tests/admin_scripts/tests.py", line 140, in run_test universal_newlines=True).communicate() File "/home/florian/sources/pypy-c-jit-63155-972e776a277f-linux64/lib-python/2.7/subprocess.py", line 679, in __init__ errread, errwrite) File "/home/florian/sources/pypy-c-jit-63155-972e776a277f-linux64/lib-python/2.7/subprocess.py", line 1147, in _execute_child self.pid = os.fork() OSError: [Errno 12] Cannot allocate memory This is on a 64 bit machine with 4 Gig of RAM, once in a while even oom_killer hits it… I am also seeing segfaults on the ci-server, but those appear to be fixed with the recent nightlies. ---------- messages: 5551 nosy: apollo13, pypy-issue priority: critical status: unread title: Major regression since 2.0 beta ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1445> ________________________________________

4 5

[issue1471] Re-enable strategies on py3k
by Philip Jenvey April 25, 2014

April 25, 2014

New submission from Philip Jenvey <pjenvey(a)underboss.org>: Most of list/set/dict etc strategies were disabled on py3k as they became pretty broken w/ the big bytes/unicode switch. We also lacked an rpython unicode type strategy at the time, but we have that now These need to be re-enabled before the final release, obviously for the sake of performance Many of the strategy tests were disabled in 2db1e0a806e2, but there are also some others. I believe they are all py3k_skip's ---------- assignedto: pjenvey messages: 5654 nosy: pypy-issue priority: performance bug status: unread title: Re-enable strategies on py3k ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1471> ________________________________________

1 2

[issue818] MySQLdb-python 1.2.3 segmentation fault on PyPy 1.5 OSX 64bit
by Didip Kerabat April 25, 2014

April 25, 2014

New submission from Didip Kerabat <didipk(a)gmail.com>: I'm not sure if this would help, but I documented the crash report here: https://gist.github.com/1120902 ---------- messages: 2901 nosy: didip, pypy-issue priority: bug status: unread title: MySQLdb-python 1.2.3 segmentation fault on PyPy 1.5 OSX 64bit ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue818> ________________________________________

3 2

[issue1421] pypy latest trips over pyftpdlib-1.0.1 storage related tests
by Ian Delaney April 25, 2014

April 25, 2014

New submission from Ian Delaney <della5(a)iinet.com.au>: in the test suite comprising of all of 2 test files, it trips over here test_appe_rest (__main__.TestFtpStoreDataMProcMixin) ... ok test_failing_rest_on_stor (__main__.TestFtpStoreDataMProcMixin) ... ok test_quit_during_transfer (__main__.TestFtpStoreDataMProcMixin) ... ok test_rest_on_stor (__main__.TestFtpStoreDataMProcMixin) ... ^X^C It persistently hangs on (a number of) tests testing stor(age) of data and I have no idea where to start. fijal, you made a package called ctypes_configure who know when. It's been made a dep to tests for pyzmq but I can't add it to portage since it lacks both a live homepage and a license. Plse shoer it up. ---------- assignedto: fijal messages: 5447 nosy: fijal, idella5, pypy-issue priority: performance bug release: 2.0 status: chatting title: pypy latest trips over pyftpdlib-1.0.1 storage related tests ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1421> ________________________________________

5 8

[issue1185] [cpyext] Missing members in PyThreadState
by Colin Rice April 24, 2014

April 24, 2014

New submission from Colin Rice <dah4k0r(a)gmail.com>: It appears that pypy doesn't define certain members namely: exc_type, exc_value, exc_tracebacl, curexc_type, curexc_value, curexc_traceback. See http://hg.python.org/cpython/file/d129982c063d/Include/pystate.h Bug appeared when trying to build gevent. ---------- messages: 4466 nosy: c00w, pypy-issue priority: bug status: unread title: [cpyext] Missing members in PyThreadState ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1185> ________________________________________

5 8

[issue1022] dict.update significantly slower than series of dict.__setitem__
by Xavier Morel April 24, 2014

April 24, 2014

New submission from Xavier Morel <bugs.pypy.org(a)masklinn.net>: In CPython, as the number of keys grow dict.update settles at roughly half the speed of an equivalent bunch of dict[key]=value sequence: > python2.7 -m timeit -s 'd = {}' 'd["foo"] = 3' 'd["bar"] = 4' 'd["baz"] = 5' 'd["qux"] = 6' 'd["quux"] = 7' 1000000 loops, best of 3: 0.395 usec per loop > python2.7 -m timeit -s 'd = {}' 'd.update(foo=3, bar=4, baz=5, qux=6, quux=7)' 1000000 loops, best of 3: 0.657 usec per loop In Pypy, on the other hand, the difference in speed is on the order of 20x, even while setting 5 keys and dict.update is ~30% the speed of the equivalent call in CPython at almost 2µsec/loop to CPython's 0.66µsec/loop, while pypy's __setitem__ is more than 4 times faster than CPython: > pypy-c -m timeit -s 'd = {}' 'd["foo"] = 3' 'd["bar"] = 4' 'd["baz"] = 5' 'd["qux"] = 6' 'd["quux"] = 7' 10000000 loops, best of 3: 0.0877 usec per loop > pypy-c -m timeit -s 'd = {}' 'd.update(foo=3, bar=4, baz=5, qux=6, quux=7)' 100000 loops, best of 3: 1.95 usec per loop that kind-of bothers me, as I tend to use dict.update over long sequences of setitem for readability purpose. Now of course half a µsec per call is not a big difference in absolute, but still… Versions information: * OSX 10.6.8 * CPython 2.7.2 (Macports) * Pypy 1.7.0 Python 2.7.1 (?, Nov 24 2011, 10:57:50) (Macports) ---------- messages: 3814 nosy: masklinn, pypy-issue priority: performance bug status: unread title: dict.update significantly slower than series of dict.__setitem__ ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1022> ________________________________________

4 3

[issue824] Memory usage in time of pytest.py running under pypy
by Piotr Skamruk April 24, 2014

April 24, 2014

New submission from Piotr Skamruk <piotr.skamruk(a)gmail.com>: pypy-c (jit version) translated around 2011-08-02 machine with 4G ram, with ubuntu oneiric onboard python2.7 pytest.py pypy/module/_ssl/test after less than minute - done max ram usage around 700M pypy pytest.py pypy/module/_ssl/test after several minutes pypy eated whole ram, and kswapd goes crazy ---------- messages: 2913 nosy: jell, pypy-issue priority: bug status: unread title: Memory usage in time of pytest.py running under pypy ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue824> ________________________________________

2 1

[issue1093] PyPy list element del insert too slow
by raymin April 23, 2014

April 23, 2014

New submission from raymin <guo.raymin(a)gmail.com>: # testList.py L = [] i = 0 while i < 100000: L.append('k%d' % i) i += 1 i = 0 while i < 100000: if i & 1: k = L[0] del L[0] L.insert(i, k) else: k = L[i] del L[i] L.append(k) i += 1 print i, len(L) time python testList.py : 0m6.710s time pypy testList.py : 0m41.702s ---------- title: PyPy list element del insert to slow -> PyPy list element del insert too slow ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1093> ________________________________________

2 1

[issue1029] cpython test_subprocess.py fails
by Garen Parham April 23, 2014

April 23, 2014

New submission from Garen Parham <garen.p(a)gmail.com>: On Ubuntu Linux 11.10, pypy trunk currently fails one of the modified test_subproces.py unit tests like so: garen@ubuntu:~/dev/bins$ ~/dev/bins/pypy-c-jit-51842-457e2166648c-linux/bin/pypy ~/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib-python/modified- 2.7/test/test_subprocess.py ... ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/garen/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/garen/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 Also, the test_subprocess.py shipped with the latest cpython 2.7.2.5 has several new tests that also fail: ====================================================================== ERROR: test_communicate_epipe_only_stdin (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 617, in test_communicate_epipe_only_stdin p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 729, in communicate self.stdin.write(input) IOError: [Errno 32] Broken pipe: '<fdopen>' ====================================================================== ERROR: test_close_fd_0 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 830, in test_close_fd_0 self.check_close_std_fds([0]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fd_1 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 833, in test_close_fd_1 self.check_close_std_fds([1]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fd_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 836, in test_close_fd_2 self.check_close_std_fds([2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_1 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 839, in test_close_fds_0_1 self.check_close_std_fds([0, 1]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_1_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 850, in test_close_fds_0_1_2 self.check_close_std_fds([0, 1, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 842, in test_close_fds_0_2 self.check_close_std_fds([0, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_1_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 845, in test_close_fds_1_2 self.check_close_std_fds([1, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_communicate_epipe (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 609, in test_communicate_epipe p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 740, in communicate return self._communicate(input) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1263, in _communicate stdout, stderr = self._communicate_with_select(input) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1365, in _communicate_with_select bytes_written = os.write(self.stdin.fileno(), chunk) OSError: [Errno 32] Broken pipe ====================================================================== ERROR: test_communicate_epipe_only_stdin (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 617, in test_communicate_epipe_only_stdin p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 729, in communicate self.stdin.write(input) IOError: [Errno 32] Broken pipe: '<fdopen>' ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ====================================================================== FAIL: test_wait_when_sigchild_ignored (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 860, in test_wait_when_sigchild_ignored " non-zero with this error:\n%s" % stderr) AssertionError: sigchild_ignore.py exited non-zero with this error: Traceback (most recent call last): File "app_main.py", line 51, in run_toplevel File "/home/garen/dev/bins/Python- 2.7.2/Lib/test/subprocessdata/sigchild_ignore.py", line 6, in <module> subprocess.Popen([sys.executable, '-c', 'print("albatross")']).wait() File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1247, in wait pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 471, in _eintr_retry_call return func(*args) OSError: [Errno 10] No child processes ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ---------------------------------------------------------------------- Ran 127 tests in 23.897s FAILED (failures=3, errors=10, skipped=14) Traceback (most recent call last): File "app_main.py", line 51, in run_toplevel File "./Python-2.7.2/Lib/test/test_subprocess.py", line 1053, in <module> test_main() File "./Python-2.7.2/Lib/test/test_subprocess.py", line 1049, in test_main test_support.run_unittest(*unit_tests) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_support.py", line 1138, in run_unittest _run_suite(suite) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_support.py", line 1092, in _run_suite raise TestFailed(err) TestFailed: multiple errors occurred At least a few of these appear to be related to some previously filed issues: https://bugs.pypy.org/issue934 https://bugs.pypy.org/issue828 ---------- messages: 3837 nosy: Garen, pypy-issue priority: bug release: ??? status: unread title: cpython test_subprocess.py fails ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1029> ________________________________________

4 4

[issue1031] Speed of a tiny arithmetic program
by Armin Rigo April 23, 2014

April 23, 2014

New submission from Armin Rigo <armin.rigo(a)gmail.com>: http://paste.pocoo.org/show/543141/ This program is not much faster with pypy. Even if I get rid of the obvious inefficiencies using divmod(..,2) and replace 2**r*d with d << r, the program ends up only twice as fast. Why? ---------- messages: 3845 nosy: arigo, pypy-issue priority: performance bug status: unread title: Speed of a tiny arithmetic program ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1031> ________________________________________

4 4