Mailman 3 August 2013 - pypy-issue

[issue1185] [cpyext] Missing members in PyThreadState
by Colin Rice April 24, 2014

April 24, 2014

New submission from Colin Rice <dah4k0r(a)gmail.com>: It appears that pypy doesn't define certain members namely: exc_type, exc_value, exc_tracebacl, curexc_type, curexc_value, curexc_traceback. See http://hg.python.org/cpython/file/d129982c063d/Include/pystate.h Bug appeared when trying to build gevent. ---------- messages: 4466 nosy: c00w, pypy-issue priority: bug status: unread title: [cpyext] Missing members in PyThreadState ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1185> ________________________________________

5 8

[issue1022] dict.update significantly slower than series of dict.__setitem__
by Xavier Morel April 24, 2014

April 24, 2014

New submission from Xavier Morel <bugs.pypy.org(a)masklinn.net>: In CPython, as the number of keys grow dict.update settles at roughly half the speed of an equivalent bunch of dict[key]=value sequence: > python2.7 -m timeit -s 'd = {}' 'd["foo"] = 3' 'd["bar"] = 4' 'd["baz"] = 5' 'd["qux"] = 6' 'd["quux"] = 7' 1000000 loops, best of 3: 0.395 usec per loop > python2.7 -m timeit -s 'd = {}' 'd.update(foo=3, bar=4, baz=5, qux=6, quux=7)' 1000000 loops, best of 3: 0.657 usec per loop In Pypy, on the other hand, the difference in speed is on the order of 20x, even while setting 5 keys and dict.update is ~30% the speed of the equivalent call in CPython at almost 2µsec/loop to CPython's 0.66µsec/loop, while pypy's __setitem__ is more than 4 times faster than CPython: > pypy-c -m timeit -s 'd = {}' 'd["foo"] = 3' 'd["bar"] = 4' 'd["baz"] = 5' 'd["qux"] = 6' 'd["quux"] = 7' 10000000 loops, best of 3: 0.0877 usec per loop > pypy-c -m timeit -s 'd = {}' 'd.update(foo=3, bar=4, baz=5, qux=6, quux=7)' 100000 loops, best of 3: 1.95 usec per loop that kind-of bothers me, as I tend to use dict.update over long sequences of setitem for readability purpose. Now of course half a µsec per call is not a big difference in absolute, but still… Versions information: * OSX 10.6.8 * CPython 2.7.2 (Macports) * Pypy 1.7.0 Python 2.7.1 (?, Nov 24 2011, 10:57:50) (Macports) ---------- messages: 3814 nosy: masklinn, pypy-issue priority: performance bug status: unread title: dict.update significantly slower than series of dict.__setitem__ ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1022> ________________________________________

4 3

[issue824] Memory usage in time of pytest.py running under pypy
by Piotr Skamruk April 24, 2014

April 24, 2014

New submission from Piotr Skamruk <piotr.skamruk(a)gmail.com>: pypy-c (jit version) translated around 2011-08-02 machine with 4G ram, with ubuntu oneiric onboard python2.7 pytest.py pypy/module/_ssl/test after less than minute - done max ram usage around 700M pypy pytest.py pypy/module/_ssl/test after several minutes pypy eated whole ram, and kswapd goes crazy ---------- messages: 2913 nosy: jell, pypy-issue priority: bug status: unread title: Memory usage in time of pytest.py running under pypy ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue824> ________________________________________

2 1

[issue1093] PyPy list element del insert too slow
by raymin April 23, 2014

April 23, 2014

New submission from raymin <guo.raymin(a)gmail.com>: # testList.py L = [] i = 0 while i < 100000: L.append('k%d' % i) i += 1 i = 0 while i < 100000: if i & 1: k = L[0] del L[0] L.insert(i, k) else: k = L[i] del L[i] L.append(k) i += 1 print i, len(L) time python testList.py : 0m6.710s time pypy testList.py : 0m41.702s ---------- title: PyPy list element del insert to slow -> PyPy list element del insert too slow ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1093> ________________________________________

2 1

[issue1029] cpython test_subprocess.py fails
by Garen Parham April 23, 2014

April 23, 2014

New submission from Garen Parham <garen.p(a)gmail.com>: On Ubuntu Linux 11.10, pypy trunk currently fails one of the modified test_subproces.py unit tests like so: garen@ubuntu:~/dev/bins$ ~/dev/bins/pypy-c-jit-51842-457e2166648c-linux/bin/pypy ~/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib-python/modified- 2.7/test/test_subprocess.py ... ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/garen/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/garen/dev/bins//pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 Also, the test_subprocess.py shipped with the latest cpython 2.7.2.5 has several new tests that also fail: ====================================================================== ERROR: test_communicate_epipe_only_stdin (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 617, in test_communicate_epipe_only_stdin p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 729, in communicate self.stdin.write(input) IOError: [Errno 32] Broken pipe: '<fdopen>' ====================================================================== ERROR: test_close_fd_0 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 830, in test_close_fd_0 self.check_close_std_fds([0]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fd_1 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 833, in test_close_fd_1 self.check_close_std_fds([1]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fd_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 836, in test_close_fd_2 self.check_close_std_fds([2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_1 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 839, in test_close_fds_0_1 self.check_close_std_fds([0, 1]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_1_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 850, in test_close_fds_0_1_2 self.check_close_std_fds([0, 1, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_0_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 842, in test_close_fds_0_2 self.check_close_std_fds([0, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_close_fds_1_2 (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 845, in test_close_fds_1_2 self.check_close_std_fds([1, 2]) File "./Python-2.7.2/Lib/test/test_subprocess.py", line 821, in check_close_std_fds err = test_support.strip_python_stderr(err) AttributeError: 'module' object has no attribute 'strip_python_stderr' ====================================================================== ERROR: test_communicate_epipe (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 609, in test_communicate_epipe p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 740, in communicate return self._communicate(input) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1263, in _communicate stdout, stderr = self._communicate_with_select(input) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1365, in _communicate_with_select bytes_written = os.write(self.stdin.fileno(), chunk) OSError: [Errno 32] Broken pipe ====================================================================== ERROR: test_communicate_epipe_only_stdin (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 617, in test_communicate_epipe_only_stdin p.communicate("x" * 2**20) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 729, in communicate self.stdin.write(input) IOError: [Errno 32] Broken pipe: '<fdopen>' ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ====================================================================== FAIL: test_wait_when_sigchild_ignored (__main__.POSIXProcessTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 860, in test_wait_when_sigchild_ignored " non-zero with this error:\n%s" % stderr) AssertionError: sigchild_ignore.py exited non-zero with this error: Traceback (most recent call last): File "app_main.py", line 51, in run_toplevel File "/home/garen/dev/bins/Python- 2.7.2/Lib/test/subprocessdata/sigchild_ignore.py", line 6, in <module> subprocess.Popen([sys.executable, '-c', 'print("albatross")']).wait() File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 1247, in wait pid, sts = _eintr_retry_call(os.waitpid, self.pid, 0) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/subprocess.py", line 471, in _eintr_retry_call return func(*args) OSError: [Errno 10] No child processes ====================================================================== FAIL: test_executable_without_cwd (__main__.ProcessTestCaseNoPoll) ---------------------------------------------------------------------- Traceback (most recent call last): File "./Python-2.7.2/Lib/test/test_subprocess.py", line 163, in test_executable_without_cwd self.assertEqual(p.returncode, 47) AssertionError: 1 != 47 ---------------------------------------------------------------------- Ran 127 tests in 23.897s FAILED (failures=3, errors=10, skipped=14) Traceback (most recent call last): File "app_main.py", line 51, in run_toplevel File "./Python-2.7.2/Lib/test/test_subprocess.py", line 1053, in <module> test_main() File "./Python-2.7.2/Lib/test/test_subprocess.py", line 1049, in test_main test_support.run_unittest(*unit_tests) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_support.py", line 1138, in run_unittest _run_suite(suite) File "/home/garen/dev/bins/pypy-c-jit-51842-457e2166648c-linux/lib- python/modified-2.7/test/test_support.py", line 1092, in _run_suite raise TestFailed(err) TestFailed: multiple errors occurred At least a few of these appear to be related to some previously filed issues: https://bugs.pypy.org/issue934 https://bugs.pypy.org/issue828 ---------- messages: 3837 nosy: Garen, pypy-issue priority: bug release: ??? status: unread title: cpython test_subprocess.py fails ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1029> ________________________________________

4 4

[issue1031] Speed of a tiny arithmetic program
by Armin Rigo April 23, 2014

April 23, 2014

New submission from Armin Rigo <armin.rigo(a)gmail.com>: http://paste.pocoo.org/show/543141/ This program is not much faster with pypy. Even if I get rid of the obvious inefficiencies using divmod(..,2) and replace 2**r*d with d << r, the program ends up only twice as fast. Why? ---------- messages: 3845 nosy: arigo, pypy-issue priority: performance bug status: unread title: Speed of a tiny arithmetic program ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1031> ________________________________________

4 4

[issue1027] Do something with longs
by Fijal April 23, 2014

April 23, 2014

New submission from Fijal <fijall(a)gmail.com>: A bit no clue what, but performance of longs is fairly disastrous right now, so I suppose we should do something with it (not attaching any benchmarks, but *anything* is slow with them). ---------- messages: 3832 nosy: fijal, pypy-issue priority: performance bug status: unread title: Do something with longs ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue1027> ________________________________________

2 1

[issue999] rename virtualizable2 to virtualizable
by Carl Friedrich Bolz April 23, 2014

April 23, 2014

New submission from Carl Friedrich Bolz <cfbolz(a)gmx.de>: to make things slightly less confusing ---------- messages: 3703 nosy: cfbolz, pypy-issue priority: wish status: unread title: rename virtualizable2 to virtualizable ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue999> ________________________________________

1 1

[issue927] Task takes more time on nightly than CYthon 2.7
by Zira April 23, 2014

April 23, 2014

New submission from Zira <NeruYume(a)hotmail.com>: from itertools import combinations import time string = "ABCDEFGHIJKLMNOPQRSTUWXYZ" string = string.lower() minlen = 3 substrlen = 12 #Find combinations available letters can be arranged in at = time.clock() lookup = set() for i in range(minlen, substrlen+1): for comb in combinations(string, i): lookup.add("".join(sorted(comb))) lookup = list(lookup) lookup.sort(key=len, reverse=True) print time.clock()-at ### #This takes more time on pypy-c-jit-49069-62bc56457861-win32 than on CPython 2.7 (64 bit) Took 90 seconds on pypy-c-jit-49069-62bc56457861-win32 and 45 seconds on CPython 2.7 ---------- messages: 3423 nosy: Zira, pypy-issue priority: performance bug status: unread title: Task takes more time on nightly than CYthon 2.7 ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue927> ________________________________________

6 8

[issue821] __debug__ is always True
by dag April 23, 2014

April 23, 2014

New submission from dag <dag.odenhall(a)gmail.com>: Python 2.7.1 (b590cf6de419, Apr 30 2011, 02:00:34) [PyPy 1.5.0-alpha0 with GCC 4.4.3] on linux2 >>>> sys.flags.optimize, __debug__ (1, True) ---------- messages: 2909 nosy: dag, pypy-issue priority: bug release: 1.5 status: unread title: __debug__ is always True ________________________________________ PyPy bug tracker <tracker(a)bugs.pypy.org> <https://bugs.pypy.org/issue821> ________________________________________

3 3