Mailman 3 April 2018 - pypy-issue

Issue #2794: PIP: ssl module in Python is not available (pypy/pypy)
by Каримов Денис 08 Apr '18

08 Apr '18

New issue 2794: PIP: ssl module in Python is not available https://bitbucket.org/pypy/pypy/issues/2794/pip-ssl-module-in-python-is-not… Каримов Денис: Hi) I Have a problev with installing packages from PIP. What did i do: * I download pypy from pypy.org: Linux x86-64 binary (64bit, tar.bz2 built on Ubuntu 12.04 - 16.04) * Extract package to my `/opt/pypy3` folder * Create simlink from `/opt/pypy3/bin/pypy3` to `/usr/local/bin/pypy3` * Create virtualenv `virtualenv -p pypy3 pypy`, Also, i tried `virtualenv -p /opt/pypy3/bin/pypy3` * Activate virtualenv `source /pypy/bin/activate` When i fried to install packages from PIP, i take error: ``` $ pip install -r requirements.txt pip is configured with locations that require TLS/SSL, however the ssl module in Python is not available. Collecting Django==1.11.11 (from -r requirements.txt (line 1)) Could not fetch URL https://pypi.python.org/simple/django/: There was a problem confirming the ssl certificate: Can't connect to HTTPS URL because the SSL module is not available. - skipping Could not find a version that satisfies the requirement Django==1.11.11 (from -r requirements.txt (line 1)) (fromversions: ) No matching distribution found for Django==1.11.11 (from -r requirements.txt (line 1)) ``` Also, i tried `pip install Django`. What i'm missed?

1 0

Issue #2793: cpyext class subclasses lose attributes (pypy/pypy)
by pv 07 Apr '18

07 Apr '18

New issue 2793: cpyext class subclasses lose attributes https://bitbucket.org/pypy/pypy/issues/2793/cpyext-class-subclasses-lose-at… pv: On pypy3 (bcbefe2f5e14, 2018-04-05) the following code fails ``` import numpy as np from numpy.testing import assert_allclose x = np.matrix(np.random.rand(12, 12)) for j in range(20000): assert_allclose(x, x) ``` with ``` Traceback (most recent call last): File "<stdin>", line 2, in <module> File ".../env/site-packages/numpy/testing/nose_tools/utils.py", line 1396, in assert_allclose verbose=verbose, header=header, equal_nan=equal_nan) File ".../env/site-packages/numpy/testing/nose_tools/utils.py", line 769, in assert_array_compare reduced = val.ravel() File ".../env/site-packages/numpy/matrixlib/defmatrix.py", line 1020, in ravel return N.ndarray.ravel(self, order=order) File ".../env/site-packages/numpy/matrixlib/defmatrix.py", line 260, in __array_finalize__ if (isinstance(obj, matrix) and obj._getitem): return AttributeError: 'matrix' object has no attribute '_getitem' ``` The `matrix` class seem to lose some of its attributes, apparently when the jit kicks in. (I guess this was a known bug, but I didn't see an open issue for it.)

1 0

Issue #2792: _PyTuple_Resize crashes (regression in master) (pypy/pypy)
by Christoph Reiter 07 Apr '18

07 Apr '18

New issue 2792: _PyTuple_Resize crashes (regression in master) https://bitbucket.org/pypy/pypy/issues/2792/_pytuple_resize-crashes-regress… Christoph Reiter: This seems to crash with current master, but works with 5.10: ``` #!C PyObject *foo = PyTuple_New(1); _PyTuple_Resize (foo, 1); ```

1 0

Issue #2791: PyPy3: use W_IntObject instead of W_LongObject whenever possible (pypy/pypy)
by Ronan Lamy 06 Apr '18

06 Apr '18

New issue 2791: PyPy3: use W_IntObject instead of W_LongObject whenever possible https://bitbucket.org/pypy/pypy/issues/2791/pypy3-use-w_intobject-instead-of Ronan Lamy: In pypy3, we have 2 implementations for app-level int objects: W_IntObject and W_LongObject. The former is similar to Python 2 ints and JITs nicely, the latter wraps `rpython.rlib.rbigint` and is much slower. Issue #2785 fixed one case where using W_LongObject instead of W_IntObject caused a major user-visible slowdown, but there are many more places where we create W_LongObject indiscriminately. It would probably make sense to always try to convert to W_IntObject. We should at least make `space.newlong == space.newlong_from_rarith_int == space.newint`.

1 0

Issue #2790: pypy3 reading big file very slow (pypy/pypy)
by Ziqi Liu 06 Apr '18

06 Apr '18

New issue 2790: pypy3 reading big file very slow https://bitbucket.org/pypy/pypy/issues/2790/pypy3-reading-big-file-very-slow Ziqi Liu: I'm trying to use pypy3 to improve the efficiency of my code. The basic flow is reading a very big file and do some processing and output. pypy3 do improve the speed of the processing part, but very very slow in reading big file, much more slower than normal python3.....I suppose pypy3 doesn't compile it correctly, maybe I need to add some args to improve the reading file efficiency? I read the file with built-in open function ``` with open(inF1, 'r') as f: gtf = [line.split('\t') for line in f] ```

1 0

Issue #2789: Crash (cpyext?) in pypy3 (as of 2018-04-05) at numpy object array dealloc (pypy/pypy)
by pv 05 Apr '18

05 Apr '18

New issue 2789: Crash (cpyext?) in pypy3 (as of 2018-04-05) at numpy object array dealloc https://bitbucket.org/pypy/pypy/issues/2789/crash-cpyext-in-pypy3-as-of-201… pv: The following code crashes in pypy3 (bcbefe2f5e14, py3.5 branch as of 2018-04-05): https://github.com/pv/crash-pypy-1/tree/3e47f83de863ab21dc2dac4129639821046… using `pip install numpy==1.14.2`. pypy3-5.10.1 doesn't crash. gdb says ``` $ gdb --args pypy3 crash.py ... /home/pauli/prj/scipy/scipy/tmp/pypy3bug/idl.py:281: UserWarning: Not able to verify number of bytes from header warnings.warn("Not able to verify number of bytes from header") 0 [55 66] 1 [55 66] 2 [55 66] 3 [55 66] 4 [55 66] 5 [55 66] Program received signal SIGSEGV, Segmentation fault. (gdb) bt #0 0x00007ffff3e54168 in malloc_consolidate () from /lib64/libc.so.6 #1 0x00007ffff3e56f00 in _int_malloc () from /lib64/libc.so.6 #2 0x00007ffff3e587e3 in malloc () from /lib64/libc.so.6 #3 0x00007fffe479f00a in PyArray_IterNew (obj=0x1c3b430) at numpy/core/src/multiarray/iterators.c:290 #4 0x00007fffe483403e in PyArray_XDECREF (mp=0x1c3b430) at numpy/core/src/multiarray/refcount.c:168 #5 0x00007fffe46d81ec in array_dealloc (self=0x1c3b430) at numpy/core/src/multiarray/arrayobject.c:514 #6 0x00007ffff6429bfd in _PyPy_tuple_dealloc () from /usr/local/stow/pypy3+20180405/lib/pypy3+20180405/bin/libpypy3-c.so #7 0x00007ffff5b35d8a in pypy_g.rawrefcount_perform () from /usr/local/stow/pypy3+20180405/lib/pypy3+20180405/bin/libpypy3-c.so ... ``` That part of Numpy code is trying to DECREF items contained in an object array, but not clear if the issue is actually at that point. (Didn't manage to reduce this so far to a simpler testcase, sorry, just extracted from scipy test suite. Interestingly, numpy test suite doesn't crash.)

1 0

Issue #2788: cpyext: writing readonly attribute raises TypeError instead of AttributeError (pypy/pypy)
by Christoph Reiter 05 Apr '18

05 Apr '18

New issue 2788: cpyext: writing readonly attribute raises TypeError instead of AttributeError https://bitbucket.org/pypy/pypy/issues/2788/cpyext-writing-readonly-attribu… Christoph Reiter: An attribute defined through tp_getset with a PyGetSetDef struct where the attribute entry has a NULL setter leads to the following differences: CPython: ``` #!python Traceback (most recent call last): File "a.py", line 3, in <module> GObject.TYPE_STRING.name = "foo" AttributeError: attribute 'name' of 'gobject.GType' objects is not writable ``` PyPy: ``` #!python Traceback (most recent call last): File "a.py", line 3, in <module> GObject.TYPE_STRING.name = "foo" TypeError: readonly attribute ```

1 0

Issue #2787: pypy3 sockname error (pypy/pypy)
by Guillaume Valadon 05 Apr '18

05 Apr '18

New issue 2787: pypy3 sockname error https://bitbucket.org/pypy/pypy/issues/2787/pypy3-sockname-error Guillaume Valadon: I found an error with socket.sockname() while using pypy3 with Scapy. Here is how to reproduce it: ``` #!shell $ pypy3 --version Python 3.5.3 (3f6eaa010fce78cc7973bdc1dfdb95970f08fed2, Feb 12 2018, 22:20:44) [PyPy 5.10.1 with GCC 7.3.0] $ cat test_pypy3.py import socket ETH_P_ALL = 3 ins = socket.socket(socket.AF_PACKET, socket.SOCK_RAW, socket.htons(ETH_P_ALL)) ins.bind(("eno1", ETH_P_ALL)) print(ins.getsockname()) ins.close() $ sudo pypy3 test_pypy3.py [sudo] password for guedou: Traceback (most recent call last): File "test_pypy3.py", line 5, in <module> print(ins.getsockname()) UnicodeDecodeError: 'utf8' codec can't decode byte 0xdc in position 0: invalid continuation byte ``` The same code works fine with Python 2.7, 3.6 and pypy.

1 0

Issue #2786: pypy3 interpreter segfault somewhere around async/gc/finalization (pypy/pypy)
by Joshua Oreman 04 Apr '18

04 Apr '18

New issue 2786: pypy3 interpreter segfault somewhere around async/gc/finalization https://bitbucket.org/pypy/pypy/issues/2786/pypy3-interpreter-segfault-some… Joshua Oreman: The async_generator package provides pure-Python async generators with semantics as similar as possible to the native ones in CPython 3.6, with the goal of supporting PyPy and CPython 3.5. It's located at https://github.com/python-trio/async_generator. I'm working on adding support to async_generator for PEP 525 finalization hooks, and ran into a PyPy interpreter crash. I've merged all the dependencies into one file without any CPython-specifics, and it still reliably reproduces the crash, with or without `--jit off`; it's attached below. (The full change from which this was extracted is https://github.com/python-trio/async_generator/pull/14; it's not merged into async_generator yet.) I'm using OS X 10.13.3, with pypy3 installed using Homebrew: ``` $ pypy3 asyncgenissue.py mock_sleep mock_sleep Segmentation fault: 11 $ pypy3 Python 3.5.3 (3f6eaa010fce78cc7973bdc1dfdb95970f08fed2, Jan 13 2018, 18:14:01) [PyPy 5.10.1 with GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)] >>> print("\n".join("{}: {}".format(*elem) for elem in __import__("sys").pypy_translation_info.items())) objspace.usemodules.__builtin__: False [lots of other objspace.usemodules.something: True] objspace.usemodules.micronumpy: False objspace.allworkingmodules: True objspace.extmodules: None objspace.translationmodules: False objspace.soabi: None objspace.honor__builtins__: False objspace.disable_call_speedhacks: False objspace.disable_entrypoints: False objspace.fstrings: True objspace.hash: siphash24 objspace.std.withtproxy: True objspace.std.withprebuiltint: False objspace.std.prebuiltintfrom: -5 objspace.std.prebuiltintto: 100 objspace.std.withsmalllong: False objspace.std.withspecialisedtuple: True objspace.std.withliststrategies: True objspace.std.withmethodcachecounter: False objspace.std.methodcachesizeexp: 11 objspace.std.intshortcut: True objspace.std.optimized_list_getitem: True objspace.std.newshortcut: False translating: True translation.continuation: True translation.type_system: lltype translation.backend: c translation.shared: True translation.log: True translation.gc: incminimark translation.gctransformer: framework translation.gcremovetypeptr: True translation.gcrootfinder: shadowstack translation.thread: True translation.sandbox: False translation.rweakref: True translation.jit: True translation.jit_backend: auto translation.jit_profiler: off translation.jit_opencoder_model: normal translation.check_str_without_nul: True translation.verbose: True translation.cc: clang translation.profopt: False translation.profoptargs: None translation.instrument: False translation.countmallocs: False translation.fork_before: None translation.dont_write_c_files: False translation.instrumentctl: None translation.output: None translation.secondaryentrypoints: cpyext,main translation.dump_static_data_info: False translation.no__thread: True translation.make_jobs: 3 translation.list_comprehension_operations: True translation.withsmallfuncsets: 5 translation.taggedpointers: False translation.keepgoing: False translation.lldebug: False translation.lldebug0: False translation.lto: False translation.icon: pypy.ico translation.libname: None translation.backendopt.inline: True translation.backendopt.inline_threshold: 32.4 translation.backendopt.inline_heuristic: rpython.translator.backendopt.inline.inlining_heuristic translation.backendopt.print_statistics: False translation.backendopt.merge_if_blocks: True translation.backendopt.mallocs: True translation.backendopt.constfold: True translation.backendopt.profile_based_inline: None translation.backendopt.profile_based_inline_threshold: 32.4 translation.backendopt.profile_based_inline_heuristic: rpython.translator.backendopt.inline.inlining_heuristic translation.backendopt.clever_malloc_removal: False translation.backendopt.clever_malloc_removal_threshold: 32.4 translation.backendopt.clever_malloc_removal_heuristic: rpython.translator.backendopt.inline.inlining_heuristic translation.backendopt.remove_asserts: False translation.backendopt.really_remove_asserts: False translation.backendopt.stack_optimization: True translation.backendopt.storesink: True translation.backendopt.replace_we_are_jitted: False translation.backendopt.none: None translation.platform: host ``` I gave about an hour's effort to trying to get a debug version of pypy translated, and gave up when I got `[translation:ERROR] Exception: 'no_collect' function can trigger collection: <function _siphash24 at 0x000000010b2afcb8>`.

1 0

Issue #2785: PyPy3 slowdown when .pyc files are present (pypy/pypy)
by Maciej Fijalkowski 03 Apr '18

03 Apr '18

New issue 2785: PyPy3 slowdown when .pyc files are present https://bitbucket.org/pypy/pypy/issues/2785/pypy3-slowdown-when-pyc-files-a… Maciej Fijalkowski: Instructions here: https://gist.github.com/1st1/57d979e1e58948a7e523754a3d02a57d

1 0