Mailman 3 June 2018 - pypy-issue

Issue #2853: Build fails on FreeBSD 11.2 x64 (pypy/pypy)
by Babak Farrokhi 30 Jun '18

30 Jun '18

New issue 2853: Build fails on FreeBSD 11.2 x64 https://bitbucket.org/pypy/pypy/issues/2853/build-fails-on-freebsd-112-x64 Babak Farrokhi: ```text $ uname -a FreeBSD dev4 11.2-RELEASE FreeBSD 11.2-RELEASE #0 r335510: Fri Jun 22 04:32:14 UTC 2018 root@releng2.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 $ tar zxf pypy3-v6.0.0-src.tar.bz2 $ cd pypy3-v6.0.0-src/pypy/goal/ $ pypy ../../rpython/bin/rpython -Ojit [translation:info] 2.7.13 (0e7ea4fe15e82d5124e805e2e4a37cae1a402d4b, Jun 23 2018, 01:20:20) [PyPy 5.10.0 with GCC 4.2.1 Compatible FreeBSD Clang 4.0.0 (tags/RELEASE_400/final 297347)] [platform:msg] Set platform with 'host' cc=None, using cc='clang', version='Unknown' [translation:info] Translating target as defined by targetpypystandalone [translation] PyPy config object: [translation] [objspace] [std] intshortcut = True optimized_list_getitem = True withspecialisedtuple = True [usemodules] __pypy__ = True _ast = True _cffi_backend = True _codecs = True _collections = True _continuation = True _csv = True _jitlog = True _lsprof = True _md5 = True _minimal_curses = True _multibytecodec = True _multiprocessing = True _pickle_support = True _posixsubprocess = True _pypyjson = True _random = True _rawffi = True _socket = True _sre = True _string = True _testing = True _vmprof = True _weakref = True array = True atexit = True binascii = True bz2 = True cmath = True cpyext = True crypt = True errno = True faulthandler = True fcntl = True gc = True imp = True marshal = True math = True mmap = True parser = True pwd = True pyexpat = True pypyjit = True select = True signal = True struct = True symbol = True termios = True thread = True time = True token = True unicodedata = True zipimport = True zlib = True [translation] translate.py configuration: [translation] [translate] opt = jit [translation] translation configuration: [translation] [translation] check_str_without_nul = True continuation = True gc = incminimark gcrootfinder = shadowstack gctransformer = framework icon = pypy.ico jit = True list_comprehension_operations = True secondaryentrypoints = cpyext,main shared = True thread = True type_system = lltype withsmallfuncsets = 5 [translation:info] Annotating&simplifying... [1c00] {translation-task starting annotate [translation:info] with policy: pypy.tool.ann_override.PyPyAnnotatorPolicy ...snip... [Timer] Timings: [Timer] annotate --- 268.0 s [Timer] ========================================== [Timer] Total: --- 268.0 s [translation:info] Error: File "/root/pypy3-v6.0.0-src/rpython/translator/goal/translate.py", line 318, in main drv.proceed(goals) File "/root/pypy3-v6.0.0-src/rpython/translator/driver.py", line 554, in proceed result = self._execute(goals, task_skip = self._maybe_skip()) File "/root/pypy3-v6.0.0-src/rpython/translator/tool/taskengine.py", line 114, in _execute res = self._do(goal, taskcallable, *args, **kwds) File "/root/pypy3-v6.0.0-src/rpython/translator/driver.py", line 278, in _do res = func() File "/root/pypy3-v6.0.0-src/rpython/translator/driver.py", line 315, in task_annotate s = annotator.build_types(self.entry_point, self.inputtypes) File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 92, in build_types return self.build_graph_types(flowgraph, inputs_s, complete_now=complete_now) File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 140, in build_graph_types self.complete() File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 229, in complete self.complete_pending_blocks() File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 224, in complete_pending_blocks self.processblock(graph, block) File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 398, in processblock self.flowin(graph, block) File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 501, in flowin self.consider_op(op) File "/root/pypy3-v6.0.0-src/rpython/annotator/annrpython.py", line 653, in consider_op resultcell = op.consider(self) File "/root/pypy3-v6.0.0-src/rpython/flowspace/operation.py", line 104, in consider return spec(annotator, *self.args) File "/root/pypy3-v6.0.0-src/rpython/annotator/unaryop.py", line 118, in simple_call_SomeObject return s_func.call(argspec) File "/root/pypy3-v6.0.0-src/rpython/annotator/unaryop.py", line 978, in call return bookkeeper.pbc_call(self, args) File "/root/pypy3-v6.0.0-src/rpython/annotator/bookkeeper.py", line 535, in pbc_call results.append(desc.pycall(whence, args, s_previous_result, op)) File "/root/pypy3-v6.0.0-src/rpython/annotator/description.py", line 398, in pycall s_result = self.specialize(inputcells, op) File "/root/pypy3-v6.0.0-src/rpython/annotator/description.py", line 281, in specialize return self.specializer(self, inputcells) File "/root/pypy3-v6.0.0-src/rpython/annotator/specialize.py", line 303, in memo _, _, memotable = memotables.find(firstvalues) File "/root/pypy3-v6.0.0-src/rpython/tool/algo/unionfind.py", line 48, in find info = self.info_factory(obj) File "/root/pypy3-v6.0.0-src/rpython/annotator/specialize.py", line 293, in compute_one_result value = func(*args) File "/root/pypy3-v6.0.0-src/rpython/rlib/rarithmetic.py", line 154, in _should_widen_type r_class = rffi.platform.numbertype_to_rclass[tp] [translation:ERROR] KeyError: <Void> Processing block: block@28[n_1] is a <class 'rpython.flowspace.flowcontext.SpamBlock'> in (rpython.rlib.rarithmetic:139)widen__NoneType containing the following operations: v805 = simple_call((function typeOf), n_1) v806 = simple_call((function _should_widen_type), v805) v807 = bool(v806) --end-- [translation] start debugger... > /root/pypy3-v6.0.0-src/rpython/rlib/rarithmetic.py(154)_should_widen_type() -> r_class = rffi.platform.numbertype_to_rclass[tp] (Pdb+) ```

1 0

Issue #2852: Prebuild binary for Rasbian referencing unavailable libs (pypy/pypy)
by Fredrik Chabot 28 Jun '18

28 Jun '18

New issue 2852: Prebuild binary for Rasbian referencing unavailable libs https://bitbucket.org/pypy/pypy/issues/2852/prebuild-binary-for-rasbian-ref… Fredrik Chabot: root@nmt-nmt-99:~# ldd ./pypy2-v6.0.0-linux-armhf-raspbian/bin/pypy linux-vdso.so.1 (0x7ef1e000) /usr/lib/arm-linux-gnueabihf/libarmmem.so (0x76efb000) libpypy-c.so => /root/./pypy2-v6.0.0-linux-armhf-raspbian/bin/libpypy-c.so (0x74478000) libpthread.so.0 => /lib/arm-linux-gnueabihf/libpthread.so.0 (0x7444f000) libc.so.6 => /lib/arm-linux-gnueabihf/libc.so.6 (0x74310000) libutil.so.1 => /lib/arm-linux-gnueabihf/libutil.so.1 (0x742fd000) libdl.so.2 => /lib/arm-linux-gnueabihf/libdl.so.2 (0x742ea000) libm.so.6 => /lib/arm-linux-gnueabihf/libm.so.6 (0x7426b000) libz.so.1 => /lib/arm-linux-gnueabihf/libz.so.1 (0x74244000) ** libssl.so.1.0.0 => not found libcrypto.so.1.0.0 => not found ** libexpat.so.1 => /lib/arm-linux-gnueabihf/libexpat.so.1 (0x74212000) libcrypt.so.1 => /lib/arm-linux-gnueabihf/libcrypt.so.1 (0x741d3000) librt.so.1 => /lib/arm-linux-gnueabihf/librt.so.1 (0x741bc000) libbz2.so.1.0 => /lib/arm-linux-gnueabihf/libbz2.so.1.0 (0x7419c000) ** libffi.so.5 => not found** libncurses.so.5 => /lib/arm-linux-gnueabihf/libncurses.so.5 (0x74170000) libtinfo.so.5 => /lib/arm-linux-gnueabihf/libtinfo.so.5 (0x74141000) libgcc_s.so.1 => /lib/arm-linux-gnueabihf/libgcc_s.so.1 (0x74114000) /lib/ld-linux-armhf.so.3 (0x76f11000) libssl/crypto dependency is probably survivable with a symlink to the libssl.so.1.0.2 I doubt the available libffi.so.6 will do.

1 0

Issue #2851: Is pypy really supporting pandas now? (pypy/pypy)
by Haotian_Wu 24 Jun '18

24 Jun '18

New issue 2851: Is pypy really supporting pandas now? https://bitbucket.org/pypy/pypy/issues/2851/is-pypy-really-supporting-panda… Haotian_Wu: Hi talented guys, I am trying to use pandas in pypy right now, since I see the notice "PyPy v5.9 Released, Now Supports Pandas, NumPy". I am using "Python2.7 compatible PyPy 6.0.0, Windows binary (32bit) " and Python 2.7. I have successfully installed numpy on pypy. But when I try to install pandas using different ways, there are always errors and I don't know how to fix that. For example, when I use "pip install pandas" under pypy bin, it shows something like this: C:\Users\Haotian Wu\Downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\bin>pip install pandas Collecting pandas Using cached https://files.pythonhosted.org/packages/27/85/f9e4f0e47a6f1410b1d737b74a176… Requirement already satisfied: python-dateutil>=2.5.0 in c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\site-packages (from pandas) (2.7.3) Requirement already satisfied: pytz>=2011k in c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\site-packages (from pandas) (2018.4) Requirement already satisfied: numpy>=1.9.0 in c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\site-packages (from pandas) (1.10.0) Requirement already satisfied: six>=1.5 in c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\site-packages (from python-dateutil>=2.5.0->pandas) (1.11.0) Installing collected packages: pandas Running setup.py install for pandas ... error Complete output from command "c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\pypy.exe" -u -c "import setuptools, tokenize;__file__='c:\\users\\haotia~1\\appdata\\local\\temp\\pip-install-wpq53k\\pandas\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record c:\users\haotia~1\appdata\local\temp\pip-record-tacmug\install-record.txt --single-version-externally-managed --compile: ... error: command 'C:\\Users\\Haotian Wu\\AppData\\Local\\Programs\\Common\\Microsoft\\Visual C++ for Python\\9.0\\VC\\Bin\\cl.exe' failed with exit status 2 ---------------------------------------- **Command ""c:\users\haotian wu\downloads\pypy2-v6.0.0-win32\pypy2-v6.0.0-win32\pypy.exe" -u -c "import setuptools, tokenize;__file__='c:\\users\\haotia~1\\appdata\\local\\temp\\pip-install-wpq53k\\pandas\\setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record c:\users\haotia~1\appdata\local\temp\pip-record-tacmug\install-record.txt --single-version-externally-managed --compile" failed with error code 1 in c:\users\haotia~1\appdata\local\temp\pip-install-wpq53k\pandas\** Is pypy supporting pandas now? If yes, how could I install pandas on my windows system? Could you please provide some specific approaches? Thanks for your help. Look forward to your early reply.

1 0

Issue #2850: Error when creating a Pool() - Python Multiprocessing standard library - Windows 32 bit (pypy/pypy)
by Francesco 20 Jun '18

20 Jun '18

New issue 2850: Error when creating a Pool() - Python Multiprocessing standard library - Windows 32 bit https://bitbucket.org/pypy/pypy/issues/2850/error-when-creating-a-pool-pyth… Francesco: PyPy reports an error when I try to create a Pool with multiprocessing standard library. Python 3.5.3 and PyPy 6.0.0: ``` #!python OSError: [Errno 997] L'evento di I/O sovrapposto è in corso ``` Python 3.5.3 and PyPy 5.10.1: ``` #!python ImportError: cannot import name 'WAIT_ABANDONED_0' ``` In order to reproduce the problem you can simply execute this little bit of code: ``` #!python from multiprocessing import Pool foo = Pool() ``` Any idea? Thanks

1 0

Issue #2849: Syntax bug for keyword-only arguments in function definition (pypy/pypy)
by sjdv1982 16 Jun '18

16 Jun '18

New issue 2849: Syntax bug for keyword-only arguments in function definition https://bitbucket.org/pypy/pypy/issues/2849/syntax-bug-for-keyword-only-arg… sjdv1982: Function definition below (with the comma at the end) is valid syntax for cpython3, not for pypy3. [code ``` #!python def test(self, *, b, c,): pass ``` PyPy version: Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:10:04) [PyPy 6.0.0 with GCC 6.2.0 20160901] on linux

1 0

Issue #2848: GNU/Hurd port (pypy/pypy)
by Samuel Thibault 16 Jun '18

16 Jun '18

New issue 2848: GNU/Hurd port https://bitbucket.org/pypy/pypy/issues/2848/gnu-hurd-port Samuel Thibault: Hello, I'm trying to port pypy to GNU/Hurd, I have used the attached patch and gotten the build to proceed, but ended up with this: [3c15] translation-task} [translation:info] Error: File "/var/tmp/pypy-6.0.0+dfsg/rpython/translator/goal/translate.py", line 318, in main drv.proceed(goals) File "/var/tmp/pypy-6.0.0+dfsg/rpython/translator/driver.py", line 554, in proceed result = self._execute(goals, task_skip = self._maybe_skip()) File "/var/tmp/pypy-6.0.0+dfsg/rpython/translator/tool/taskengine.py", line 114, in _execute res = self._do(goal, taskcallable, *args, **kwds) File "/var/tmp/pypy-6.0.0+dfsg/rpython/translator/driver.py", line 278, in _do res = func() File "/var/tmp/pypy-6.0.0+dfsg/rpython/translator/driver.py", line 315, in task_annotate s = annotator.build_types(self.entry_point, self.inputtypes) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 92, in build_types return self.build_graph_types(flowgraph, inputs_s, complete_now=complete_now) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 140, in build_graph_types self.complete() File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 229, in complete self.complete_pending_blocks() File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 224, in complete_pending_blocks self.processblock(graph, block) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 398, in processblock self.flowin(graph, block) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 501, in flowin self.consider_op(op) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/annrpython.py", line 653, in consider_op resultcell = op.consider(self) File "/var/tmp/pypy-6.0.0+dfsg/rpython/flowspace/operation.py", line 104, in consider return spec(annotator, *self.args) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/unaryop.py", line 118, in simple_call_SomeObject return s_func.call(argspec) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/unaryop.py", line 978, in call return bookkeeper.pbc_call(self, args) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/bookkeeper.py", line 535, in pbc_call results.append(desc.pycall(whence, args, s_previous_result, op)) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/description.py", line 398, in pycall s_result = self.specialize(inputcells, op) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/description.py", line 281, in specialize return self.specializer(self, inputcells) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/specialize.py", line 303, in memo _, _, memotable = memotables.find(firstvalues) File "/var/tmp/pypy-6.0.0+dfsg/rpython/tool/algo/unionfind.py", line 48, in find info = self.info_factory(obj) File "/var/tmp/pypy-6.0.0+dfsg/rpython/annotator/specialize.py", line 293, in compute_one_result value = func(*args) File "/var/tmp/pypy-6.0.0+dfsg/rpython/rlib/rarithmetic.py", line 154, in _should_widen_type r_class = rffi.platform.numbertype_to_rclass[tp] [translation:ERROR] KeyError: <Void> Processing block: block@28[n_1] is a <class 'rpython.flowspace.flowcontext.SpamBlock'> in (rpython.rlib.rarithmetic:139)widen__NoneType containing the following operations: v637 = simple_call((function typeOf), n_1) v638 = simple_call((function _should_widen_type), v637) v639 = bool(v638) --end-- which, I have to say, I don't understand :) Samuel

1 0

Issue #2847: pypy2 6.0.0 unbound method has type `method` not `instancemethod` (pypy/pypy)
by Jeong YunWon 14 Jun '18

14 Jun '18

New issue 2847: pypy2 6.0.0 unbound method has type `method` not `instancemethod` https://bitbucket.org/pypy/pypy/issues/2847/pypy2-600-unbound-method-has-ty… Jeong YunWon: Code: ``` class A(object): def f(self): pass print(A.f) print(type(A.f)) ``` Result of pypy2 6.0.0 ``` $ python test.py <unbound method A.f> <type 'method'> $ python --version Python 2.7.13 (ab0b9caf307d, Apr 24 2018, 18:05:02) [PyPy 6.0.0 with GCC 4.2.1 Compatible Apple LLVM 9.1.0 (clang-902.0.39.1)] ``` Expected result (of CPython 2.7.13) ``` $ python t.py <unbound method A.f> <type 'instancemethod'> $ python --version Python 2.7.13 ```

1 0

Issue #2846: Error while creating a multiprocessing.Pool, _winapi 535, "There is a process on other end of the pipe" (pypy/pypy)
by jean 11 Jun '18

11 Jun '18

New issue 2846: Error while creating a multiprocessing.Pool, _winapi 535, "There is a process on other end of the pipe" https://bitbucket.org/pypy/pypy/issues/2846/error-while-creating-a-multipro… jean: ``` #!python Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:27:13) [PyPy 6.0.0 with MSC v.1910 32 bit] on win32 Type "help", "copyright", "credits" or "license" for more information. >>>> import multiprocessing as mp >>>> with mp.Pool() as pool: .... pass .... Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\context.py", line 118, in Pool context=self.get_context()) File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\pool.py", line 150, in __init__ self._setup_queues() File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\pool.py", line 243, in _setup_queues self._inqueue = self._ctx.SimpleQueue() File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\context.py", line 111, in SimpleQueue return SimpleQueue(ctx=self.get_context()) File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\queues.py", line 323, in __init__ self._reader, self._writer = connection.Pipe(duplex=False) File "C:\pypy3-v6.0.0-win32\lib-python\3\multiprocessing\connection.py", line 552, in Pipe _, err = overlapped.GetOverlappedResult(True) File "C:\pypy3-v6.0.0-win32\lib_pypy\_winapi.py", line 110, in GetOverlappedResult raise _WinError() File "C:\pypy3-v6.0.0-win32\lib_pypy\_winapi.py", line 23, in _WinError raise WindowsError(code, message) OSError: [Errno 535] There is a process on other end of the pipe >>>> ``` I tried it on win8.1 and win10, same results (doesnt matter how many processes) versions: pypy3 v6.0.0 on win32

1 0

Issue #2845: tdigest with PyPy is 8x slower than with Python3 (pypy/pypy)
by Ovanes Markarian 03 Jun '18

03 Jun '18

New issue 2845: tdigest with PyPy is 8x slower than with Python3 https://bitbucket.org/pypy/pypy/issues/2845/tdigest-with-pypy-is-8x-slower-… Ovanes Markarian: I ran the tests below and found out that on PyPy tdigest is horribly slow. Besides update I think all operations like merging of tdigests are slow. I opened a similar issue in tdigest GitHub: https://github.com/CamDavidsonPilon/tdigest/issues/44. My timings are: ``` #!python ========== PyPy running test in 2.7.13 (0e7ea4fe15e82d5124e805e2e4a37cae1a402d4b, Jan 06 2018, 12:46:49) [PyPy 5.10.0 with GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)] generating tdigests in batch generated items: 100 generating tdigests took: 32.5672068596 ---------- generating tdigests one by one generated items: 100 generating tdigests took: 17.4209430218 ---------- ================== Python running test in 2.7.14 (default, Mar 9 2018, 23:57:12) [GCC 4.2.1 Compatible Apple LLVM 9.0.0 (clang-900.0.39.2)] generating tdigests in batch generated items: 100 generating tdigests took: 4.16117596626 ---------- generating tdigests one by one generated items: 100 generating tdigests took: 2.38711595535 ---------- ``` I've repeated the test in the official PyPy docker container with PyPy 6.0.0 (compatible with python 3) with the same outcome: https://hub.docker.com/_/pypy/ Any ideas?

1 0