Mailman 3 March 2017 - pypy-dev

About gurobipy
by Luis José Novoa 31 May '18

31 May '18

Hi All, My name is Luis Novoa. Im working on a large scale optimization problem using python/gurobipy for my implementation. I was wondering if any of you in this list has used gurobipy with pypy, or if it is even possible at this time. Thanks in advance, Luis.

9 9

2, 7 and 3.5 release is almost here - please help check you favorite platform
by Matti Picus 07 Apr '17

07 Apr '17

4 7

Details on project idea: Explicit typing in RPython
by joannah nanjekye 03 Apr '17

03 Apr '17

Hello, I am interested in working on the above project. I need to understand what it is about so that I can make a plan for it. I would love to work on it for GSoC if accepted. In summary..I want to know the goal and the most important stack involved working on it. I am proficient in python. If the above project idea is not so much in that direction you can advise a better idea among the ones listed here http://pypy.readthedocs.io/en/latest/project-ideas.html. Kind regards, -- Joannah Nanjekye +256776468213 F : Nanjekye Captain Joannah S : joannah.nanjekye T : @captainjoannah SO : joannah *"You think you know when you learn, are more sure when you can write, even more when you can teach, but certain when you can program." Alan J. Perlis*

4 7

pypy real world example, a django project data processing. but slow...
by Vláďa Macek 31 Mar '17

31 Mar '17

Hi, recently I asked my friends to run my sort of a benchmark on their machines (attached). The goal was to test the speed of different data access in python2 and python3, 32bit and 64bit. One of my friends sent me the pypy results -- the script ran fast as hell! Astounding. At home I have a 64bit Dell laptop running 32bit Ubuntu 14.04. I downloaded your binary https://bitbucket.org/pypy/pypy/downloads/pypy2-v5.7.0-linux32.tar.bz2 and confirmed my friend's results, wow. I develop a large Django project, that includes a big amount of background data processing. Reads large files, computes, issues much SQL to postgresql via psycopg2, every 5 minutes. Heavily uses memcache daemon between runs. I'd welcome a speedup here very much. So let's give it a try. Installed psycopg2cffi (via pip in virtualenv), set up the paths and ran. The computation printouts were the same, very promising -- taking into account how complicated the project is! The SQL looked right too. My respect on compatiblity! Unfortunately, the time needed to complete was double in comparison CPython 2.7 for exactly the same task. You mention you might have some tips for why it's slow. Are you interested in getting in touch? Although I rather can't share the code and data with you, I'm offering a real world example of significant load that might help Pypy get better. Thank you, -- : Vlada Macek : http://macek.sandbox.cz : +420 608 978 164 : UNIX && Dev || Training : Python, Django : PGP key 97330EBD (Disclaimer: The opinions expressed herein are not necessarily those of my employer, not necessarily mine, and probably not necessary.)

2 4

error building source pypy2-v5.7.0 cygwin 32/windows 64
by Sergey Kurdakov 28 Mar '17

28 Mar '17

Hi, as my windows pypy would always crash on my project but the same project on linux works fine and my main developing environment is windows I decided to try cygwin pypy so I got pypy2-v5.7.0-src.tar.bz2 and run on latest Cygwin-32 on windows 10/64 python ../../rpython/bin/rpython -Ojit targetpypystandalone aside of few warnings like /tmp/usession-release-pypy2.7-v5.7.0-0/platcheck_50.c:92:1: warning: implicit declaration of function ‘mremap’ [-Wimplicit-function-declaration] /tmp/usession-release-pypy2.7-v5.7.0-0/module_cache/module_0.c:82:68: warning: implicit declaration of function ‘malloc’ [-Wimplicit-function-declaration] which seems indicate - that some flags are not correctly set I almost immediately get following error: === [platform:execute] gcc -shared /tmp/usession-release-pypy2.7-v5.7.0-0/module_cache/module_0.o /tmp/usession-release-pypy2.7-v5.7.0-0/module_cache/module_1.o /tmp/usession-release-pypy2.7-v5.7.0-0/module_cache/module_2.o -Wl,--export-all-symbols -lrt -o /tmp/usession-release-pypy2.7-v5.7.0-0/shared_cache/externmod.dll Traceback (most recent call last): File "../../rpython/bin/rpython", line 20, in <module> main() File "/home/Sergey/pypy2/rpython/translator/goal/translate.py", line 217, in main targetspec_dic, translateconfig, config, args = parse_options_and_load_target() File "/home/Sergey/pypy2/rpython/translator/goal/translate.py", line 155, in parse_options_and_load_target targetspec_dic = load_target(targetspec) File "/home/Sergey/pypy2/rpython/translator/goal/translate.py", line 97, in load_target mod = __import__(specname) File "targetpypystandalone.py", line 11, in <module> from pypy.tool.option import make_objspace File "/home/Sergey/pypy2/pypy/tool/option.py", line 3, in <module> from pypy.config.pypyoption import get_pypy_config File "/home/Sergey/pypy2/pypy/config/pypyoption.py", line 44, in <module> if detect_cpu.autodetect().startswith('x86'): File "/home/Sergey/pypy2/rpython/jit/backend/detect_cpu.py", line 106, in autodetect return detect_model_from_host_platform() File "/home/Sergey/pypy2/rpython/jit/backend/detect_cpu.py", line 85, in detect_model_from_host_platform if feature.detect_sse2(): File "/home/Sergey/pypy2/rpython/jit/backend/x86/detect_feature.py", line 20, in detect_sse2 code = cpu_id(eax=1) File "/home/Sergey/pypy2/rpython/jit/backend/x86/detect_feature.py", line 34, in cpu_id return cpu_info(''.join(asm)) File "/home/Sergey/pypy2/rpython/jit/backend/x86/detect_feature.py", line 16, in cpu_info free(data, 4096) File "/home/Sergey/pypy2/rpython/rtyper/lltypesystem/rffi.py", line 260, in wrapper assert len(args) == nb_args AssertionError ==== any guide for building latest pypy on Cygwin? or at least to fix those mentioned errors? Regards Sergey

2 1

Maybe do a 5.7.1 release soon?
by Armin Rigo 26 Mar '17

26 Mar '17

Hi all, https://bitbucket.org/pypy/pypy/issues/2508/dictionary-pop-with-default-fai… This is a core regression found by Jason and fixed by Alex Gaynor. Thanks to both! Is this justification enough to plan a 5.7.1 release soon? A bientôt, Armin.

3 2

Remove cpyext.load_module()?
by Manuel Jacob 23 Mar '17

23 Mar '17

Hi, In order to implement PEP 489 (Multi-phase extension module initialization) on py3.5 I need to change the way app-level Python code interacts with extension module loading internals. Maintaining cpyext.load_module() is a bit annoying. Probably the best way would be to delegate straight to imp.load_dynamic(). But then the question is why we need it in the first place. I'd like to remove cpyext.load_module() on both default and py3.5. -Manuel

2 1

numpy 1.12.1 segfault with pypy 2 5.7 on ubuntu 14.04
by Gelin Yan 23 Mar '17

23 Mar '17

Hi All I built pypy 2 5.7 from the source on Ubuntu 14.04 and installed numpy 1.12.1 via pip. When running numpy.test('full'), I noticed there was a segfault. I tested pypy 2 5.6 with numpy 1.12.1 too. I didn't see any segfault. Regards gelin yan

2 1

lltype.Signed type in ThreadLocalReference
by John Zhang 22 Mar '17

22 Mar '17

Hi all, I’m wondering why rthread.ThreadLocalReference is initialised to have lltype.Signed type (rthread.py:387). If in get() it’s retrieved as rclass.OBJECTPTR, why not just set the type of the field to be OBJECTPTR? is this related to some specific optimisation? The problem I’m having is that in my back-end I cannot cast an integer to a GC-ed heap object reference (which the OBJECTPTR translates to), it can only be cast to a non-GC-ed memory object reference (a different memory space not part of the GC managed heap). Any ideas? Regards, John Zhang ------------------------------------------------------ John Zhang Research Assistant Programming Languages, Design & Implementation Division Computer Systems Group ANU College of Engineering & Computer Science 108 North Rd The Australian National University Acton ACT 2601 john.zhang(a)anu.edu.au<mailto:john.zhang@anu.edu.au>

2 2

Segfaults when compiling PyPy
by Dingyuan Wang 17 Mar '17

17 Mar '17

Dear all, Is there anyone also having the problem that CPython2.7 or PyPy2 randomly crashes when compiling PyPy (several latest versions on hg)? I'm using Python 2.7.13 (or PyPy2 latest) on Debian stretch. One kind of problems is https://bugs.python.org/issue29242 Another kind is shown below. (at 90736:e668451adc8d) Program received signal SIGSEGV, Segmentation fault. update_refs () at ../Modules/gcmodule.c:332 332 ../Modules/gcmodule.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:58 #1 0x00007ffff6f2d40a in __GI_abort () at abort.c:89 #2 0x00007ffff6f69bd0 in __libc_message (do_abort=do_abort@entry=2, fmt=fmt@entry=0x7ffff705ec30 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175 #3 0x00007ffff6f6ff96 in malloc_printerr (action=3, str=0x7ffff705ec88 "munmap_chunk(): invalid pointer", ptr=<optimized out>, ar_ptr=<optimized out>) at malloc.c:5046 #4 0x0000555555630f5f in list_dealloc.lto_priv () at ../Objects/listobject.c:316 #5 0x0000555555688456 in dict_dealloc.lto_priv.61 (mp=0x7fffe2e52398) at ../Objects/dictobject.c:1040 #6 subtype_dealloc.lto_priv () at ../Objects/typeobject.c:1035 #7 0x0000555555678af2 in list_ass_slice.lto_priv () at ../Objects/listobject.c:704 #8 0x000055555569253e in assign_slice.lto_priv () at ../Python/ceval.c:4758 #9 0x000055555565300b in PyEval_EvalFrameEx () at ../Python/ceval.c:1868 #10 0x0000555555654c1f in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffcc50, func=<function at remote 0x7fffc0bed938>) at ../Python/ceval.c:4437 #11 call_function (oparg=<optimized out>, pp_stack=0x7fffffffcc50) at ../Python/ceval.c:4372 #12 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 ---Type <return> to continue, or q <return> to quit--- #13 0x0000555555654c1f in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffcda0, func=<function at remote 0x7fffc0a8e758>) at ../Python/ceval.c:4437 #14 call_function (oparg=<optimized out>, pp_stack=0x7fffffffcda0) at ../Python/ceval.c:4372 #15 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #16 0x000055555564d535 in PyEval_EvalCodeEx () at ../Python/ceval.c:3584 #17 0x0000555555654f19 in fast_function (nk=1, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffcfb0, func=<function at remote 0x7fffc0a8ed70>) at ../Python/ceval.c:4447 #18 call_function (oparg=<optimized out>, pp_stack=0x7fffffffcfb0) at ../Python/ceval.c:4372 #19 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #20 0x0000555555654c1f in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffd100, func=<function at remote 0x7ffff4a42a28>) at ../Python/ceval.c:4437 #21 call_function (oparg=<optimized out>, pp_stack=0x7fffffffd100) at ../Python/ceval.c:4372 #22 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #23 0x000055555564d535 in PyEval_EvalCodeEx () at ../Python/ceval.c:3584 #24 0x0000555555669ea8 in function_call.lto_priv () at ../Objects/funcobject.c:523 #25 0x000055555563b673 in PyObject_Call () at ../Objects/abstract.c:2547 ---Type <return> to continue, or q <return> to quit--- #26 0x00005555556518a5 in ext_do_call (nk=0, na=3, flags=<optimized out>, pp_stack=0x7fffffffd3b8, func=<function at remote 0x7ffff4a42848>) at ../Python/ceval.c:4666 #27 PyEval_EvalFrameEx () at ../Python/ceval.c:3028 #28 0x000055555564d535 in PyEval_EvalCodeEx () at ../Python/ceval.c:3584 #29 0x0000555555655698 in fast_function (nk=1, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffd5c0, func=<function at remote 0x7ffff4b75140>) at ../Python/ceval.c:4447 #30 call_function (oparg=<optimized out>, pp_stack=0x7fffffffd5c0) at ../Python/ceval.c:4372 #31 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #32 0x0000555555654c1f in fast_function (nk=<optimized out>, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffd710, func=<function at remote 0x7ffff4a42e60>) at ../Python/ceval.c:4437 #33 call_function (oparg=<optimized out>, pp_stack=0x7fffffffd710) at ../Python/ceval.c:4372 #34 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #35 0x000055555564d535 in PyEval_EvalCodeEx () at ../Python/ceval.c:3584 #36 0x0000555555655698 in fast_function (nk=0, na=<optimized out>, n=<optimized out>, pp_stack=0x7fffffffd920, func=<function at remote 0x7ffff66f2848>) at ../Python/ceval.c:4447 #37 call_function (oparg=<optimized out>, pp_stack=0x7fffffffd920) at ../Python/ceval.c:4372 ---Type <return> to continue, or q <return> to quit--- #38 PyEval_EvalFrameEx () at ../Python/ceval.c:2989 #39 0x000055555564d535 in PyEval_EvalCodeEx () at ../Python/ceval.c:3584 #40 0x000055555564d2d9 in PyEval_EvalCode (co=<optimized out>, globals=<optimized out>, locals=<optimized out>) at ../Python/ceval.c:669 #41 0x000055555567ce3f in run_mod.lto_priv () at ../Python/pythonrun.c:1376 #42 0x0000555555677d52 in PyRun_FileExFlags () at ../Python/pythonrun.c:1362 #43 0x000055555567789e in PyRun_SimpleFileExFlags () at ../Python/pythonrun.c:948 #44 0x0000555555628af1 in Py_Main () at ../Modules/main.c:640 #45 0x00007ffff6f192b1 in __libc_start_main (main=0x555555628420 <main>, argc=4, argv=0x7fffffffdd68, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fffffffdd58) at ../csu/libc-start.c:291 #46 0x000055555562831a in _start () -- Dingyuan Wang

1 1