Mailman 3 May 2013 - pypy-dev

Problems in connecting C++ and python with cppyy
by Xia Xin 27 May '13

27 May '13

Hi, When I use cppyy to connect the C++ with the python, I got a failure. Following this page, https://pypy.readthedocs.org/en/improve-docs/cppyy.html Define a new class $ cat MyClass.h class MyClass { public: MyClass(int i = -99) : m_myint(i) {} int GetMyInt() { return m_myint; } void SetMyInt(int i) { m_myint = i; } public: int m_myint; }; then compile it. $ genreflex MyClass.h $ g++ -fPIC -rdynamic -O2 -shared -I$REFLEXHOME/include MyClass_rflx.cpp -o libMyClassDict.so -L$REFLEXHOME/lib -lReflex $ ls libMyClassDict.so MyClass.h MyClass_rflx.cpp BUT, when I tried to load it in pypy-c, error occurred. $ pypy-c >>>> import cppyy >>>> cppyy.load_reflection_info("libMyClassDict.so") Traceback (most recent call last): File "<stdin>", line 1, in <module> RuntimeError: libMyClassDict.so: cannot open shared object file: No such file or directory Help me please? Thanks.

3 12

uWSGI 1.9.11 released with PyPy support
by Roberto De Ioris 26 May '13

26 May '13

Hi everyone, thanks to the effort of Maciej Fijalkowski (and contributions of Alex Gaynor and Armin Rigo) we now have a fully working PyPy plugin into uWSGI. The plugin works via cffi, and already supports multithreading and a good set of the uWSGI api (like caching and rpc) In the next few days i will start spamming major PaaS/ISPs using uWSGI (included my company) to ask them to offer an option to use PyPy in their services. I will probably start with pythonanywhere.com, as they make a massive use of unique uWSGI features and already offer PyPy as shell. The plugin requires nightly builds and libpypy-c.so, so (for now, i hope it will change soon ;) you need to build/translate it on your own (i have added some prebuilt version in my download area, but they are ubuntu-specific). Documentation: http://uwsgi-docs.readthedocs.org/en/latest/PyPy.html Benchmarks: http://uwsgi-docs.readthedocs.org/en/latest/PyPy_benchmarks.html Thanks a lot -- Roberto De Ioris http://unbit.it

4 4

Python 3 ...
by Armin Rigo 24 May '13

24 May '13

Hi all, Unrelated to everything, a comment about Python 3's unrivalled syntax. You can now be hesitant in your programs! Try it out: if len(x) > 0 and... and... and x[0] == 5: More seriously, I'm used to type "..." somewhere to mean "fix me first!". I didn't move to Python 3 so far, but if I had to pick a reason, this one would be high on the list. Now the program will associate a useless meaning to my "..." and try to execute it. Even worse, in the usual case (a line containing only "...") it will work: the line is completely ignored! You can write this: def foo(): x = ... ... and actually execute foo() without getting any error. Likely you'll end with a crash later because this call to foo() didn't have the expected effect, which you did not implement so far. Same with "assert...", which just passes. Great! I guess I just have to remember: use 4 dots, never 3. </rant> Armin

4 3

Fail to compile psycopg2
by Steve Kieu 24 May '13

24 May '13

Hello All, I tried to install psycopg2 but failed with the following message building 'psycopg2._psycopg' extension cc -O2 -fPIC -Wimplicit -DPSYCOPG_DEFAULT_PYDATETIME=1 -DPSYCOPG_VERSION="2.5 (dt dec pq3 ext)" -DPG_VERSION_HEX=0x090109 -DPSYCOPG_EXTENSIONS=1 -DPSYCOPG_NEW_BOOLEAN=1 -DHAVE_PQFREEMEM=1 -I/home/stevek/pypy/include -I. -I/usr/include/postgresql -I/usr/include/postgresql/9.1/server -c psycopg/psycopgmodule.c -o build/temp.linux-x86_64-2.7/psycopg/psycopgmodule.o -Wdeclaration-after-statement In file included from psycopg/psycopgmodule.c:38:0: ./psycopg/error.h:32:5: error: unknown type name ‘PyBaseExceptionObject’ error: command 'cc' failed with exit status 1 Looks like the python header from pypy does not declare PyBaseExceptionObject Any way to fix this? Thanks in adanvace, -- Steve Kieu

2 2

PyPy logo update
by Arseniy Terekhin 22 May '13

22 May '13

Hi! Let's update the logo to have `PyPy` instead of `pypy`. Too see my idea go to http://pypy.org and execute this javascript (Ctrl+Shift+J for Chrome, Ctrl+Shift+K for Firefox): $('#header').prepend('<h1 class="title" style="position: fixed;font-size: 350%;margin-top: 31px;margin-left: 152px;background: white;width: 300px;height: 40px;color:black;">PyPy</h1>'); Any objection? If no then I'll make a pull request. -- Best regards, Arseniy Terekhin

1 0

PyPy 2.0.2 released
by Armin Rigo 21 May '13

21 May '13

Hi all, The bugfix PyPy 2.0.2 has been released (on all platforms but OS/X which should come later in the day). ========================= PyPy 2.0.2 - Fermi Panini ========================= We're pleased to announce PyPy 2.0.2. This is a stable bugfix release over 2.0 and 2.0.1. You can download it here: http://pypy.org/download.html It fixes a crash in the JIT when calling external C functions (with ctypes/cffi) in a multithreaded context. What is PyPy? ============= PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7. It's fast (pypy 2.0 and cpython 2.7.3 performance comparison: http://speed.pypy.org) due to its integrated tracing JIT compiler. This release supports x86 machines running Linux 32/64, Mac OS X 64 or Windows 32. Support for ARM is progressing but not bug-free yet. Highlights ========== This release contains only the fix described above. A crash (or wrong results) used to occur if all these conditions were true: - your program is multithreaded; - it runs on a single-core machine or a heavily-loaded multi-core one; - it uses ctypes or cffi to issue external calls to C functions. This was fixed in the branch emit-call-x86 (see the example file bug1.py: https://bitbucket.org/pypy/pypy/commits/7c80121abbf4). Cheers, arigo et. al. for the PyPy team

1 0

Is cpyext dead forever?
by Matti Picus 18 May '13

18 May '13

cpyext is currently disabled on default. Is there a branch to revive it? Or are we expecting cffi to replace all interaction with external c code? I'm not sure what will be more painful, getting the world to rewrite all modules or supporting cpyext, both seem non-trivial. (I'm opening the discussion here since I'm not sure if everyone was heard in the discussion on IRC) Matti

2 3

pypy performance on fractal terrain generator.
by sean riley 18 May '13

18 May '13

FYI. Performance comparison of pypy and CPython using a fractal terrain generator and writing out a png file. Pypy is 6-11x faster on my Ubuntu Intel system. For 1024x1024 map: sriley@xxxy:/data/src/cityserver$ time pypy map.py real 0m0.656s user 0m0.596s sys 0m0.052s sriley@xxx:/data/src/cityserver$ time python map.py real 0m4.189s user 0m4.132s sys 0m0.044s For 4096x4096 map: sriley@xxx:/data/src/cityserver$ time pypy map.py real 0m6.511s user 0m6.152s sys 0m0.328s sriley@xxx:/data/src/cityserver$ time python map.py real 1m7.641s user 1m7.124s sys 0m0.324s Sean.

2 1

PyPy 2.0.1 released
by Armin Rigo 16 May '13

16 May '13

============================== PyPy 2.0.1 - Bohr Smørrebrød ============================== We're pleased to announce PyPy 2.0.1. This is a stable bugfix release over 2.0. You can download it here: http://pypy.org/download.html The fixes are mainly about fatal errors or crashes in our stdlib. See below for more details. What is PyPy? ============= PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7. It's fast due to its integrated tracing JIT compiler. (pypy 2.0 and cpython 2.7.3 performance comparison: http://speed.pypy.org) This release supports x86 machines running Linux 32/64, Mac OS X 64 or Windows 32. Support for ARM is progressing but not bug-free yet. Highlights ========== - fix an occasional crash in the JIT that ends in `RPython Fatal error: NotImplementedError` (https://bugs.pypy.org/issue1482). - `id(x)` is now always a positive number (except on int/float/long/complex). This fixes an issue in `_sqlite.py` (mostly for 32-bit Linux). - fix crashes of callback-from-C-functions (with cffi) when used together with Stackless features, on asmgcc (i.e. Linux only). Now gevent should work better (http://mail.python.org/pipermail/pypy-dev/2013-May/011362.html). - work around an eventlet issue with `socket._decref_socketios()` (https://bugs.pypy.org/issue1468). Cheers, arigo et. al. for the PyPy team

1 0

Segfault with pypy-2.0, gevent, dnspython
by Emil Kroymann 16 May '13

16 May '13

Hi List, I discovered a segementation fault with pypy-2.0 and gevent, while playing with the dnspython library. I compiled pypy from the source tarball downloaded from the pypy website with jit enabled and installed gevent with pypy support as described in the pypycore repository. Below is a log of the simple steps needed to reproduce the problem. From the generated core file, it seems, the problem occurs in the minimark gc. I also attached the core file to this mail. Regards, Emil (pypy-gevent)emil@descartes:~/Play/pypy-gevent/test$ ulimit -c unlimited (pypy-gevent)emil@descartes:~/Play/pypy-gevent/test$ python Python 2.7.3 (b9c3566aa0170aaa736db0491d542c309ec7a5dc, May 12 2013, 11:22:30) [PyPy 2.0.0 with GCC 4.6.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. And now for something completely different: ``All problems in computer science can be solved by another level of indirection. --Butler Lampson'' >>>> from gevent import monkey; monkey.patch_all() >>>> from dns.resolver import query >>>> a = query('www.google.de') *** using ev loop >>>> dir(a) Speicherzugriffsfehler (Speicherabzug geschrieben) (pypy-gevent)emil@descartes:~/Play/pypy-gevent/test$ gdb --core core --args python GNU gdb (Ubuntu/Linaro 7.4-2012.04-0ubuntu2.1) 7.4-2012.04 Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://bugs.launchpad.net/gdb-linaro/>... Reading symbols from /home/emil/.virtualenvs/pypy-gevent/bin/python...(no debugging symbols found)...done. [New LWP 3216] warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `python'. Program terminated with signal 11, Segmentation fault. #0 0x000000000110b2a4 in pypy_g_walk_to_parent_frame () (gdb) bt #0 0x000000000110b2a4 in pypy_g_walk_to_parent_frame () #1 0x000000000110b75c in pypy_g_walk_stack_from () #2 0x000000000110b899 in pypy_g__asm_callback () #3 0x000000000130b725 in pypy_asm_stackwalk () #4 0x0000000001104f32 in pypy_g_MiniMarkGC_minor_collection.part.1 () #5 0x00000000011099f8 in pypy_g_MiniMarkGC_collect_and_reserve () #6 0x0000000000ee4482 in pypy_g_invalidate_loop () #7 0x000000000104f85f in pypy_g_QuasiImmut_invalidate () #8 0x0000000000cdbdc3 in pypy_g_ModuleDictStrategy_setitem_str () #9 0x0000000000419539 in pypy_g___mm_setitem_W_DictMultiObject_W_Root_W_Root () #10 0x0000000000c9a3ff in pypy_g_displayhook () #11 0x0000000000849ede in pypy_g_BuiltinCode1_fastcall_1 () #12 0x00000000008475b0 in pypy_g_funccall_valuestack__AccessDirect_None () #13 0x000000000086a86c in pypy_g_CALL_FUNCTION__AccessDirect_None () #14 0x000000000087357f in pypy_g_dispatch_bytecode__AccessDirect_None () #15 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #16 0x0000000000c827a2 in pypy_g_portal_4 () #17 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #18 0x000000000085e826 in pypy_g_PyFrame_run () #19 0x000000000080a67b in pypy_g_call_function__star_1 () #20 0x0000000000872295 in pypy_g_dispatch_bytecode__AccessDirect_None () #21 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #22 0x0000000000c827a2 in pypy_g_portal_4 () #23 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #24 0x000000000085e826 in pypy_g_PyFrame_run () #25 0x000000000086cff4 in pypy_g_EXEC_STMT__AccessDirect_None () #26 0x00000000008726aa in pypy_g_dispatch_bytecode__AccessDirect_None () #27 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #28 0x0000000000c827a2 in pypy_g_portal_4 () #29 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #30 0x000000000085e826 in pypy_g_PyFrame_run () #31 0x0000000000cda8ba in pypy_g_CALL_METHOD__AccessDirect_star_1 () #32 0x0000000000873867 in pypy_g_dispatch_bytecode__AccessDirect_None () #33 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #34 0x0000000000c827a2 in pypy_g_portal_4 () #35 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #36 0x000000000085e826 in pypy_g_PyFrame_run () #37 0x0000000000cda8ba in pypy_g_CALL_METHOD__AccessDirect_star_1 () ---Type <return> to continue, or q <return> to quit--- #38 0x0000000000873867 in pypy_g_dispatch_bytecode__AccessDirect_None () #39 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #40 0x0000000000c827a2 in pypy_g_portal_4 () #41 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #42 0x000000000085e826 in pypy_g_PyFrame_run () #43 0x0000000000cda8ba in pypy_g_CALL_METHOD__AccessDirect_star_1 () #44 0x0000000000873867 in pypy_g_dispatch_bytecode__AccessDirect_None () #45 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #46 0x0000000000c827a2 in pypy_g_portal_4 () #47 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #48 0x000000000085e826 in pypy_g_PyFrame_run () #49 0x000000000086a86c in pypy_g_CALL_FUNCTION__AccessDirect_None () #50 0x000000000087357f in pypy_g_dispatch_bytecode__AccessDirect_None () #51 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #52 0x0000000000c827a2 in pypy_g_portal_4 () #53 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #54 0x000000000085e826 in pypy_g_PyFrame_run () #55 0x0000000000cb71fd in pypy_g_call_args () #56 0x000000000086a74e in pypy_g_call_function__AccessDirect_None () #57 0x000000000087375c in pypy_g_dispatch_bytecode__AccessDirect_None () #58 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #59 0x0000000000c827a2 in pypy_g_portal_4 () #60 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #61 0x000000000085e826 in pypy_g_PyFrame_run () #62 0x00000000008473d3 in pypy_g_funccall_valuestack__AccessDirect_None () #63 0x000000000086a86c in pypy_g_CALL_FUNCTION__AccessDirect_None () #64 0x000000000087357f in pypy_g_dispatch_bytecode__AccessDirect_None () #65 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #66 0x0000000000c827a2 in pypy_g_portal_4 () #67 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #68 0x000000000085e826 in pypy_g_PyFrame_run () #69 0x0000000000cb71fd in pypy_g_call_args () #70 0x000000000086a74e in pypy_g_call_function__AccessDirect_None () #71 0x000000000087370f in pypy_g_dispatch_bytecode__AccessDirect_None () #72 0x0000000000876583 in pypy_g_handle_bytecode__AccessDirect_None () #73 0x0000000000c827a2 in pypy_g_portal_4 () #74 0x0000000001067113 in pypy_g_ll_portal_runner__Unsigned_Bool_pypy_interpreter () #75 0x000000000085e826 in pypy_g_PyFrame_run () ---Type <return> to continue, or q <return> to quit--- #76 0x000000000080a9ce in pypy_g_call_function__star_2 () #77 0x0000000000763aea in pypy_g_entry_point () #78 0x0000000001306234 in pypy_main_function () #79 0x00007f84c489476d in __libc_start_main () from /lib/x86_64-linux-gnu/libc.so.6 #80 0x0000000000411c91 in _start () (gdb) quit -- Emil Kroymann VoIP Services Engineer Email: emil.kroymann(a)isaco.de Tel: +49-30-203899885 Mobile: +49-151-62820588 ISACO GmbH Kurfürstenstraße 79 10787 Berlin Germany Amtsgericht Charlottenburg, HRB 112464B Geschäftsführer: Daniel Frommherz

4 7