Mailman 3 August 2011 - pypy-dev

work on libpypy.so
by Roberto De Ioris Aug. 20, 2011

Aug. 20, 2011

Hi everyone, my company has a bunch of C apps (mainly the uWSGI application server container and a scriptable DNS server) embedding CPython in their core. We would like to start using PyPy, so our need is having a workable libpypy.so implementation (we do not need it to be compatible with CPython api, we can rewrite those parts, expecially in uWSGI, without problems). I have searched for some work already done, but it looks like no one is pushing it. I apply myself for working on this area (… [View More]

5 5

Re: [pypy-dev] Build pypy 1.6 on Windows XP with MinGW: can't find ffi.h
by Caleb Hattingh Aug. 19, 2011

Aug. 19, 2011

On 19 August 2011 18:55, Caleb Hattingh <caleb.hattingh(a)gmail.com> wrote: > I ran out of memory some time after the JIT had successfully compiled, > so now I am trying > > PYPY_GC_MAX_DELTA=200MB pypy --jit loop_longevity=300 ./translate.py -Ojit > > as suggested in the help page. Will post here again if I succeed. Unfortunately, another error, and it looks like something possibly to do with multibyte encoding: j:\tools\pypy\pypy\translator\c/src/cjkcodecs/… [View More]multibytecodec.h:12:13: error: conflicti ng types for 'ssize_t' Here is the last bit of error log: ======================================================================== [c:writing] objspace_std_proxy_helpers.c [c:writing] rpython_memory_gctransform_transform.c [c:writing] objspace_std_unicodetype.c [c:writing] module_pypyjit_interp_resop.c [c:writing] objspace_std_complextype.c [c:writing] module__random_interp_random.c [c:writing] module__file___init__.c [c:writing] module_micronumpy_interp_ufuncs.c [c:writing] jit_metainterp_optimizeopt___init__.c [translation:info] written: c:\docume~1\admini~1\locals~1\temp\usession-default-12\testing_1\testing_1.c [translation:info] Compiling c source... [platform:execute] make in c:\docume~1\admini~1\locals~1\temp\usession-default-12\testing_1 [platform:Error] In file included from common_header.h:35:0, [platform:Error] from testing_1.c:1: [platform:Error] j:\tools\pypy\pypy\translator\c/src/stack.h:47:1: warning: 'thread' attribute directive ignor ed [platform:Error] In file included from common_header.h:46:0, [platform:Error] from testing_1.c:1: [platform:Error] j:\tools\pypy\pypy\translator\c/src/cjkcodecs/multibytecodec.h:12:13: error: conflicting type s for 'ssize_t' [platform:Error] c:\mingw\bin\../lib/gcc/mingw32/4.5.2/../../../../include/sys/types.h:118:18: note: previous declaration of 'ssize_t' was here [platform:Error] make: *** [testing_1.o] Error 1 [platform:Error] make: Entering directory `/tmp/usession-default-12/testing_1' [platform:Error] gcc -O3 -DPy_BUILD_CORE -o testing_1.o -c testing_1.c -Ij:\\tools\\pypy\\pypy\\translator\\c -Ij:\\tools\\pypy\\pypy\\module\\cpyext\\include -I.. [platform:Error] make: Leaving directory `/tmp/usession-default-12/testing_1' [Timer] Timings: [Timer] annotate --- 656.2 s [Timer] rtype_lltype --- 443.8 s [Timer] pyjitpl_lltype --- 600.7 s [Timer] backendopt_lltype --- 240.1 s [Timer] stackcheckinsertion_lltype --- 52.7 s [Timer] database_c --- 332.4 s [Timer] source_c --- 458.4 s [Timer] compile_c --- 7.2 s [Timer] =========================================== [Timer] Total: --- 2791.4 s [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 308, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 810, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "j:\tools\pypy\pypy\translator\tool\taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 286, in _do [translation:ERROR] res = func() [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 573, in task_compile_c [translation:ERROR] cbuilder.compile(**kwds) [translation:ERROR] File "j:\tools\pypy\pypy\translator\c\genc.py", line 513, in compile [translation:ERROR] extra_opts) [translation:ERROR] File "j:\tools\pypy\pypy\translator\platform\posix.py", line 188, in execute_makefile [translation:ERROR] self._handle_error(returncode, stdout, stderr, path.join('make')) [translation:ERROR] File "j:\tools\pypy\pypy\translator\platform\windows.py", line 372, in _handle_error [translation:ERROR] returncode, '', stderr + stdout, outname) [translation:ERROR] File "j:\tools\pypy\pypy\translator\platform\__init__.py", line 130, in _handle_error [translation:ERROR] raise CompilationError(stdout, stderr) [translation:ERROR] CompilationError: CompilationError(err=""" [translation:ERROR] In file included from common_header.h:35:0, [translation:ERROR] from testing_1.c:1: [translation:ERROR] j:\tools\pypy\pypy\translator\c/src/stack.h:47:1: warning: 'thread' attribute directiv e ignored [translation:ERROR] In file included from common_header.h:46:0, [translation:ERROR] from testing_1.c:1: [translation:ERROR] j:\tools\pypy\pypy\translator\c/src/cjkcodecs/multibytecodec.h:12:13: error: conflicti ng types for 'ssize_t' [translation:ERROR] c:\mingw\bin\../lib/gcc/mingw32/4.5.2/../../../../include/sys/types.h:118:18: note: pr evious declaration of 'ssize_t' was here [translation:ERROR] make: *** [testing_1.o] Error 1 [translation:ERROR] make: Entering directory `/tmp/usession-default-12/testing_1' [translation:ERROR] gcc -O3 -DPy_BUILD_CORE -o testing_1.o -c testing_1.c -Ij:\\tools\\pypy\\pypy\\transla tor\\c -Ij:\\tools\\pypy\\pypy\\module\\cpyext\\include -I.. [translation:ERROR] make: Leaving directory `/tmp/usession-default-12/testing_1' [translation:ERROR] """) [translation] start debugger... > j:\tools\pypy\pypy\translator\platform\__init__.py(130)_handle_error() -> raise CompilationError(stdout, stderr) (Pdb+) ======================================================================== I am going to try to build with MSVC, see if that works. regards Caleb [View Less]

2 2

Broken link in Getting Started
by Miha Marolt Aug. 19, 2011

Aug. 19, 2011

Hi, in the Getting Started section of the documentation (http://doc.pypy.org/en/latest/getting-started.html), the command to download pip should be $ curl -O https://raw.github.com/pypa/pip/master/contrib/get-pip.py In browser, the old link (https://github.com/pypa/pip/raw/master/contrib/get-pip.py <https://github.com/pypa/pip/raw/master/contrib/get-pip.py>) is redirected to the new one, but the curl downloads the page with the redirection note.

1 0

Build pypy 1.6 on Windows XP with MinGW: can't find ffi.h
by Caleb Hattingh Aug. 19, 2011

Aug. 19, 2011

Hi This is a really silly thing, but I am hoping someone who has done this before can just give me the one-liner answer. I am trying to build pypy 1.6 on Windows XP using MinGW (in an MSYS environment). The build gets started, and I see a bit of Mandelbrot, but when the time comes for JIT, I get an error which I will reproduce below. I am following the too-terse instructions at the bottom of this page: http://codespeak.net/pypy/dist/pypy/doc/windows.html I have made sure that my newly-… [View More]built libffi-5.dll is on the system path, but I doubt that matters for translation. The instruction that I run is $ pypy.exe translate.py -Ojit --cc=mingw32 (Note that the help page only uses a single hyphen as in "-cc=mingw32", which doesn't work, that should be fixed on the page). The error that I see is the following: ================================================================================ ... [rtyper] specializing: 156100 / 156162 blocks (99%) [rtyper] -=- specialized 2519 more blocks -=- [rtyper] -=- specialized 0 more blocks -=- #%% [rtyper] -=- specialized 10 more blocks -=- [translation:info] JIT compiler generation... [platform:execute] gcc -c -O3 c:\docume~1\admini~1\locals~1\temp\usession-default-6\platcheck_54.c -o c:\docum e~1\admini~1\locals~1\temp\usession-default-6\platcheck_54.o [Timer] Timings: [Timer] annotate --- 639.2 s [Timer] rtype_lltype --- 388.4 s [Timer] pyjitpl_lltype --- 2.7 s [Timer] =========================================== [Timer] Total: --- 1030.2 s [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 308, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 810, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "j:\tools\pypy\pypy\translator\tool\taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 286, in _do [translation:ERROR] res = func() [translation:ERROR] File "j:\tools\pypy\pypy\translator\driver.py", line 395, in task_pyjitpl_lltype [translation:ERROR] from pypy.jit.metainterp.warmspot import apply_jit [translation:ERROR] File "j:\tools\pypy\pypy\jit\metainterp\warmspot.py", line 17, in <module> [translation:ERROR] from pypy.jit.metainterp import history, pyjitpl, gc, memmgr [translation:ERROR] File "j:\tools\pypy\pypy\jit\metainterp\pyjitpl.py", line 23, in <module> [translation:ERROR] from pypy.jit.metainterp.optimizeopt.util import args_dict_box [translation:ERROR] File "j:\tools\pypy\pypy\jit\metainterp\optimizeopt\__init__.py", line 8, in <module> [translation:ERROR] from pypy.jit.metainterp.optimizeopt.fficall import OptFfiCall [translation:ERROR] File "j:\tools\pypy\pypy\jit\metainterp\optimizeopt\fficall.py", line 3, in <module> [translation:ERROR] from pypy.rlib.libffi import Func [translation:ERROR] File "j:\tools\pypy\pypy\rlib\libffi.py", line 7, in <module> [translation:ERROR] from pypy.rlib import clibffi [translation:ERROR] File "j:\tools\pypy\pypy\rlib\clibffi.py", line 115, in <module> [translation:ERROR] include_dir='include', library_dir='.libs'), [translation:ERROR] File "j:\tools\pypy\pypy\rpython\tool\rffi_platform.py", line 778, in configure_externa l_library [translation:ERROR] raise last_error [translation:ERROR] CompilationError: CompilationError(out=""" [translation:ERROR] CompilationError(err=""" [translation:ERROR] c:\docume~1\admini~1\locals~1\temp\usession-default-6\platcheck_54.c:20:17: fa tal error: ffi.h: No such file or directory [translation:ERROR] compilation terminated. [translation:ERROR] """)""") [translation] start debugger... > j:\tools\pypy\pypy\rpython\tool\rffi_platform.py(778)configure_external_library() -> raise last_error (Pdb+) ... ================================================================================ I have tried placing ffi.h (and ffi_common.h and ffitarget.h) in various strategic places, but to no avail. I could figure it out on my own eventually, but perhaps someone could save me a little time? In exchange, I would be happy to write a more detailed doc section for building pypy on windows from source using mingw. kind regards Caleb Hattingh [View Less]

2 3

PPC64 JIT test_ppc.py tests fixed and working
by David Edelsohn Aug. 19, 2011

Aug. 19, 2011

Sven, With the attached patch, all of the ppc/ppcgen/test/test_ppc.py tests pass except for test_call_function that I skip while I debug it. I updated ppc_assembler.py:load_from() to load a full 64 bit value on 64 bit systems. It is not exactly right because I need to fix the signed offset compensation code, but it allows the test to pass. The multiply tests were failing because the tests perform a signed comparison and the result of PPC 32 bit multiply instructions are not implicitly sign … [View More]

2 1

Re: [pypy-dev] PyPy 1.6 released
by Serhat Sevki Dincer Aug. 18, 2011

Aug. 18, 2011

Great news! Thanks.. > From: Maciej Fijalkowski <fijall(a)gmail.com> > To: PyPy Developer Mailing List <pypy-dev(a)python.org> > Date: Thu, 18 Aug 2011 19:30:44 +0200 > Subject: [pypy-dev] PyPy 1.6 released > ======================== > PyPy 1.6 - kickass panda > ======================== > > We're pleased to announce the 1.6 release of PyPy. This release brings a lot > of bugfixes and performance improvements over 1.5, and improves … [View More]

1 0

PPC JIT test_load_and_store()
by David Edelsohn Aug. 18, 2011

Aug. 18, 2011

Sven, Does test_ppc.py:test_load_and_store() succeed for you? The code stores the values in registers r10 and r11 to the memory addressed by registers r8 and r9, but r8 and r9 never are initialized, so it stores to an arbitrary location in memory that may not be valid and causes a segfault. I understand the intent of the test, but I don't understand how it is suppose to work as currently written. Thanks, David

3 3

Update import path of PPC JIT tests
by David Edelsohn Aug. 18, 2011

Aug. 18, 2011

Many of the files in ppc/ppcgen/test (and ppc/ppcgen/rassemblermaker.py) reference the old path of pypy.jit.codegen.XXX. Updating the paths to pypy.jit.backend.XXX allows most of the tests to run and pass. Thanks, David

1 0

python 3
by Timur Tkachev Aug. 18, 2011

Aug. 18, 2011

Hello, Guys, maybe my question had been asked numerous times, but I couldn't google even a remote answer to it. What are the plans of python 3 support? Please shed some light on this topic. Last poll in your blog regarding what's holding off the pypy usage & acceptance showed that people do have an interest in this matter. Maybe there are people that can sponsor this work, maybe there is a branch with initial support implemented, maybe there are people eager to start helping you - we, … [View More]

11 19

Re: [pypy-dev] Linux 3.0 kernel fallout
by Amaury Forgeot d'Arc Aug. 16, 2011

Aug. 16, 2011

2011/8/16 Reiner | chocri <reiner(a)chocri.de> > $ python -c 'import sys; print sys.platform' > linux2 > > $ uname -r > 3.0.0-1-686-pae > So, where is the issue? -- Amaury Forgeot d'Arc

4 3