Mailman 3 July 2013 - pypy-dev

Cross-post from python-ideas: Compressing the stack on the fly
by Ram Rachum 28 Jul '14

28 Jul '14

Hi guys, I made a post on the Python-ideas mailing list that I was told might be relevant to Pypy. I've reproduced the original email below. Here is the thread on Python-ideas with all the discussion.<https://groups.google.com/forum/?fromgroups#!topic/python-ideas/hteGSNTyC_4> -------------- Hi everybody, Here's an idea I had a while ago. Now, I'm an ignoramus when it comes to how programming languages are implemented, so this idea will most likely be either (a) completely impossible or (b) trivial knowledge. I was thinking about the implementation of the factorial in Python. I was comparing in my mind 2 different solutions: The recursive one, and the one that uses a loop. Here are example implementations for them: def factorial_recursive(n): if n == 1: return 1 return n * factorial_recursive(n - 1) def factorial_loop(n): result = 1 for i in range(1, n + 1): result *= i return result I know that the recursive one is problematic, because it's putting a lot of items on the stack. In fact it's using the stack as if it was a loop variable. The stack wasn't meant to be used like that. Then the question came to me, why? Maybe the stack could be built to handle this kind of (ab)use? I read about tail-call optimization on Wikipedia. If I understand correctly, the gist of it is that the interpreter tries to recognize, on a frame-by-frame basis, which frames could be completely eliminated, and then it eliminates those. Then I read Guido's blog post explaining why he doesn't want it in Python. In that post he outlined 4 different reasons why TCO shouldn't be implemented in Python. But then I thought, maybe you could do something smarter than eliminating individual stack frames. Maybe we could create something that is to the current implementation of the stack what `xrange` is to the old-style `range`. A smart object that allows access to any of a long list of items in it, without actually having to store those items. This would solve the first argument that Guido raises in his post, which I found to be the most substantial one. What I'm saying is: Imagine the stack of the interpreter when it runs the factorial example above for n=1000. It has around 1000 items in it and it's just about to explode. But then, if you'd look at the contents of that stack, you'd see it's embarrassingly regular, a compression algorithm's wet dream. It's just the same code location over and over again, with a different value for `n`. So what I'm suggesting is an algorithm to compress that stack on the fly. An algorithm that would detect regularities in the stack and instead of saving each individual frame, save just the pattern. Then, there wouldn't be any problem with showing informative stack trace: Despite not storing every individual frame, each individual frame could still be accessed, similarly to how `xrange` allow access to each individual member without having to store each of them. Then, the stack could store a lot more items, and tasks that currently require recursion (like pickling using the standard library) will be able to handle much deeper recursions. What do you think? Ram.

2 1

Python vs pypy: interesting performance difference [dict.setdefault]
by David Naylor 10 Mar '14

10 Mar '14

Hi, I needed to create a cache of date and time objects and I wondered what was the best way to handle the cache. For comparison I put together the following test: <file="iforkey.py"> import datetime import random import timeit ranges = [datetime.datetime(2011,01, random.randint(1, 31)) for i in xrange(1000)] def ifdict(): cache = {} b = [] for i in ranges: key = i.day if key in cache: b.append(cache[key]) else: date = i.date() cache[key] = date b.append(date) def keydict(): cache = {} b = [] for i in ranges: key = i.day try: b.append(cache[key]) except KeyError: date = i.date() cache[key] = date b.append(date) def defaultdict(): cache = {} b= [] for i in ranges: b.append(cache.setdefault(i, i.date())) print "ifdict:", timeit.repeat("ifdict()", "from __main__ import ifdict", number=10000) print "keydict:", timeit.repeat("keydict()", "from __main__ import keydict", number=10000) print "defaultdict:", timeit.repeat("defaultdict()", "from __main__ import defaultdict", number=10000) </file> # python iforfile.py ifdict: [2.432887077331543, 2.4002890586853027, 2.397233009338379] keydict: [2.3483030796051025, 2.358638048171997, 2.314802885055542] defaultdict: [3.5384328365325928, 3.5329859256744385, 3.5728111267089844] # pypy iforfile.py (pypy 1.5) ifdict: [0.8129069805145264, 0.74648118019104, 0.7432689666748047] keydict: [0.5187451839447021, 0.4662129878997803, 0.4504108428955078] defaultdict: [37.98510789871216, 37.859113931655884, 37.92770600318909] Pypy displays significant slowdown in the defaultdict function, otherwise displays its usual speedup. To check what is the cause I replaced i.date() with i.day and found no major difference in times. It appears dict.setdefault (or it's interaction with jit) is causing a slow down. Regards

4 14

numpy fails trigonometry with complex numbers, what to do?
by Matti Picus 23 Dec '13

23 Dec '13

I am trying to complete complex numbers in numpypy. Progress is good, I picked up from previous work on the numpypy-complex2 branch. Complex numbers come with extensive tests, it seems all the corner cases are covered. In porting the tests to numpypy, I came across a problem: numpy returns different results than cmath. Some of the differences are due to the fact that numpy does not raise a ValueError for dividing by 0 or other silly input values, but other differences are inexplicable (note the sign of the imaginary part): >>> numpy.arccos(complex(0.,-0.)) (1.5707963267948966-0j) >>> cmath.acos(complex(0.,-0.)) (1.5707963267948966+0j) >>> or this one: >>> cmath.acos(complex(float('inf'),2.3)) -infj >>> numpy.arccos(complex(float('inf'),2.3)) (0.78539816339744828-inf*j) Should I ignore the inconsistencies, or fix the 700 out of 2300 test instance failures? What should pypy's numpypy do - be consistent with numpy or with cmath? cmath is easier and probably faster (no need to mangle results or input args), so I would prefer cmath to trying to understand the logic behind numpy. Matti 2280c2365844

4 4

Pypy-2.1-beta2 translation error
by David Naylor 01 Aug '13

01 Aug '13

Hi, While trying to self-translate pypy-2.1-beta2 I got the following error: RPython traceback: File "rpython_jit_metainterp_resume.c", line 7778, in blackhole_from_resumedata File "rpython_jit_metainterp_resume.c", line 9972, in ResumeDataDirectReader_consume_vref_and_vable File "rpython_jit_metainterp_resume.c", line 695, in ResumeDataDirectReader_consume_vable_info Fatal RPython error: AssertionError Is this a known problem or something wrong with my setup? Regards

3 4

PyPy3 2.1 beta 1 released
by Philip Jenvey 31 Jul '13

31 Jul '13

================ PyPy3 2.1 beta 1 ================ We're pleased to announce the first beta of the upcoming 2.1 release of PyPy3. This is the first release of PyPy which targets Python 3 (3.2.3) compatibility. We would like to thank all of the people who donated_ to the `py3k proposal`_ for supporting the work that went into this and future releases. You can download the PyPy3 2.1 beta 1 release here: http://pypy.org/download.html#pypy3-2-1-beta-1 Highlights ========== * The first release of PyPy3: support for Python 3, targetting CPython 3.2.3! - There are some `known issues`_ including performance regressions (issues `#1540`_ & `#1541`_) slated to be resolved before the final release. What is PyPy? ============== PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7.3 or 3.2.3. It's fast due to its integrated tracing JIT compiler. This release supports x86 machines running Linux 32/64, Mac OS X 64 or Windows 32. Also this release supports ARM machines running Linux 32bit - anything with ``ARMv6`` (like the Raspberry Pi) or ``ARMv7`` (like Beagleboard, Chromebook, Cubieboard, etc.) that supports ``VFPv3`` should work. Cheers, the PyPy team

1 0

memory leak in pypy
by Nathan Hurst 30 Jul '13

30 Jul '13

I was playing with this simple function to compute uint/3. It does not (afaict) directly allocate any memory, but when run it rapidly consumes all memory (32GB): def divu3(n): q = (n >> 2) + (n >> 4) # q = n*0.0101 (approx). q = q + (q >> 4) # q = n*0.01010101. q = q + (q >> 8) # q = n*0.01010101. q = q + (q >> 16) # q = n*0.01010101. r = n - q*3 # 0 <= r <= 15. return q + (11*r >> 5) # Returning q + r/3. for i in range(2**31): assert(divu3(i) == i/3) Python 2.7.3 (daf1b0412bfbd0666c19d567e37b29e4a3be5734, Jul 12 2013, 19:10:57) [PyPy 2.1.0-beta1 with GCC 4.7.2] on linux2 is it being over eager to specialise? njh

4 4

Threading in RPython
by Sean Fisk 30 Jul '13

30 Jul '13

Hello everyone, For my internship<http://morepypy.blogspot.com/2012/12/pypy-related-internship-at-ncar.html>, I am working on implementing a solver for partial differential equations in RPython <https://github.com/seanfisk/rpython-stencil-language>. I am investigating the possibility of parallelizing the code using multi-threading. I have found the RPython's basic threading library, rpython/rlib/rthread.py<https://bitbucket.org/pypy/pypy/src/a75c05b8580ec08fb12777332492254c57ebe0a…>, and am attempting to get a "Hello world!" threading program up and running. I have successfully been able to start threads that do really simple things like printing literal messages. However, I would now like to be able to pass parameters to the threads. The only example I can seem to find of this library in use is the threading support in PyPy (at pypy/module/thread/os_thread.py<https://bitbucket.org/pypy/pypy/src/a75c05b8580ec08fb12777332492254c57ebe0a…>). I‘ve read through the code a number of times and am using it as a reference. However, there are some features I don’t need and some things that simply won't run in my interpreter (e.g., everything involving spaces). Can anybody point me in the right direction as to passing parameters to threads? I know I need something similar to the Bootstrapper to synchronize my parameters, but everything I've tried so far has either not synchronized or segfaulted. The current code is segfaulting around rthread.gc_thread_die(). I can do some more digging on this if necessary. Thanks in advance for help anyone might offer. ~ Sean $ python --version Python 2.7.3 (5acfe049a5b0, May 21 2013, 13:47:22) [PyPy 2.0.2 with GCC 4.2.1 Compatible Apple LLVM 4.2 (clang-425.0.28)] Here is the current code: # rthread_hello.py## Compile with: rpython --thread rthread_hello.py from rpython.rlib import rthread # "Library" code class Arguments(object): pass class FunctionData(object): args = Arguments() func = None lock = None _function_data = FunctionData() def _thread_func_wrapper(): rthread.gc_thread_start() func = _function_data.func args = _function_data.args _function_data.lock.release() func(args) rthread.gc_thread_die() def run_in_thread(func, args): _function_data.func = func _function_data.args = args if _function_data.lock is None: _function_data.lock = rthread.allocate_lock() _function_data.lock.acquire(True) rthread.gc_thread_prepare() rthread.start_new_thread(_thread_func_wrapper, ()) # "User" code def func_to_call(args): print 'Within the function' print args.first print args.second def main(argv): for i in xrange(5): args = Arguments() # Create some dummy arguments. args.first = i args.second = i * 10 # Start the thread. run_in_thread(func_to_call, args) return 0 def target(x, y): return main, None

3 6

Fwd: Build failed in Jenkins: pypy #887
by Maciej Fijalkowski 30 Jul '13

30 Jul '13

the nightly build crashes strangely ---------- Forwarded message ---------- From: "Jenkins" <jenkins(a)codernity.com> Date: Tue, Jul 30, 2013 at 2:48 AM Subject: Build failed in Jenkins: pypy #887 To: fijall(a)gmail.com See <http://ci.cod/job/pypy/887/> ------------------------------------------ [...truncated 3127 lines...] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2268:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2268:3: warning: (near initialization for ‘pypy_g_array_690.a.items[432].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2283:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2283:3: warning: (near initialization for ‘pypy_g_array_690.a.items[435].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2298:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2298:3: warning: (near initialization for ‘pypy_g_array_690.a.items[438].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2308:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2308:3: warning: (near initialization for ‘pypy_g_array_690.a.items[440].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2313:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2313:3: warning: (near initialization for ‘pypy_g_array_690.a.items[441].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2333:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2333:3: warning: (near initialization for ‘pypy_g_array_690.a.items[445].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2383:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2383:3: warning: (near initialization for ‘pypy_g_array_690.a.items[455].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2478:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2478:3: warning: (near initialization for ‘pypy_g_array_690.a.items[474].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2503:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2503:3: warning: (near initialization for ‘pypy_g_array_690.a.items[479].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2563:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2563:3: warning: (near initialization for ‘pypy_g_array_690.a.items[491].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2578:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2578:3: warning: (near initialization for ‘pypy_g_array_690.a.items[494].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2588:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2588:3: warning: (near initialization for ‘pypy_g_array_690.a.items[496].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2593:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2593:3: warning: (near initialization for ‘pypy_g_array_690.a.items[497].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2613:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2613:3: warning: (near initialization for ‘pypy_g_array_690.a.items[501].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2643:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2643:3: warning: (near initialization for ‘pypy_g_array_690.a.items[507].d_value’) [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2663:3: warning: initialization from incompatible pointer type [enabled by default] [translation:ERROR] data_pypy_module_cpyext_pyobject.c:2663:3: warning: (near initialization for ‘pypy_g_array_690.a.items[511].d_value’) [enabled by default] [translation:ERROR] implement_1.c: In function ‘pypy_g_descr_typecheck_get_doc’: [translation:ERROR] implement_1.c:14072:10: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_5.c: In function ‘pypy_g_ccall_fclose__arrayPtr_reload’: [translation:ERROR] implement_5.c:15324:2: warning: passing argument 1 of ‘fclose’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from <http://ci.cod/job/pypy/ws/pypy/module/cpyext/include/object.h>:4:0, [translation:ERROR] from <http://ci.cod/job/pypy/ws/pypy/module/cpyext/include/Python.h>:85, [translation:ERROR] from common_header.h:38, [translation:ERROR] from implement_5.c:5: [translation:ERROR] /usr/include/stdio.h:234:12: note: expected ‘struct FILE *’ but argument is of type ‘char *’ [translation:ERROR] implement_9.c: In function ‘pypy_g_ccall_stat64__arrayPtr_statPtr_reload’: [translation:ERROR] implement_9.c:12377:2: warning: passing argument 2 of ‘stat64’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:55:0, [translation:ERROR] from implement_9.c:5: [translation:ERROR] /usr/include/x86_64-linux-gnu/sys/stat.h:504:1: note: expected ‘struct stat64 *’ but argument is of type ‘struct stat *’ [translation:ERROR] implement_9.c: In function ‘pypy_g_ccall_fstat64__INT_statPtr_reload’: [translation:ERROR] implement_9.c:12617:2: warning: passing argument 2 of ‘fstat64’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:55:0, [translation:ERROR] from implement_9.c:5: [translation:ERROR] /usr/include/x86_64-linux-gnu/sys/stat.h:518:1: note: expected ‘struct stat64 *’ but argument is of type ‘struct stat *’ [translation:ERROR] implement_11.c: In function ‘pypy_g_ccall_lstat64__arrayPtr_statPtr_reload’: [translation:ERROR] implement_11.c:24466:2: warning: passing argument 2 of ‘lstat64’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:55:0, [translation:ERROR] from implement_11.c:5: [translation:ERROR] /usr/include/x86_64-linux-gnu/sys/stat.h:511:1: note: expected ‘struct stat64 *’ but argument is of type ‘struct stat *’ [translation:ERROR] implement_11.c: In function ‘pypy_g_ccall_fdopen__INT_arrayPtr_reload’: [translation:ERROR] implement_11.c:24524:11: warning: assignment from incompatible pointer type [enabled by default] [translation:ERROR] implement_11.c: In function ‘pypy_g_ccall_setbuf__arrayPtr_arrayPtr_reload’: [translation:ERROR] implement_11.c:24581:2: warning: passing argument 1 of ‘setbuf’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from <http://ci.cod/job/pypy/ws/pypy/module/cpyext/include/object.h>:4:0, [translation:ERROR] from <http://ci.cod/job/pypy/ws/pypy/module/cpyext/include/Python.h>:85, [translation:ERROR] from common_header.h:38, [translation:ERROR] from implement_11.c:5: [translation:ERROR] /usr/include/stdio.h:329:13: note: expected ‘struct FILE * __restrict__’ but argument is of type ‘char *’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetUnparsedEntityDeclHandler__NonePtr__1’: [translation:ERROR] implement_21.c:24275:2: warning: passing argument 2 of ‘XML_SetUnparsedEntityDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:600:1: note: expected ‘XML_UnparsedEntityDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *, char *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetStartElementHandler__NonePtr_funcPt_1’: [translation:ERROR] implement_21.c:24451:2: warning: passing argument 2 of ‘XML_SetStartElementHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:539:1: note: expected ‘XML_StartElementHandler’ but argument is of type ‘void (*)(void *, char *, char **)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetSkippedEntityHandler__NonePtr_funcP_1’: [translation:ERROR] implement_21.c:24594:2: warning: passing argument 2 of ‘XML_SetSkippedEntityHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:637:1: note: expected ‘XML_SkippedEntityHandler’ but argument is of type ‘void (*)(void *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetEndElementHandler__NonePtr_funcPtr_’: [translation:ERROR] implement_21.c:24664:2: warning: passing argument 2 of ‘XML_SetEndElementHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:543:1: note: expected ‘XML_EndElementHandler’ but argument is of type ‘void (*)(void *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetDefaultHandlerExpand__NonePtr_funcP_1’: [translation:ERROR] implement_21.c:24734:2: warning: passing argument 2 of ‘XML_SetDefaultHandlerExpand’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:583:1: note: expected ‘XML_DefaultHandler’ but argument is of type ‘void (*)(void *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetCharacterDataHandler__NonePtr_funcP_1’: [translation:ERROR] implement_21.c:24804:2: warning: passing argument 2 of ‘XML_SetCharacterDataHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:547:1: note: expected ‘XML_CharacterDataHandler’ but argument is of type ‘void (*)(void *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetCommentHandler__NonePtr_funcPtr_rel’: [translation:ERROR] implement_21.c:24929:2: warning: passing argument 2 of ‘XML_SetCommentHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:554:1: note: expected ‘XML_CommentHandler’ but argument is of type ‘void (*)(void *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetElementDeclHandler__NonePtr_funcPtr_1’: [translation:ERROR] implement_21.c:24999:2: warning: passing argument 2 of ‘XML_SetElementDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:155:1: note: expected ‘XML_ElementDeclHandler’ but argument is of type ‘void (*)(void *, char *, struct XML_Content *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetStartNamespaceDeclHandler__NonePtr__1’: [translation:ERROR] implement_21.c:25193:2: warning: passing argument 2 of ‘XML_SetStartNamespaceDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:613:1: note: expected ‘XML_StartNamespaceDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetEndNamespaceDeclHandler__NonePtr_fu_1’: [translation:ERROR] implement_21.c:25263:2: warning: passing argument 2 of ‘XML_SetEndNamespaceDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:617:1: note: expected ‘XML_EndNamespaceDeclHandler’ but argument is of type ‘void (*)(void *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetEntityDeclHandler__NonePtr_funcPtr_’: [translation:ERROR] implement_21.c:25334:2: warning: passing argument 2 of ‘XML_SetEntityDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:341:1: note: expected ‘XML_EntityDeclHandler’ but argument is of type ‘void (*)(void *, char *, int, char *, int, char *, char *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetNotationDeclHandler__NonePtr_funcPt_1’: [translation:ERROR] implement_21.c:25405:2: warning: passing argument 2 of ‘XML_SetNotationDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:604:1: note: expected ‘XML_NotationDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetStartDoctypeDeclHandler__NonePtr_fu_1’: [translation:ERROR] implement_21.c:25531:2: warning: passing argument 2 of ‘XML_SetStartDoctypeDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:592:1: note: expected ‘XML_StartDoctypeDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetDefaultHandler__NonePtr_funcPtr_rel’: [translation:ERROR] implement_21.c:25601:2: warning: passing argument 2 of ‘XML_SetDefaultHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:575:1: note: expected ‘XML_DefaultHandler’ but argument is of type ‘void (*)(void *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetExternalEntityRefHandler__NonePtr_f_1’: [translation:ERROR] implement_21.c:25672:2: warning: passing argument 2 of ‘XML_SetExternalEntityRefHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:625:1: note: expected ‘XML_ExternalEntityRefHandler’ but argument is of type ‘int (*)(struct XML_ParserStruct *, char *, char *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetProcessingInstructionHandler__NoneP_1’: [translation:ERROR] implement_21.c:25743:2: warning: passing argument 2 of ‘XML_SetProcessingInstructionHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:551:1: note: expected ‘XML_ProcessingInstructionHandler’ but argument is of type ‘void (*)(void *, char *, char *)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetXmlDeclHandler__NonePtr_funcPtr_rel’: [translation:ERROR] implement_21.c:25869:2: warning: passing argument 2 of ‘XML_SetXmlDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:192:1: note: expected ‘XML_XmlDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_SetAttlistDeclHandler__NonePtr_funcPtr_1’: [translation:ERROR] implement_21.c:25940:2: warning: passing argument 2 of ‘XML_SetAttlistDeclHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_21.c:5: [translation:ERROR] /usr/include/expat.h:175:1: note: expected ‘XML_AttlistDeclHandler’ but argument is of type ‘void (*)(void *, char *, char *, char *, char *, int)’ [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_EVP_get_digestbyname__arrayPtr_reload’: [translation:ERROR] implement_21.c:60561:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_21.c: In function ‘pypy_g_ccall_XML_ErrorString__INT_reload’: [translation:ERROR] implement_21.c:65477:11: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_22.c: In function ‘pypy_g_ccall_XML_SetUnknownEncodingHandler__NonePtr_fun_1’: [translation:ERROR] implement_22.c:4813:2: warning: passing argument 2 of ‘XML_SetUnknownEncodingHandler’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from common_header.h:80:0, [translation:ERROR] from implement_22.c:5: [translation:ERROR] /usr/include/expat.h:641:1: note: expected ‘XML_UnknownEncodingHandler’ but argument is of type ‘int (*)(void *, char *, struct XML_Encoding *)’ [translation:ERROR] implement_22.c: In function ‘pypy_g_ccall_SSL_get_current_cipher__SSLPtr_reload’: [translation:ERROR] implement_22.c:46343:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_22.c: In function ‘pypy_g_ccall_SSL_CIPHER_get_name__SSL_CIPHERPtr_reload’: [translation:ERROR] implement_22.c:46398:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_23.c: In function ‘pypy_g_ccall_openpty__arrayPtr_arrayPtr_arrayPtr_arrayP_1’: [translation:ERROR] implement_23.c:32105:2: warning: implicit declaration of function ‘openpty’ [-Wimplicit-function-declaration] [translation:ERROR] implement_23.c: In function ‘pypy_g_ccall_forkpty__arrayPtr_arrayPtr_arrayPtr_arrayP_1’: [translation:ERROR] implement_23.c:34480:2: warning: implicit declaration of function ‘forkpty’ [-Wimplicit-function-declaration] [translation:ERROR] implement_23.c: In function ‘pypy_g_ccall_EVP_DigestFinal__EVP_MD_CTXPtr_arrayPtr_ar_1’: [translation:ERROR] implement_23.c:41912:2: warning: pointer targets in passing argument 2 of ‘EVP_DigestFinal’ differ in signedness [-Wpointer-sign] [translation:ERROR] In file included from /usr/include/openssl/x509.h:73:0, [translation:ERROR] from /usr/include/openssl/ssl.h:156, [translation:ERROR] from common_header.h:72, [translation:ERROR] from implement_23.c:5: [translation:ERROR] /usr/include/openssl/evp.h:565:5: note: expected ‘unsigned char *’ but argument is of type ‘char *’ [translation:ERROR] implement_23.c: In function ‘pypy_g_ccall_i2d_X509__X509Ptr_arrayPtr_reload’: [translation:ERROR] implement_23.c:42675:2: warning: passing argument 2 of ‘i2d_X509’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from /usr/include/openssl/ssl.h:156:0, [translation:ERROR] from common_header.h:72, [translation:ERROR] from implement_23.c:5: [translation:ERROR] /usr/include/openssl/x509.h:839:1: note: expected ‘unsigned char **’ but argument is of type ‘char **’ [translation:ERROR] implement_23.c: In function ‘pypy_g_ccall_inet_ntop__INT_arrayPtr_arrayPtr_UINT_relo’: [translation:ERROR] implement_23.c:48311:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_X509V3_EXT_get__arrayPtr_reload’: [translation:ERROR] implement_24.c:27995:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_ASN1_ITEM_ptr__funcPtr_reload’: [translation:ERROR] implement_24.c:28275:12: warning: assignment from incompatible pointer type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_ASN1_item_d2i__arrayPtr_arrayPtr_Signed_AS_1’: [translation:ERROR] implement_24.c:28337:2: warning: passing argument 2 of ‘ASN1_item_d2i’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from /usr/include/openssl/objects.h:960:0, [translation:ERROR] from /usr/include/openssl/evp.h:94, [translation:ERROR] from /usr/include/openssl/x509.h:73, [translation:ERROR] from /usr/include/openssl/ssl.h:156, [translation:ERROR] from common_header.h:72, [translation:ERROR] from implement_24.c:5: [translation:ERROR] /usr/include/openssl/asn1.h:1088:14: note: expected ‘const unsigned char **’ but argument is of type ‘char **’ [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_TLSv1_method____reload’: [translation:ERROR] implement_24.c:33757:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_SSLv3_method____reload’: [translation:ERROR] implement_24.c:34491:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_SSLv23_method____reload’: [translation:ERROR] implement_24.c:34544:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] implement_24.c: In function ‘pypy_g_ccall_ASN1_STRING_to_UTF8__arrayPtr_asn1_string__1’: [translation:ERROR] implement_24.c:41507:2: warning: passing argument 1 of ‘ASN1_STRING_to_UTF8’ from incompatible pointer type [enabled by default] [translation:ERROR] In file included from /usr/include/openssl/objects.h:960:0, [translation:ERROR] from /usr/include/openssl/evp.h:94, [translation:ERROR] from /usr/include/openssl/x509.h:73, [translation:ERROR] from /usr/include/openssl/ssl.h:156, [translation:ERROR] from common_header.h:72, [translation:ERROR] from implement_24.c:5: [translation:ERROR] /usr/include/openssl/asn1.h:1000:5: note: expected ‘unsigned char **’ but argument is of type ‘char **’ [translation:ERROR] implement_25.c: In function ‘pypy_g_ccall_gai_strerror__INT_reload’: [translation:ERROR] implement_25.c:10714:12: warning: assignment discards ‘const’ qualifier from pointer target type [enabled by default] [translation:ERROR] pypy_goal_targetpypystandalone.c: In function ‘pypy_g_pypy_thread_attach’: [translation:ERROR] pypy_goal_targetpypystandalone.c:3981:2: warning: assignment makes pointer from integer without a cast [enabled by default] [translation:ERROR] In file included from pypy_interpreter_astcompiler_symtable.c:7:0: [translation:ERROR] forwarddecl.h:207028:14: error: stray ‘`’ in program [translation:ERROR] forwarddecl.h:207028:35: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘y_g_array_45914’ [translation:ERROR] make: *** [pypy_interpreter_astcompiler_symtable.s] Error 1 [translation:ERROR] make: *** Waiting for unfinished jobs.... [translation:ERROR] """) [translation] start debugger... > <http://ci.cod/job/pypy/ws/rpython/translator/platform/__init__.py(150)_hand…> -> raise CompilationError(stdout, stderr) Traceback (most recent call last): File "app_main.py", line 72, in run_toplevel f(*fargs, **fkwds) File "../../rpython/bin/rpython", line 20, in <module> main() File "<http://ci.cod/job/pypy/ws/rpython/translator/goal/translate.py",> line 325, in main debug(True) File "<http://ci.cod/job/pypy/ws/rpython/translator/goal/translate.py",> line 278, in debug pdb_plus_show.start(tb) File "<http://ci.cod/job/pypy/ws/rpython/translator/tool/pdbplus.py",> line 417, in start fn(*args) File "<http://ci.cod/job/pypy/ws/rpython/translator/tool/pdbplus.py",> line 25, in post_mortem self.interaction(t.tb_frame, t) File "/opt/pypy_2_beta2/lib-python/2.7/pdb.py", line 210, in interaction self.cmdloop() File "/opt/pypy_2_beta2/lib-python/2.7/cmd.py", line 109, in cmdloop self.preloop() File "<http://ci.cod/job/pypy/ws/rpython/translator/tool/pdbplus.py",> line 29, in preloop raise NoTTY("Cannot start the debugger when stdout is captured.") NoTTY: Cannot start the debugger when stdout is captured. Build step 'Execute shell' marked build as failure

1 0

intrinsics for special instructions
by Nathan Hurst 30 Jul '13

30 Jul '13

Is there a way to call special operators such as __builtin_popcount from within pypy? regards, njh

2 1

parallel building
by Nathan Hurst 29 Jul '13

29 Jul '13

Dear mailing list, I have looked around the web and through the various makefiles and pypy/goal/targetpypystandalone.py and I can't work out how to make pypy build using more cores. I have plenty of RAM (64GB) but the build is only using a single core. Is it possible? njh

5 6