Mailman 3 May 2011 - pypy-dev

Building pypy on freebsd 64bit
by Shadrin Eugene 18 Nov '11

18 Nov '11

Hi! I tryed to build pypy on the freebsd, 64bit platform, but failed. First of all I downloaded a 32bit-Python to run pypy. And then: [user@server_name ~/pypy-trunk/pypy/translator/goal]$ ~/py32/bin/python translate.py -Ojit [translation:info] Translating target as defined by targetpypystandalone [platform:execute] gcc -m32 -c -O3 -pthread -fomit-frame-pointer /var/tmp/usession-trunk-22/gcctest.c -o /var/tmp/usession-trunk-22/gcctest.o [platform:WARNING] /var/tmp/usession-trunk-22/gcctest.c:28:2: warning: no newline at end of file [platform:execute] gcc -m32 /var/tmp/usession-trunk-22/gcctest.o -L/lib32 -L/usr/lib32 -L`pwd`/lib32 -Wl,-rpath,/lib32 -Wl,-rpath,/usr/lib32 -pthread -o /var/tmp/usession-trunk-22/gcctest printf("sizeof short=%ld\n", (long)sizeof(short)); printf("sizeof unsigned short=%ld\n", (long)sizeof(unsigned short)); printf("sizeof int=%ld\n", (long)sizeof(int)); printf("sizeof unsigned int=%ld\n", (long)sizeof(unsigned int)); printf("sizeof long=%ld\n", (long)sizeof(long)); printf("sizeof unsigned long=%ld\n", (long)sizeof(unsigned long)); printf("sizeof signed char=%ld\n", (long)sizeof(signed char)); printf("sizeof unsigned char=%ld\n", (long)sizeof(unsigned char)); printf("sizeof long long=%ld\n", (long)sizeof(long long)); printf("sizeof unsigned long long=%ld\n", (long)sizeof(unsigned long long)); printf("sizeof size_t=%ld\n", (long)sizeof(size_t)); printf("sizeof time_t=%ld\n", (long)sizeof(time_t)); printf("sizeof wchar_t=%ld\n", (long)sizeof(wchar_t)); printf("sizeof mode_t=%ld\n", (long)sizeof(mode_t)); printf("sizeof pid_t=%ld\n", (long)sizeof(pid_t)); sizeof short=2 sizeof unsigned short=2 sizeof int=4 sizeof unsigned int=4 sizeof long=8 sizeof unsigned long=8 sizeof signed char=1 sizeof unsigned char=1 sizeof long long=8 sizeof unsigned long long=8 sizeof size_t=8 sizeof time_t=8 sizeof wchar_t=4 sizeof mode_t=2 sizeof pid_t=4 Traceback (most recent call last): File "translate.py", line 300, in <module> main() File "translate.py", line 205, in main targetspec_dic, translateconfig, config, args = parse_options_and_load_target() File "translate.py", line 153, in parse_options_and_load_target targetspec_dic = load_target(targetspec) File "translate.py", line 105, in load_target mod = __import__(specname) File "targetpypystandalone.py", line 5, in <module> from pypy.objspace.std.objspace import StdObjSpace File "/place/home/hitrobot/pypy-trunk/pypy/objspace/std/__init__.py", line 1, in <module> from pypy.objspace.std.objspace import StdObjSpace File "/place/home/hitrobot/pypy-trunk/pypy/objspace/std/objspace.py", line 3, in <module> from pypy.interpreter import pyframe, function, special File "/place/home/hitrobot/pypy-trunk/pypy/interpreter/pyframe.py", line 13, in <module> from pypy.rlib import jit, rstack File "/place/home/hitrobot/pypy-trunk/pypy/rlib/rstack.py", line 10, in <module> from pypy.rpython.lltypesystem import rffi, lltype File "/place/home/hitrobot/pypy-trunk/pypy/rpython/lltypesystem/rffi.py", line 824, in <module> sys.maxint, sizeof(lltype.Signed))) AssertionError: Mixed configuration of the word size of the machine: the underlying Python was compiled with maxint=2147483647, but the C compiler says that 'long' is 8 bytes I got this error, then I added "-m32" flag to gcc argument list (in the posix.py source file) , but error occured again :( Does anybody tryed to build pypy-c on the 64bit FreeBsd? Thank you for your answer! -- Shadrin Eugene

5 7

unable to translate with current head of default
by wlavrijsen＠lbl.gov 06 Jul '11

06 Jul '11

Hi, running into the following traceback when translating. Any ideas? My machine too old to have certain features? Thanks! Best regards, Wim Lavrijsen [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 306, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 809, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/tool/taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 286, in _do [translation:ERROR] res = func() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 397, in task_pyjitpl_lltype [translation:ERROR] backend_name=self.config.translation.jit_backend, inline=True) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/jit/metainterp/warmspot.py", line 50, in apply_jit [translation:ERROR] warmrunnerdesc.finish() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/jit/metainterp/warmspot.py", line 210, in finish [translation:ERROR] self.annhelper.finish() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/rpython/annlowlevel.py", line 240, in finish [translation:ERROR] self.finish_annotate() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/rpython/annlowlevel.py", line 259, in finish_annotate [translation:ERROR] ann.complete_helpers(self.policy) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 176, in complete_helpers [translation:ERROR] self.complete() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 250, in complete [translation:ERROR] self.processblock(graph, block) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 448, in processblock [translation:ERROR] self.flowin(graph, block) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 508, in flowin [translation:ERROR] self.consider_op(block.operations[i]) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 710, in consider_op [translation:ERROR] raise_nicer_exception(op, str(graph)) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 707, in consider_op [translation:ERROR] resultcell = consider_meth(*argcells) [translation:ERROR] File "<4237-codegen /home/wlav/pypydev/pypy/pypy/annotation/annrpython.py:745>", line 3, in consider_op_getattr [translation:ERROR] return arg.getattr(*args) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/unaryop.py", line 606, in getattr [translation:ERROR] attrdef = ins.classdef.find_attribute(attr) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 217, in find_attribute [translation:ERROR] return self.locate_attribute(attr).attrs[attr] [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 212, in locate_attribute [translation:ERROR] self.generalize_attr(attr) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 307, in generalize_attr [translation:ERROR] self._generalize_attr(attr, s_value) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 297, in _generalize_attr [translation:ERROR] newattr.mutated(self) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 137, in mutated [translation:ERROR] raise NoSuchAttrError(homedef, self.name) [translation:ERROR] NoSuchAttrError': (<ClassDef 'pypy.jit.backend.x86.regloc.AssemblerLocation'>, 'is_xmm') [translation:ERROR] .. v0 = getattr(loc_0, ('is_xmm')) [translation:ERROR] .. '(pypy.jit.backend.x86.assembler:671)Assembler386._assemble_bootstrap_direct_call' [translation:ERROR] Processing block: [translation:ERROR] block@150 is a <class 'pypy.objspace.flow.flowcontext.SpamBlock'> [translation:ERROR] in (pypy.jit.backend.x86.assembler:671)Assembler386._assemble_bootstrap_direct_call [translation:ERROR] containing the following operations: [translation:ERROR] v0 = getattr(loc_0, ('is_xmm')) [translation:ERROR] v1 = is_true(v0) [translation:ERROR] --end-- -- WLavrijsen(a)lbl.gov -- +1 (510) 486 6411 -- www.lavrijsen.net

5 16

Performance challenge of mutating class variables
by David Edelsohn 10 Jun '11

10 Jun '11

I mentioned this issue in a private conversation with Carl and he suggested that I send the details to the mailinglist. The following blog post is a nice summary of a significant performance problem in IronPython's early implementation with good links to the key discussions: http://ironpython-urls.blogspot.com/2009/05/python-jython-and-ironpython.ht… Robert Smallshire implemented OWL Basic in IronPython and experienced some massive slowdowns relative to CPython and Jython. IronPython developer Dino Diehland investigated the problem and wrote an detailed blog post about the problem and the fix implemented in IronPython. The problem was due to the user program's use of a class variable as a counter, which caused "unfortunate" behavior in the IronPython implementation -- mutating the variable invalidated the cache. PyPy shows a good speedup compared with CPython already, but it is an interesting corner case. The smaller testcase created by Robert might be a good benchmark to add to PyPy Speed Center (http://www.smallshire.org.uk/sufficientlysmall/2009/05/22/ironpython-2-0-an…). - David

7 12

Compiling PyPy 1.5 fails on Slackware 13.37
by Audrius Kažukauskas 06 Jun '11

06 Jun '11

Hi, I've reported this on #pypy yesterday, but I thought this might be a better place for this kind of information. I've tried to build PyPy 1.5 from source on Slackware 13.37 (32-bit LXC container, while the host and kernel are 64-bit; both systems Slackware) and got an exception[0] in the last stage of the build process (compilation). [0] http://paste.pocoo.org/show/387121/ Here are some bits of information about the system used: gcc 4.5.2, glibc 2.13. If you need anything else, I'll be happy to report it. I also still have all the .c files created by translation process, if any of those are needed, just tell me where to send them. -- Audrius Kažukauskas

3 3

List Slicing Performance Drop
by Mohyiddeen Othman 31 May '11

31 May '11

Hi, I've been recently doing Project Euler puzzles using Python, and have recently started to use PyPy to increase performance. However I've come across something (no pun intended) puzzling. I made this script for Euler #50. http://pastebin.com/VZ12Nsci It calculates all the primes under 1M first, then looks through them for a solution. The first part (finding primes) is blazing fast under PyPy (as expected). But in the second part PyPy lags behind. CPython managed it in 183s, while PyPy did it in 498s. I'm assuming it has something to do with the list slicing?

3 4

Re: [pypy-dev] [Cython] [GSoC] Blog post regarding the Cython backend aiming PyPy
by Romain Guillebert 31 May '11

31 May '11

On Tue, May 31, 2011 at 12:08:52PM +0200, mark florisson wrote: > Cool. Would it be useful to always generate wrapper functions for > extern functions with numeric argument types? E.g. this is valid > Cython code: > > cdef extern from "foo.h": > ctypedef unsigned int size_t > size_t func_with_typedef_arg(size_t a) > > So here the ctypedef for size_t is unsigned int, which is only valid > in C for some platforms/architectures. So perhaps a wrapper function > could solve that issue: > > int __pyx_wrapper_func_with_typedef_arg(int a) { > /* some bounds and sign checking code here ? */ > return func_with_typedef(a); > } > > Because then you always know that calling it with argtypes = [c_int] > and restype = c_int is valid. > (BTW, it's also valid to declare something as a function which is > actually a macro, so I suppose you always need wrappers for > functions.) > > Do you already have an idea how to handle struct type arguments? Those > are often also incomplete... but perhaps I'm geting too far ahead, I > don't think we're quite there yet. I suppose you could also place this > ABI burden on the user (for now), as does ctypes. > > As for the linking stuff, perhaps it's a good idea to look at > http://wiki.cython.org/enhancements/distutils_preprocessing (currently > down unfortunately, but in google cache). Then you can list libraries > like this: '# distutils: libraries = spam eggs' at the top of the > file. > > Cheers, > > Mark Hi Mark For the moment, I try to handle the standard case : call a function with C basic types, then add structures and pass by pointer. To deal with the ABI, fijal told me that there's a tool called ctypes_configure, I will investigate this to see what I can get from it. Cheers Romain

1 0

[freebsd] pypy core dumps on unit tests (AssertionError)
by David Naylor 31 May '11

31 May '11

Hi, I've run the unit tests for pypy and pypy-stackless on FreeBSD and at some stage the tests causes pypy(-stackless) to core dump. Here are the results: # pypy1.5 -c "from test import testall" <snip/> test_capi internal test_L_code internal test_broken_memoryview RPython traceback: File "implement_3.c", line 63565, in _PyObject_New File "implement_3.c", line 65132, in _PyObject_NewVar File "implement_3.c", line 31701, in from_ref Fatal RPython error: AssertionError Abort (core dumped) # pypy-stackless1.5 -c "from test import testall" <snip/> test_capi internal test_L_code internal test_broken_memoryview RPython traceback: File "implement_1.c", line 241860, in _PyObject_NewVar File "implement_1.c", line 165468, in from_ref Fatal RPython error: AssertionError Abort (core dumped) Is there any other debug information needed? And how can I help fix this? Also, how would one run the unit tests under sandbox? Regards, David

2 1

[Cython] [GSoC] Blog post regarding the Cython backend aiming PyPy
by mark florisson 31 May '11

31 May '11

On 30 May 2011 23:31, Romain Guillebert <romain.py(a)gmail.com> wrote: > Hi > > I've posted and article on my blog that explains what I've done during > the community bonding period and the first week of the Google Summer of > Code : > http://rguillebert.blogspot.com/2011/05/cython-backend-aiming-pypy-week-1.h… > > Cheers > Romain > _______________________________________________ > cython-devel mailing list > cython-devel(a)python.org > http://mail.python.org/mailman/listinfo/cython-devel > Cool. Would it be useful to always generate wrapper functions for extern functions with numeric argument types? E.g. this is valid Cython code: cdef extern from "foo.h": ctypedef unsigned int size_t size_t func_with_typedef_arg(size_t a) So here the ctypedef for size_t is unsigned int, which is only valid in C for some platforms/architectures. So perhaps a wrapper function could solve that issue: int __pyx_wrapper_func_with_typedef_arg(int a) { /* some bounds and sign checking code here ? */ return func_with_typedef(a); } Because then you always know that calling it with argtypes = [c_int] and restype = c_int is valid. (BTW, it's also valid to declare something as a function which is actually a macro, so I suppose you always need wrappers for functions.) Do you already have an idea how to handle struct type arguments? Those are often also incomplete... but perhaps I'm geting too far ahead, I don't think we're quite there yet. I suppose you could also place this ABI burden on the user (for now), as does ctypes. As for the linking stuff, perhaps it's a good idea to look at http://wiki.cython.org/enhancements/distutils_preprocessing (currently down unfortunately, but in google cache). Then you can list libraries like this: '# distutils: libraries = spam eggs' at the top of the file. Cheers, Mark

1 0

Pull requests and other stuff from bitbucket
by Armin Rigo 31 May '11

31 May '11

Hi all, hi Anto, On Bitbucket, the user PyPy has still an e-mail address that goes only to Antonio. It's used at least by the pull requests and fork notifications. It seems that we'd like to see them more widely. Antonio, would it make sense to change that address to arrive to the pypy-commit list? A bientôt, Armin.

3 3

[GSoC] Blog post regarding the Cython backend aiming PyPy
by Romain Guillebert 30 May '11

30 May '11

Hi I've posted and article on my blog that explains what I've done during the community bonding period and the first week of the Google Summer of Code : http://rguillebert.blogspot.com/2011/05/cython-backend-aiming-pypy-week-1.h… Cheers Romain

1 0