Mailman 3 June 2011 - pypy-dev

Building pypy on freebsd 64bit
by Shadrin Eugene 18 Nov '11

18 Nov '11

Hi! I tryed to build pypy on the freebsd, 64bit platform, but failed. First of all I downloaded a 32bit-Python to run pypy. And then: [user@server_name ~/pypy-trunk/pypy/translator/goal]$ ~/py32/bin/python translate.py -Ojit [translation:info] Translating target as defined by targetpypystandalone [platform:execute] gcc -m32 -c -O3 -pthread -fomit-frame-pointer /var/tmp/usession-trunk-22/gcctest.c -o /var/tmp/usession-trunk-22/gcctest.o [platform:WARNING] /var/tmp/usession-trunk-22/gcctest.c:28:2: warning: no newline at end of file [platform:execute] gcc -m32 /var/tmp/usession-trunk-22/gcctest.o -L/lib32 -L/usr/lib32 -L`pwd`/lib32 -Wl,-rpath,/lib32 -Wl,-rpath,/usr/lib32 -pthread -o /var/tmp/usession-trunk-22/gcctest printf("sizeof short=%ld\n", (long)sizeof(short)); printf("sizeof unsigned short=%ld\n", (long)sizeof(unsigned short)); printf("sizeof int=%ld\n", (long)sizeof(int)); printf("sizeof unsigned int=%ld\n", (long)sizeof(unsigned int)); printf("sizeof long=%ld\n", (long)sizeof(long)); printf("sizeof unsigned long=%ld\n", (long)sizeof(unsigned long)); printf("sizeof signed char=%ld\n", (long)sizeof(signed char)); printf("sizeof unsigned char=%ld\n", (long)sizeof(unsigned char)); printf("sizeof long long=%ld\n", (long)sizeof(long long)); printf("sizeof unsigned long long=%ld\n", (long)sizeof(unsigned long long)); printf("sizeof size_t=%ld\n", (long)sizeof(size_t)); printf("sizeof time_t=%ld\n", (long)sizeof(time_t)); printf("sizeof wchar_t=%ld\n", (long)sizeof(wchar_t)); printf("sizeof mode_t=%ld\n", (long)sizeof(mode_t)); printf("sizeof pid_t=%ld\n", (long)sizeof(pid_t)); sizeof short=2 sizeof unsigned short=2 sizeof int=4 sizeof unsigned int=4 sizeof long=8 sizeof unsigned long=8 sizeof signed char=1 sizeof unsigned char=1 sizeof long long=8 sizeof unsigned long long=8 sizeof size_t=8 sizeof time_t=8 sizeof wchar_t=4 sizeof mode_t=2 sizeof pid_t=4 Traceback (most recent call last): File "translate.py", line 300, in <module> main() File "translate.py", line 205, in main targetspec_dic, translateconfig, config, args = parse_options_and_load_target() File "translate.py", line 153, in parse_options_and_load_target targetspec_dic = load_target(targetspec) File "translate.py", line 105, in load_target mod = __import__(specname) File "targetpypystandalone.py", line 5, in <module> from pypy.objspace.std.objspace import StdObjSpace File "/place/home/hitrobot/pypy-trunk/pypy/objspace/std/__init__.py", line 1, in <module> from pypy.objspace.std.objspace import StdObjSpace File "/place/home/hitrobot/pypy-trunk/pypy/objspace/std/objspace.py", line 3, in <module> from pypy.interpreter import pyframe, function, special File "/place/home/hitrobot/pypy-trunk/pypy/interpreter/pyframe.py", line 13, in <module> from pypy.rlib import jit, rstack File "/place/home/hitrobot/pypy-trunk/pypy/rlib/rstack.py", line 10, in <module> from pypy.rpython.lltypesystem import rffi, lltype File "/place/home/hitrobot/pypy-trunk/pypy/rpython/lltypesystem/rffi.py", line 824, in <module> sys.maxint, sizeof(lltype.Signed))) AssertionError: Mixed configuration of the word size of the machine: the underlying Python was compiled with maxint=2147483647, but the C compiler says that 'long' is 8 bytes I got this error, then I added "-m32" flag to gcc argument list (in the posix.py source file) , but error occured again :( Does anybody tryed to build pypy-c on the 64bit FreeBsd? Thank you for your answer! -- Shadrin Eugene

5 7

Re: [pypy-dev] bounties for pypy
by Laura Creighton 16 Sep '11

16 Sep '11

>The idea was also to possibly attract new developers ... for example, if >there would be "10 days in money" for adapting py2exe, I am sure many wou >ld >jump to solve this puzzle. This is sort of a bad example. Because py2exe embeds CPython, and we wouldn't want to do that. So what we would probably want to do is to make some general tool that willmake a windows binary, or a mac one, and get rid of the need for bzfreeze and friends. So now you are looking at a general embedding solution, and that is more than 10 days worth of work. But I get the idea. <snip> >> my dream was of a trustee service: after somebody commits to do the wor >k, >the pledgers have to pay to a trustee. then the work is done. then the >trustee pays the worker. This is one of the things I want to talk with fundedbyme about. But having an explicit trustee is a new idea. I think the pypy core developers are already rather well trusted in this community, but this may be important to new developers who aren't as well known. And it handles the problem' of 'I got sick and cannot do this any more' more gracefully than other solutions. >Hmmm.... a structure could be: > >- service provider does the technical stuff, as in: > # website > # collect pledges > # handle project description > # collect money > # distribute money after feature completion fundedbyme has sort of indicated an interst in doing this (except they were talking about distribution before, and I was leaving project description to the project, not outsiders). I will follow up on this when I get back home to Sweden. >- PSF / pypy-foundation / whateverfoundation provides the trust > >Thanks for confirming the need for such a thing! > >Harald Thanks once again for seeing a marketing solution that nerds like us often miss. Laura

6 12

Great results for MyHDL simulations
by Jan Decaluwe 01 Sep '11

01 Sep '11

I am seeing great improvements for MyHDL simulations by using PyPy, and I have written a page about it: http://www.myhdl.org/doku.php/performance I have asked for feedback from the MyHDL community to confirm these results, before creating some more buzz in the hardware design world :-) Thanks! Jan Decaluwe -- Jan Decaluwe - Resources bvba - http://www.jandecaluwe.com Python as a HDL: http://www.myhdl.org VHDL development, the modern way: http://www.sigasi.com Analog design automation: http://www.mephisto-da.com World-class digital design: http://www.easics.com

3 4

pypy 1.5 on Windows: sqlite connection args
by Caleb Hattingh 08 Jul '11

08 Jul '11

In lib-pypy/_sqlite3.py, line 239 (in Win 1.5 stable release) in class Connection(object): def __init__(self, database, isolation_level="", detect_types=0, timeout=None, cached_statements=None, factory=None): ...might need to become: def __init__(self, database, isolation_level="", detect_types=0, timeout=None, cached_statements=None, factory=None, *check_same_thread=False *): I am testing the web framework web2py against pypy, and this issue came up. I don't know too much about sqlite itself. Spent a lot of time modifying code to explicitly close file handles because of the different behaviour of the ref counting cpython vs. the gc pypy.

2 1

unable to translate with current head of default
by wlavrijsen＠lbl.gov 06 Jul '11

06 Jul '11

Hi, running into the following traceback when translating. Any ideas? My machine too old to have certain features? Thanks! Best regards, Wim Lavrijsen [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 306, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 809, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/tool/taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 286, in _do [translation:ERROR] res = func() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/translator/driver.py", line 397, in task_pyjitpl_lltype [translation:ERROR] backend_name=self.config.translation.jit_backend, inline=True) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/jit/metainterp/warmspot.py", line 50, in apply_jit [translation:ERROR] warmrunnerdesc.finish() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/jit/metainterp/warmspot.py", line 210, in finish [translation:ERROR] self.annhelper.finish() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/rpython/annlowlevel.py", line 240, in finish [translation:ERROR] self.finish_annotate() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/rpython/annlowlevel.py", line 259, in finish_annotate [translation:ERROR] ann.complete_helpers(self.policy) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 176, in complete_helpers [translation:ERROR] self.complete() [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 250, in complete [translation:ERROR] self.processblock(graph, block) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 448, in processblock [translation:ERROR] self.flowin(graph, block) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 508, in flowin [translation:ERROR] self.consider_op(block.operations[i]) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 710, in consider_op [translation:ERROR] raise_nicer_exception(op, str(graph)) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/annrpython.py", line 707, in consider_op [translation:ERROR] resultcell = consider_meth(*argcells) [translation:ERROR] File "<4237-codegen /home/wlav/pypydev/pypy/pypy/annotation/annrpython.py:745>", line 3, in consider_op_getattr [translation:ERROR] return arg.getattr(*args) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/unaryop.py", line 606, in getattr [translation:ERROR] attrdef = ins.classdef.find_attribute(attr) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 217, in find_attribute [translation:ERROR] return self.locate_attribute(attr).attrs[attr] [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 212, in locate_attribute [translation:ERROR] self.generalize_attr(attr) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 307, in generalize_attr [translation:ERROR] self._generalize_attr(attr, s_value) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 297, in _generalize_attr [translation:ERROR] newattr.mutated(self) [translation:ERROR] File "/home/wlav/pypydev/pypy/pypy/annotation/classdef.py", line 137, in mutated [translation:ERROR] raise NoSuchAttrError(homedef, self.name) [translation:ERROR] NoSuchAttrError': (<ClassDef 'pypy.jit.backend.x86.regloc.AssemblerLocation'>, 'is_xmm') [translation:ERROR] .. v0 = getattr(loc_0, ('is_xmm')) [translation:ERROR] .. '(pypy.jit.backend.x86.assembler:671)Assembler386._assemble_bootstrap_direct_call' [translation:ERROR] Processing block: [translation:ERROR] block@150 is a <class 'pypy.objspace.flow.flowcontext.SpamBlock'> [translation:ERROR] in (pypy.jit.backend.x86.assembler:671)Assembler386._assemble_bootstrap_direct_call [translation:ERROR] containing the following operations: [translation:ERROR] v0 = getattr(loc_0, ('is_xmm')) [translation:ERROR] v1 = is_true(v0) [translation:ERROR] --end-- -- WLavrijsen(a)lbl.gov -- +1 (510) 486 6411 -- www.lavrijsen.net

5 16

algorithm used for float -> str conversion
by Alexandre Fayolle 06 Jul '11

06 Jul '11

Hello, I just came across http://www.serpentine.com/blog/2011/06/29/here-be-dragons- advances-in-problems-you-didnt-even-know-you-had/ which talk about a paper submitted last year about a fast float -> str conversion routine. I don't know what is currently used in pypy (or in Python actually), probably the underlying libc's implementation, but this could be something interesting for people writing lots of floats in csv files. Cheers -- Alexandre Fayolle LOGILAB, Paris (France) Formations Python, CubicWeb, Debian : http://www.logilab.fr/formations Développement logiciel sur mesure : http://www.logilab.fr/services Informatique scientifique: http://www.logilab.fr/science

3 3

Re: [pypy-dev] bounties for pypy
by Laura Creighton 30 Jun '11

30 Jun '11

In a message of Tue, 28 Jun 2011 17:40:29 +0200, "Massa, Harald Armin" writes: Hi Harald! Note that we are pypy-dev(a)python.org these days. >has anyone already setup a bounties page for pypy-enabling modules? No. We just had the idea of doing it very recently. >Or had that idea and trashed it, because bounties won't be motivating any >of the pypy-capable developers? No, but it took the reception of Europython, where I met many people who would pay for GIL removal, for instance, before I got the idea that crowdsourcing would work for us. So we have been discussing this at this sprint. >I am dreaming of something like: > > >module: py2exe > >person_a pledging x money units for an adaption >person_b pledging y money units for an adaption >person_c pledging z money units for an adaption > >collectivly there are (x+y+z) money units pledged; (x+y+z) is over the >boredome-treshhold, and it gets realised. > >a pypy-able guy claims the work, the pledges are collected, and after >finishing the money is given to the work-doer. I think we want to say who wants to do the work, and how soon they could start before we collect the pledges. For things that are complicated, like 'kill the GIL' and 'numpy integration' we would need to do the spelling out of exactly what it is that we would be willing to do. I'm also open to the idea of crowdsourcing the idea of adding feature requests. I'd rather get paid up front, as well, for things that take months and or years to do. >Quite sure there are existing commercial entitities who do exactly this, >but >is there a subarea for pypy? Or am I just missing the link from the main >page? After 4 days of looking I have not found a commercial entity that does this. But I have been talking to fundedbyme, a Swedish based international competitor for kickstarter. The nice thing is that fundedbyme is a Django app. I've been talking to one of the founders, and they would like to share code with us, or set up a way to benefit open source programs in general. When the PyPy Sprint is over, and I am done a few days of vacation, I will return to Sweden, and go meet with these people. They are pypy fans already. In the meantime, if you find a commercial entity which is doing what we want already, do let me know. For me it is a matter of balancing the benefit of being paid by a hundred people in 25 Euro chunks, vs the hassle of having to return money already pledged via paypal or some service if the feature doesn't receive enough funding, (if we collect before the work starts) or going after deadbeat promisers who never pay (if we collect after the work is done). What was clear to me was that there was enough public support for PyPy that we could really live on the cash donations of people wanting to pay what they could to get feature X. The community based support is there. So now I just have to find a way to implement it. > >Harald Send ideas this way. Laura

4 3

New Fast machine for benchmarks!!
by Laura Creighton 30 Jun '11

30 Jun '11

Yippee!! Everybody please thank Jesse Noller when you see him. :-) Laura ------- Forwarded Message Date: Thu, Jun 30, 2011 at 12:05 AM Subject: speed.python.org machine online To: Python-Dev <python-dev(a)python.org>, pypy-dev(a)codespeak.net I've posted a more expansive entry on my blog: http://jessenoller.com/2011/06/29/announcing-the-new-speed-python-org-machi… But the short version, that as discussed at the VM and language summit, we now have a hosted machine dedicated to the running of cross-interpreter speed tests, etc. The hardware was generously donate by HP and the hosting provided, again, free, by OSU/OSL. DL380 HP DL380G7 X5670 LFF (2U) Dual HP NC382i Dual Port Multifunction Gigabit Server Adapters HP Smart Array P410i/1GB FBWC Controller 4x 4GB (1x4GB) Dual Rank x4 PC3-10600 (DDR3-1333) Registered CAS-9 Memory Kit 2x HP 750W Common Slot Gold Hot Plug Power Supply Kit HP iLO Advanced including 1yr 24x7 Technical Support and Updates Electronic License 4x HP 300GB 6G SAS 15K rpm LFF (3.5-inch) Dual Port Enterprise 3yr Warranty Hard Drive 2 HP DL380 G7 Intel® Xeon® X5680 (3.33GHz/6-core/130W/12MB) FIO Processor Kit With hyperthreading on, the machine has 24 cores, and handily translates pypy using cpython 2.7 in about half the time it typically takes. I am looking forward to handing this over to the team who will be running with the project from here on out - special thanks to Van, Bob Gobeille at HP and the entire OSU/OSL team. jesse ------- End of Forwarded Message

1 0

bounties for pypy
by Massa, Harald Armin 28 Jun '11

28 Jun '11

has anyone allready setup a bounties page for pypy-enabling modules? Or had that idea and trashed it, because bounties won't be motivating any of the pypy-capable developers? I am dreaming of something like: module: py2exe person_a pledging x money units for an adaption person_b pledging y money units for an adaption person_c pledging z money units for an adaption collectivly there are (x+y+z) money units pledged; (x+y+z) is over the boredome-treshhold, and it gets realised. a pypy-able guy claims the work, the pledges are collected, and after finishing the money is given to the work-doer. Quite sure there are existing commercial entitities who do exactly this, but is there a subarea for pypy? Or am I just missing the link from the main page? Harald -- GHUM GmbH Harald Armin Massa Spielberger Straße 49 70435 Stuttgart 0173/9409607 Amtsgericht Stuttgart, HRB 734971 - persuadere. et programmare

2 1

Bitbucket? Why not python.org
by Christian Tismer 28 Jun '11

28 Jun '11

Hi friends, the subject line says it all... I'm in the progress of updating stackless to use mercurial on python.org and talked to Martin v. Loewis who pointed out the restrictions of Bitbucket. Besides the impression that Bitbucket is pretty slow, it is also not possible to add our own hooks to it. I'm pretty sure python.org would be happy to host PyPy. Is there any good reason why we don't ask and move to python.org? cheers - chris -- Christian Tismer :^)<mailto:tismer@stackless.com> tismerysoft GmbH : Have a break! Take a ride on Python's Johannes-Niemeyer-Weg 9A : *Starship* http://starship.python.net/ 14109 Berlin : PGP key -> http://wwwkeys.pgp.net/ work +49 30 802 86 56 mobile +49 173 24 18 776 fax +49 30 80 90 57 05 PGP 0x57F3BF04 9064 F4E1 D754 C2FF 1619 305B C09C 5A3B 57F3 BF04 whom do you want to sponsor today? http://www.stackless.com/

7 11