Mailman 3 May 2012 - pypy-dev

Can someone review my RPython code?
by Timothy Baldridge May 27, 2012

May 27, 2012

So here's the current status of my Polymorphic functions in as a pypy module: https://bitbucket.org/halgari/pypy/src/d9e7191d13df/pypy/module/clojure/fun… I have a question about the way "space" is handled. My problem is this, I'd like to create several instances of PolymorphicFn on the interpreter level, so I can register some types with the function when the module is loaded. However, I'm not sure how I should do this. If I don't implement __new__ pypy complains that "using object.__new__ is dangerous, use MyClass.__new__ instead". However, if I implement __new__ I have to pass a space object in. Anyway, I'm sorry if I'm not making much sense here, but I guess I'm not too clear on how to create "global" objects. For instance, given my above functions.py file, how do I do this: first = PolymorphicFn() first.extend(space.type(space.wrap(None)), space.wrap(lambda w_x: None)) first.extend(Cons.typedef, Cons.typedef.rawdict("first")) To do this, I need an instance of space, but how do I get this in a global (module level) context? Thanks for any help. Timothy

2 1

checkpointing pypy sandbox in dmtcp
by Naveen Garg May 27, 2012

May 27, 2012

I couldn't figure out what antonio cuni was trying to do with the dmtcp python api here: https://bitbucket.org/antocuni/misc/src/73621b70935f/hack/checkpointing/dmt… anyways, Running the pypy interpreter in dmtcp seems to work out of the box. This works even with the sandboxed interpreter. I did: 1. translate the sandbox using instructions here: http://doc.pypy.org/en/latest/sandbox.html 2. mv pypy-c ~/bin/pypy/bin/pypy-c-sandbox bash1> dmtcp_coordinator bash2> dmtcp_checkpoint python pypy_interact.py --tmp=myexported ~/bin/pypy/bin/pypy-c-sandbox bash1> c<enter> # save checkpoint bash2> <ctrl>-c # crash pypy sandbox bash2> dmtcp_restart_script.sh # revive pypy sandbox :) profit

1 0

Differences between app and interp level calling methods
by Timothy Baldridge May 27, 2012

May 27, 2012

For my clojure module, I'm trying to figure out if I should go with app level or interp level code. Many of my classes will do dispatching on __call__ or the equivalent. Are interpreter level variadic functions going to be faster (via call_args) vs an app level __call__(self, args_w) ? A bit more background here, Clojure functions dispatch on the number of arguments: (defn + [x] x [x y] (add x y)) [x y & rest] (reduce + (add x y) rest)) For something like this, am I going to see much of a performance boost by dropping to the interpreter level from the dispatch between these three sub-function types? Thanks, Timothy -- “One of the main causes of the fall of the Roman Empire was that–lacking zero–they had no way to indicate successful termination of their C programs.” (Robert Firth)

2 1

Unsubscribe Newsletter ENS
by ENS Newsletter May 27, 2012

May 27, 2012

1 0

buildmaster moved
by Armin Rigo May 25, 2012

May 25, 2012

Hi all, Wyvern, which was the machine serving a few PyPy-related services --- most notably the buildmaster and the nightly builds at buildbot.pypy.org --- more or less died a few days ago. It was after a long life: we had the server around 2005, and now the particular small piece that broke down is no longer found. For information the hard drive was broken once already and is not as old as the rest. So David and remotely Antonio moved the HD inside another machine and reconfigured the DNS. All services should be back on-line now. Thanks to them :-) If you're running a buildslave, please make sure that its file buildbot.tac points to "buildbot.pypy.org" and not explicitly to "wyvern.cs.uni-duesseldorf.de". The latter no longer points to anything. A bientôt, Armin.

1 0

PyPy Sprint in Leipzig is approaching
by Mike Müller May 25, 2012

May 25, 2012

Hi all, It is only four weeks till the sprint in Leipzig. So it is not too earlier to get started with travel planning. Details about the sprint are here: http://morepypy.blogspot.de/2012/04/pypy-sprint-in-leipzig-june-22-27.html If you plan to attend please add you name here: https://bitbucket.org/pypy/extradoc/raw/extradoc/sprintinfo/leipzig2012/peo… Here is a short list of hotels nearby: http://www.python-academy.com/center/accommodation.html You can also stay in the city center. Public transportation is fast and frequent. It should take about 25 - 30 minutes from a inner city hotel to the sprint location. You can ask me if you have any questions about location or accommodation. Cheers, Mike

1 0

bug with MinGW32
by bookaa May 25, 2012

May 25, 2012

I download last version of PyPy source from https://github.com/pypy/pypy in MinGW32 (mingw-get-inst-20120426.exe), run: pypy/bin/py.py --cc=mingw32-gcc get error: pypy.translator.platform.CompilationError: CompilationError(err=""" e:\tem\usession-unknown-1\gcctest.c: In function 'main': e:\tem\usession-unknown-1\gcctest.c:25:51: error: 'uintptr_t' undeclared (first use in this function) this is how I fix this bug: diff -crN pypy\rpython\tool\rfficache.py pypy\rpython\tool\rfficache.bookaa.py *** pypy\rpython\tool\rfficache.py Mon May 21 14:45:32 2012 --- pypy\rpython\tool\rfficache.bookaa.py Wed May 23 08:07:33 2012 *************** *** 13,19 **** from pypy.tool.gcc_cache import build_executable_cache def ask_gcc(question, add_source=""): ! includes = ['stdlib.h', 'stdio.h', 'sys/types.h'] if os.name != 'nt': includes += ['inttypes.h'] include_string = "\n".join(["#include <%s>" % i for i in includes]) --- 13,19 ---- from pypy.tool.gcc_cache import build_executable_cache def ask_gcc(question, add_source=""): ! includes = ['stdlib.h', 'stdio.h', 'sys/types.h', 'stdint.h'] if os.name != 'nt': includes += ['inttypes.h'] include_string = "\n".join(["#include <%s>" % i for i in includes]) diff -crN pypy\rlib\rposix.py pypy\rlib\rposix.bookaa.py *** pypy\rlib\rposix.py Mon May 21 14:45:32 2012 --- pypy\rlib\rposix.bookaa.py Wed May 23 08:29:36 2012 *************** *** 24,29 **** --- 24,30 ---- separate_module_sources =[''' /* Lifted completely from CPython 3.3 Modules/posix_module.c */ #include <malloc.h> /* for _msize */ + #include <stdint.h> /* for intptr_t */ typedef struct { intptr_t osfhnd; char osfile;

5 6

Jit hints from python
by Timothy Baldridge May 25, 2012

May 25, 2012

While looking at ways to optimize the Clojure-Py code (http://github.com/halgari/clojure-py) for pypy, I'm noticing that much of Clojure-Py could benefit greatly from giving purefunction hints to the JIT. For example, let's look at the polymorphic Clojure functions known as "protocols": def ProtocolFn(object): def __init__(self): self.d = {} def extend(self, tp, fn): self.d[tp] = fn def getFn(self, tp): return self.d[tp] def __call__(self, *args, **kw): return self.getFn(type(args[0]))(*args **kw) Now, if I was writing this in RPython I would have extend clone the dictionary each time, then makr getFn as "pure" and suddenly I'd expect to see the JIT start in-lining calls to this ProtocolFn, and I would also expect to see a rather major performance boost. Also, since the majority of Clojure code deals with immutable data structures, I could actually mark 80% of my data structure functions as pure. So my question is, how easy/hard would it be to somehow get a @purefunction decorator in Python instead of just RPython? For that matter, having __immutable_fields__ would also be nice, but that may be asking for too much. Timothy -- “One of the main causes of the fall of the Roman Empire was that–lacking zero–they had no way to indicate successful termination of their C programs.” (Robert Firth)

3 4

Translating just the parser for JVM [was: Faster PyPy translation (for debugging)]
by fwierzbicki＠gmail.com May 24, 2012

May 24, 2012

On Thu, May 24, 2012 at 7:24 AM, <wlavrijsen(a)lbl.gov> wrote: > if it can find the errors, then the fastest is to use: > > pypy/bin/checkmodule.py <yourmodule> > > but I very rarely find errors that way. Second is to write a jit test, > which does partial translation (only of the code reachable from the test) > and can use a fake space, which really speeds things up. Look at any of the > jit tests themselves or those in module (*/test/*jit*.py) for some examples. > It's a bit of work (and I didn't write mine, but got it from one of the > core pypy folks :) ), but I find it in practice by far the quickest way to > find rtyping errors (albeit, again, not always conclusive). I've been meaning to dip a toe in PyPy but had trouble getting the JVM translator to work the last time I tried. How hard would it be to use a fake space (or some other technique) to just spit out a parser for the JVM? -Frank

6 7

+Site Place/ Analysis/ Offer
by Ralph Dinkins May 24, 2012

May 24, 2012

pypy-dev(a)codespeak.net : Your site has a good look and feel but you're not getting as much web traffic as you could be getting. Can we show you how to change that? It won't cost you anything for us to review your online business and the results could spike your web revenue. Reply to us today and we will do a free assessment of your web presence. Don't forget to include the best way we can contact you. Sincerely, Ralph Dinkins

1 0