Mailman 3 April 2011 - pypy-dev

improved cpyext PyArg_ParseTuple s* and t# support
by exarkun＠twistedmatrix.com April 22, 2011

April 22, 2011

Hello, There's a pyarg-parsebuffer-new branch in the pypy bitbucket repository that improves PyArg_ParseTuple. It doesn't completely implement either of these, but it adds enough for pyOpenSSL to mostly work. Arbitrary new-style buffer support was too hard for me, so I skipped that. Still, it would be nice to have this branch in 1.5 if possible, since I think with it along with my pyOpenSSL branch, pyOpenSSL becomes mostly functional on PyPy. Can someone take a look and let me know if it's okay to merge to default? Thanks, Jean-Paul

1 0

rlib parsing
by Ian Overgard April 21, 2011

April 21, 2011

Hey guys, I was playing around with using the parser generator in rlib, but I'm having some trouble figuring out how to get it to work in rpython (I did get one working in normal python though). Is there a resource on using it somewhere, or maybe just a few pointers? (I realize it's probably in a pretty beta state, but so far it seems like the only parser-generator that's runnable in rpython without really big changes). I was reading this: http://codespeak.net/pypy/dist/pypy/doc/rlib.html#full-example but it seems to cut off rather abruptly. It seems like you do something along the lines of instantiating one in normal python, then asking it for its string representation and generating a source file from that. Is that accurate? Or did I just manage to confuse myself terribly while reading the prolog example? Thanks! Ian

3 4

Problem with large allocation in test
by Joe April 21, 2011

April 21, 2011

I was trying to run the test file: pypy/jit/backend/x86/test/test_rx86_64_auto_encoding.py and was getting the following traceback: http://paste.pocoo.org/show/374129/ If you look at the comment on line 17, it's trying to allocate much more memory than I have. I think it's a total of 21GB, while I only have 4GB. I'm using 64bit OpenSuSE 11.4 for my operating system. I had the kernel setting overcommit_memory set to 0 (which may be part of the problem). Anyway, after I went into ll2ctypes.py and set far_regions to True, I was able to successfully run the original test. I don't think setting far_regions to True is the correct solution to the problem, but fiddling with kernel settings on my system is not ideal either. What would be a better overall solution? If any clarification is needed let me know, Joe

5 7

Re: [pypy-dev] rlib parsing
by Leonardo Santagada April 20, 2011

April 20, 2011

Sorry I forgot to reply to the list. The first step would be to tell us the error you are getting. But the fastest way to solve your problems, and get help learning how to debug pypy is to join the pypy channel at freenode (IRC) On Tue, Apr 19, 2011 at 8:54 PM, Ian Overgard <ian.overgard(a)gmail.com> wrote: > That's what I thought too (my code is exactly like that), but something in > it is causing the translator to break, and the error I get back doesn't seem > to tell me anything I can work with. > > I wouldn't mind jumping in to help fix it, is there maybe some sort of > guide/general tips on how to go about debugging translation issues? So far > I've just been looking at the exceptions and the rpython docs and guessing > it out, but I'm guessing people that have worked with this longer might have > more robust ideas on ways to trace things? > > On Tue, Apr 19, 2011 at 5:24 PM, Leonardo Santagada <santagada(a)gmail.com> > wrote: >> >> This code is rpython >> >> t = parsef(code) >> ToAST().transform(t) >> >> Maybe you can look at the tests in the library or the prolog and js >> implementation, both use parsing I think (at least js does). I really >> think that parsing could be polished to be a great tool for people >> wanting to implement a language in pypy. >> >> On Tue, Apr 19, 2011 at 7:51 PM, Ian Overgard <ian.overgard(a)gmail.com> >> wrote: >> > Thanks, that definitely helped. I forgot you could run arbitrary python >> > before the entry point. >> > >> > I've got it parsing now, but the one issue I'm still running into is >> > that >> > the syntax tree that comes back has a lot of junk nodes. The >> > ToAST.transform >> > function will clean them up, but it seems to be not-rpython, and I don't >> > think there's any way I can call it before the entry point (since it's >> > processing the ast, not the grammar). >> > >> > Is that class just hopeless? Or is there some way I can annotate it >> > myself >> > in the code? ( >> >> -- >> Leonardo Santagada > > -- Leonardo Santagada

1 0

Possible sprint in Genova before/after Europython
by Antonio Cuni April 18, 2011

April 18, 2011

Hi all, as we were discussing yesterday in another thread, the post-europython sprint will be only two days long, and so we might want to have a longer one either before or after europython. I am considering organizing one in my place. It could be either in Genova or more preferably in some other town in the nearby of the italian riviera. The place is ~3hr away from Florence by train. Googling images for "pegli" or "arenzano" (i.e., two of the towns we could go to) shows pictures which (I think) should encourage people to come :-) http://tinyurl.com/655p2at http://tinyurl.com/67q67r3 My idea is to find a hotel that gives us a sprinting room and internet in exchange of N people sleeping there, as we do in leysin. But before asking them, I need to have a rough idea about which value of "N" we are talking about (of course the higher the more interesting for them it is). Thus, I ask everybody who is potentially/likely interested in coming to let me know. Also, would you prefer to do it before or after europython? ciao, Anto

3 3

project infrastructure issues
by holger krekel April 18, 2011

April 18, 2011

Hey all, now that pypy's codespeak subversion usage is basically gone i'd like to push for remaining issues related to the pypy infrastructure: - apache/website - buildbot/master - roundup/issue tracker - mailman/mailing lists pypy-dev/commits/z Which of them shall we try to move elsewhere? My preliminary suggestion: - website -> readthedocs? or other site - buildbot -> python.org? or other site - issue tracker -> bitbucket issue tracker - mailing lists -> google groups or python.org or other site The "other site" could be a host that i anyway need to have for remaining codespeak and merlinux stuff and which thus is somewhat guaranteed to work mail- and otherwise. Other people could get admin access as well, of course. any suggestions or comments? best, holger

4 5

Ignore 'pinsrb/w/d' instructions in trackgcroot
by Matthew Woodcraft April 18, 2011

April 18, 2011

I found I needed the following patch in order to run translation with gcc 4.6 and -march=corei7. -M- --- a/pypy/translator/c/gcc/trackgcroot.py +++ b/pypy/translator/c/gcc/trackgcroot.py @@ -456,7 +456,7 @@ class FunctionGcRootTracker(object): 'inc', 'dec', 'not', 'neg', 'or', 'and', 'sbb', 'adc', 'shl', 'shr', 'sal', 'sar', 'rol', 'ror', 'mul', 'imul', 'div', 'idiv', 'bswap', 'bt', 'rdtsc', - 'punpck', 'pshufd', 'pcmp', 'pand', 'psllw', 'pslld', 'psllq', + 'punpck', 'pshufd', 'pcmp', 'pand', 'psllw', 'pslld', 'psllq', 'pinsr', # zero-extending moves should not produce GC pointers 'movz', ])

2 1

Re: [pypy-dev] [pypy-svn] pypy default: fixed test_circular
by Antonio Cuni April 15, 2011

April 15, 2011

> Right. My point was that since we dont care if they are there or not > the test should not test that they are there and fail if they are not. > So if there is an easy way to ignore them in this new test_pypy_c > framework (which is very cool by the way), we should. If it's not easy > I'm fine with keeping the test as it is. My main motivation here is to > learn about the new framework :) ah, I understand now. No, ignoring all force_tokens at once is not possible at the moment, but I agree that it would be a nice feature, I think I'll implement it later. Btw, I fear I need more of your help with test_silly_max and test_iter_max (see 2e5bd737be0c): what do we want to check there?

3 4

Re: [pypy-dev] [pypy-svn] pypy default: fixed test_circular
by Antonio Cuni April 15, 2011

April 15, 2011

Hi Hakan, thanks for the commits > + # We want to check that the array bound checks are removed, > + # so it's this part of the trace. However we dont care about > + # the force_token()'s. Can they be ignored? yes, I think they can be just ignored, because AFAIK operations without side effects and whose result is unused, are removed by the backend regalloc. ciao, Anto

1 0

The JVM backend and Jython
by fwierzbicki＠gmail.com April 14, 2011

April 14, 2011

Hi all, It was nice meeting up with many of you at PyCon! I've been thinking about the first steps towards collaboration between the Jython project and the PyPy project. It looks like it isn't going to be too long before we are all (CPython, PyPy, IronPython, Jython, etc) working on a single shared repository for all of our standard library .py code. In my ideal world there would come a day when there is also no standalone Java code in the Jython project: that is the shared standard library would contain all of Jython's .py files, and all of the Java would be generated from PyPy and Jython as a standalone project would disappear. It is possible that this is too ambitious, but big goals are more fun, right? In reality even if this where to get going, I imagine it would be a 10+ year plan :) So to my question - just how broken is the JVM backend? Are there workarounds that would allow the Java code to get generated? I ask because I would like to evaluate the generated Java parser as a potential replacement for our current ANTLR based parser. It seems like a nice baby step towards real collaboration since it seems like a relatively easy place to start. Clearly it would need adjustments to actually work for Jython - but I'd be able to look into that part. I don't think I have the time to try to unbreak the translation though... -Frank

6 12