Mailman 3 April 2012 - pypy-dev

Reducing the number of failing tests on win32
by Matti Picus 08 Apr '12

08 Apr '12

2 1

Re: [pypy-dev] [pypy-commit] pypy win32-cleanup2: fix test, catching raised exception with 'raises' fails on win32
by Antonio Cuni 08 Apr '12

08 Apr '12

Hi Matti, On 04/08/2012 01:08 PM, mattip wrote: > Author: Matti Picus <matti.picus(a)gmail.com> > Branch: win32-cleanup2 > Changeset: r54246:36ff8218c07d > Date: 2012-04-08 13:30 +0300 > http://bitbucket.org/pypy/pypy/changeset/36ff8218c07d/ > > Log: fix test, catching raised exception with 'raises' fails on win32 > > diff --git a/pypy/module/_socket/test/test_sock_app.py b/pypy/module/_socket/test/test_sock_app.py > --- a/pypy/module/_socket/test/test_sock_app.py > +++ b/pypy/module/_socket/test/test_sock_app.py > @@ -617,7 +617,10 @@ > except timeout: > pass > # test sendall() timeout > - raises(timeout, cli.sendall, 'foobar' * 70) > + try: > + cli.sendall('foobar'*70) > + except: > + pass isn't it better to use a more precise "except"? The way it's written now the test would pass even if there is a typo. ciao, Anto

2 1

Re: [pypy-dev] [pypy-commit] pypy win32-cleanup2: fix test, catching raised exception with 'raises' fails on win32
by Matti Picus 08 Apr '12

08 Apr '12

> Hi Matti, > > On 04/08/2012 01:08 PM, mattip wrote: > >/ Author: Matti Picus<matti.picus at gmail.com <http://mail.python.org/mailman/listinfo/pypy-dev>> > />/ Branch: win32-cleanup2 > />/ Changeset: r54246:36ff8218c07d > />/ Date: 2012-04-08 13:30 +0300 > />/ http://bitbucket.org/pypy/pypy/changeset/36ff8218c07d/ > />/ > />/ Log: fix test, catching raised exception with 'raises' fails on win32 > />/ > />/ diff --git a/pypy/module/_socket/test/test_sock_app.py b/pypy/module/_socket/test/test_sock_app.py > />/ --- a/pypy/module/_socket/test/test_sock_app.py > />/ +++ b/pypy/module/_socket/test/test_sock_app.py > />/ @@ -617,7 +617,10 @@ > />/ except timeout: > />/ pass > />/ # test sendall() timeout > />/ - raises(timeout, cli.sendall, 'foobar' * 70) > />/ + try: > />/ + cli.sendall('foobar'*70) > />/ + except: > />/ + pass > / > isn't it better to use a more precise "except"? The way it's written now the > test would pass even if there is a typo. > > ciao, > Anto yes, thanks. changeset c0ded41a61e0 Matti

1 0

PyPy sprint in Leipzig, Germany (June 22-27)
by Armin Rigo 05 Apr '12

05 Apr '12

Leipzig PyPy sprint June 22 - 27, 2012 ====================================== The next PyPy sprint will be held --- for the first time in a while --- in a place where we haven't been so far: Leipzig, Germany, at the Python Academy's Teaching Center. It will take place from the 22nd to the 27th of June 2012, before EuroPython. Thanks to Mike Müller for organizing it! .. Python Academy: http://www.python-academy.com/ This is a fully public sprint, everyone is welcome to join us. All days are full sprint days, so it is recommended to arrive the 21st and leave the 28th. Topics and goals ---------------- Open. Here are some goals: - numpy: progress towards completing the ``numpypy`` module; try to use it in real code - stm: progress on Transactional Memory; try out the ``transaction`` module on real code. - jit optimizations: there are a number of optimizations we can still try out or refactor. - work on various, more efficient data structures for Python language. A good example would be lazy string slicing/concatenation or more efficient objects. - any other PyPy-related topic is fine too. Location -------- Python Academy Leipzig, Germany. http://www.python-academy.com/center/find.html Thanks to Mike Müller for inviting us. The room holds 8 - 12 people depending how much space each individual needs. Drinks, snacks and a simple lunch, e.g. pizza or other fast food is provided. Dinner would be extra. Some accommodations: http://www.python-academy.com/center/accommodation.html Pretty much all hotels and hostels in the city center are fine too. The tram needs only 16 minutes from the central station to the Academy location. Grants ------ For students, we have the possibility to support some costs via PyPy funds. Additionally, we can support you applying for grants from the PSF and other sources. Registration ------------ If you'd like to come, please *sign up* either by announcing yourself on the pypy-dev mailing list, or by directly adding yourself to the list of people: https://bitbucket.org/pypy/extradoc/raw/extradoc/sprintinfo/leipzig2012/peo…. We need to have a head count for the organization. If you are new to the project please drop a note about your interests and post any questions.

1 0

pypy MemoryError crash
by Roger Flores 04 Apr '12

04 Apr '12

Hello all. A bug in a python application of mine resulted in this pypy crash: RPython traceback: File "translator_goal_targetpypystandalone.c", line 1033, in entry_point File "interpreter_function.c", line 1017, in funccall__star_1 File "interpreter_function.c", line 1046, in funccall__star_1 File "rpython_memory_gc_minimark.c", line 2512, in MiniMarkGC_collect_and_rese rve File "rpython_memory_gc_minimark.c", line 2216, in MiniMarkGC_minor_collection File "rpython_memory_gc_minimark.c", line 4503, in MiniMarkGC_collect_oldrefs_ to_nursery File "rpython_memory_gc_base.c", line 1714, in trace___trace_drag_out File "rpython_memory_gc_minimarkpage.c", line 214, in ArenaCollection_malloc File "rpython_memory_gc_minimarkpage.c", line 532, in ArenaCollection_allocate _new_page File "rpython_memory_gc_minimarkpage.c", line 728, in ArenaCollection_allocate _new_arena Fatal RPython error: MemoryError This application has requested the Runtime to terminate it in an unusual way. Please contact the application's support team for more information. At first I thought it was pypy reporting that the PPM compressor had ran out of memory, and simply didn't report the app's stack frames. But I've since come to realize that normally pypy does report a MemoryError and the stack frames involved, just like Python, and that this case was instead a RPython crash. I'm hoping the above stack trace from pypy is enough of a clue. >pypy -v Python 2.7.2 (0e28b379d8b3, Feb 09 2012, 18:31:47) [PyPy 1.8.0 with MSC v.1500 32 bit] on win32 -Roger

3 2

Bringing Cython and PyPy closer together
by Stefan Behnel 01 Apr '12

01 Apr '12

Hi, I'm breaking out of the thread where this topic was started ("offtopic, ontopic, ...") because it is getting too long and unfocussed to follow. The current state of the discussion seems to be that PyPy provides ways to talk to C code, but nothing as complete as CPython's C-API in the sense that it allows efficient two-way communication between C code and Python objects. Thus, we need to either improve this or look for alternatives. In order to get us more focussed on what can be done and what the implications are, so that we may eventually be able to decide what should be done, I started a Wiki page for a PyPy backend CEP (Cython Enhancement Proposal). http://wiki.cython.org/enhancements/pypy Please add to it as you see fit. In general, it is ok for a CEP to present diverging arguments, but please try to give them a structure in order to keep the overall document focussed. Stefan

9 64

Re: [pypy-dev] The Work Plan Re: STM proposal funding
by Laura Creighton 01 Apr '12

01 Apr '12

In a message of Sun, 01 Apr 2012 11:23:40 +0200, Armin Rigo writes: >I'm also thinking about writing a short paper collecting things I said >and think on various blog posts. A kind of "position paper". What do >others think of this idea? Good idea. Is this a 'scientific paper for a conference' sort of thing, or a 'post it on the internet' sort of thing? If the second, remember to include a 'Fund this reaseach HERE' button. :-) Laura

2 1

Re: [pypy-dev] Speeding up zlib in standard library
by Peter Cock 01 Apr '12

01 Apr '12

(Replying on list - assuming Justin went off list my mistake) On Fri, Mar 16, 2012 at 4:54 AM, Justin Peel <peelpy(a)gmail.com> wrote: > Two things to mention. First, if you are going to use valgrind, you > will need to build your own pypy because, as far as I know, the > buildbot ones do not have the debug info so you won't have any helpful > function names in your profile. If I remember correctly, most of the > time used is in _operate in rzlib.py. > > Also, in my opinion, the next thing to try in speeding up this code is > to do a faster copy than a char by char copy for copying to the input > buffer that is sent to the external C function. I'm not sure if the > copying from the output buffer to the string builder is char by char > or not. Looking at the code for rzlib.py, _operate does seem to be the core function, and so likely the hot spot. https://bitbucket.org/pypy/pypy/src/default/pypy/rlib/rzlib.py It uses the StringBuilder class from rstring via the append_charpsize method, defined as follows: https://bitbucket.org/pypy/pypy/src/default/pypy/rlib/rstring.py def append_charpsize(self, s, size): l = [] for i in xrange(size): l.append(s[i]) self.l.append(self.tp("").join(l)) self._grow(size) So it is indeed doing a char by char copy of the string from Python to zlib (in my case to decompress a long chunk of data). I don't know enough about PyPy's internals to say if something naive like this would work faster (guessing looking at the append_slice method): def append_charpsize(self, s, size): assert 0 <= size self.l.append(s[0:size]) self._grow(size) Presumably to try this idea out I'm going to first need to get PyPy to build locally? Thanks, Peter

4 11

Profiling pypy code
by Timothy Baldridge 01 Apr '12

01 Apr '12

I've been trying to find ways to optimize my clojure-on-python project. And I've been running through my code in jitviewer. However it seems that jitviewer only displays the number of times a given loop was run. What should I look into for benchmarking actual times spent in each loop? It seems that my optimization efforts would be best spent on areas of code that have a high hit count AND have a long execution time. Any ideas? Thanks, Timothy -- “One of the main causes of the fall of the Roman Empire was that–lacking zero–they had no way to indicate successful termination of their C programs.” (Robert Firth)

2 1