Mailman 3 February 2013 - pypy-dev

HTML Parser?
by Joe Hillenbrand 22 Feb '13

22 Feb '13

What is the recommended HTML parser to run in PyPy? The typical goto for Python is lxml, but of course that doesn't work with PyPy. Has anyone tested any other libraries? Are there any benchmarks? Thanks, -Joe

5 8

Can I install pypy on Mac osx 32 bit system
by stone node 21 Feb '13

21 Feb '13

Hi all, I want to install pypy on Mac 32bit system, but I didn't see a binary version for this configuration. Could anyone tell me how to do that? Thanks very much, Hang

2 1

pypy and PYTHONPATH
by Davide Del Vento 21 Feb '13

21 Feb '13

Folks, I've just installed pypy on a production machine which makes use of PYTHONPATH to let the user pick and chose python libraries installed in non-standard directories. I am wondering if I should wrap pypy with a shell script forcing the -E setting, to prevent picking libraries that it should not (such as numpy and scipy). Thanks! Davide Del Vento, NCAR Computational & Information Services Laboratory Consulting Services Software Engineer http://www2.cisl.ucar.edu/uss/csg/ SEA Chair http://sea.ucar.edu/

1 0

win32 own test failures
by Matti Picus 19 Feb '13

19 Feb '13

many of the jit.backend.x86.test are failing, I am willing to put time into solving this but have a bit of no idea where to start. Can someone give me the end of a string to pull? here are the last few lines of test_float, index so apparently deadframe.jf_values is empty Matti [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\warmstate.py", line 322, in execute_assembler [llinterp:error] | fail_descr.handle_fail(deadframe, metainterp_sd, jitdriver_sd) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\compile.py", line 537, in handle_fail [llinterp:error] | resume_in_blackhole(metainterp_sd, jitdriver_sd, self, deadframe) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\blackhole.py", line 1558, in resume_in_blackhole [llinterp:error] | all_virtuals) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\resume.py", line 1041, in blackhole_from_resumedata [llinterp:error] | resumereader.consume_one_section(curbh) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\resume.py", line 1083, in consume_one_section [llinterp:error] | self._prepare_next_section(info) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\resume.py", line 759, in _prepare_next_section [llinterp:error] | self.unique_id) # <-- annotation hack [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\codewriter\jitcode.py", line 149, in enumerate_vars [llinterp:error] | callback_f(index, self.get_register_index_f(i)) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\resume.py", line 771, in _callback_f [llinterp:error] | value = self.decode_float(self.cur_numb.nums[index]) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\metainterp\resume.py", line 1272, in decode_float [llinterp:error] | return self.cpu.get_latest_value_float(self.deadframe, num) [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\jit\backend\llsupport\llmodel.py", line 290, in get_latest_value_float [llinterp:error] | return deadframe.jf_values[index].float [llinterp:error] | File "c:\Users\matti\pypy_stuff\pypy\rpython\rtyper\lltypesystem\lltype.py", line 1181, in __getitem__ [llinterp:error] | raise IndexError("array index out of bounds") [llinterp:error] | IndexError: array index out of bounds [llinterp:error] `------> [llinterp:traceback] f() rpython.jit.metainterp.test.test_ajit [llinterp:traceback] v4 = jit_marker(('can_enter_jit'), (<rpython.rlib.jit.JitD...798670>), x_1, y_2, res_0) [llinterp:traceback] E v5 = direct_call((<* fn ll_portal_runner>), x_1, y_2, res_0) ==================================================================== short test summary info ==================================================================== FAIL rpython/jit/backend/x86/test/test_basic.py::TestBasic::()::test_float ============================================================ 169 tests deselected by '-ktest_float' ============================================================= ====================================================== 1 failed, 1 passed, 169 deselected in 4.32 seconds =======================================================

7 35

【Pypy Questions】
by jiaxinrun 19 Feb '13

19 Feb '13

Hi,all： I am a fresh man in pypy world! I have a question when I am using pypy for developing. When I import win32process.pyd(something in sit-packets\win32) with pypy.exe , it prompts "ImportError: No module named win32process". I am sure it's not a path problem. But when I import the same thing with python.exe，it works well. So, Can you give me some help? Thanks very much!! Additionally, I have finished a set of program. Now I want to use pypy to fast it. How could I do? Best Regards

3 4

Helping with STM at the PyCon 2013 (Santa Clara) sprints
by Taavi Burns 18 Feb '13

18 Feb '13

>From a recent email of Armin's to the list: > The STM project progressed slowly during the last few months. The > status right now is: > > * Most importantly, missing major Garbage Collection cycles, which > means pypy-stm slowly but constantly leaks memory. > > * The JIT integration is not finished; so far pypy-stm can only be > compiled without the JIT. > > * There are also other places where the performance can be improved, > probably a lot. > > * Finally there are a number of usability concerns that we (or mostly > Remi) worked on recently. The main issues turn around the idea that, > as a user of pypy-stm, you should have a way to get freeback on the > process. For example right now, transactions that abort are > completely transparent --- to the point that you don't have any way to > know that it occurred, apart from "it runs too slowly" if it occurs a > lot. You should have a way to get Python tracebacks of aborts if you > want to. A similar issue is "inevitable" transactions. I'm interested in helping with STM: 1) I think STM is really interesting, particularly Armin's take on it 2) I need a "Personal Development Goal" for %(dayjob)s. Last year it was just "Contribute to PyPy", which I did at the sprints (a bit). This year, I'd like to try something a bit more ambitious. ;) >From the list above, are there any particular areas (tickets?) that would be a good starting place for me to look at? I expect that to get the most out of the sprints, I should do a bit of pre-work (reading at least, if not poking). Thanks! -- taa /*eof*/

2 5

Re: [pypy-dev] [pypy-commit] pypy jitframe-on-heap: fix for call_assembler with floats. The offset calculation for the arguments to call_assembler in rewrite.py assumes a double-word aligned JITFRAME
by Maciej Fijalkowski 17 Feb '13

17 Feb '13

On Sun, Feb 17, 2013 at 4:00 AM, bivab <noreply(a)buildbot.pypy.org> wrote: > Author: David Schneider <david.schneider(a)picle.org> > Branch: jitframe-on-heap > Changeset: r61341:017892f48c74 > Date: 2013-02-17 02:59 +0100 > http://bitbucket.org/pypy/pypy/changeset/017892f48c74/ > > Log: fix for call_assembler with floats. The offset calculation for the > arguments to call_assembler in rewrite.py assumes a double-word > aligned JITFRAME > > diff --git a/rpython/jit/backend/arm/arch.py b/rpython/jit/backend/arm/arch.py > --- a/rpython/jit/backend/arm/arch.py > +++ b/rpython/jit/backend/arm/arch.py > @@ -17,4 +17,4 @@ > # A jitframe is a jit.backend.llsupport.llmodel.jitframe.JITFRAME > # Stack frame fixed area > # Currently only the force_index > -JITFRAME_FIXED_SIZE = 11 + 16 * 2 # 11 GPR + 16 VFP Regs (64bit) > +JITFRAME_FIXED_SIZE = 12 + 16 * 2 # 11 GPR + one word to keep alignment + 16 VFP Regs (64bit) > diff --git a/rpython/jit/backend/llsupport/rewrite.py b/rpython/jit/backend/llsupport/rewrite.py > --- a/rpython/jit/backend/llsupport/rewrite.py > +++ b/rpython/jit/backend/llsupport/rewrite.py > @@ -179,6 +179,9 @@ > for i, arg in enumerate(arglist): > descr = self.cpu.getarraydescr_for_frame(arg.type) > _, itemsize, _ = self.cpu.unpack_arraydescr_size(descr) > + # XXX > + # this calculation breaks for floats on 32 bit if > + # base_ofs of JITFRAME + index * 8 is not double-word aligned > index = index_list[i] // itemsize # index is in bytes > self.newops.append(ResOperation(rop.SETARRAYITEM_GC, > [frame, ConstInt(index), > _______________________________________________ > pypy-commit mailing list > pypy-commit(a)python.org > http://mail.python.org/mailman/listinfo/pypy-commit This fix is incorrect, I'll do the correct one later today (on GC you have extra word for GC header, so you have to account for that)

1 0

Release date for PyPy 2.0 beta 2?
by Dinu Gherman 17 Feb '13

17 Feb '13

Hi, I'm trying to make some performance comparisons using various tools like CPython, Cython, PyPy and Numba as described in an exercise I've put up here for a presentation (a tiny function generating digits of Pi): https://gist.github.com/deeplook/4947835 For this code PyPy 1.9 shows around 50 % of the performance of CPython. Christian Tismer tells me 2.0 beta 1 was much better, but I'm running into a bug for PyPy 2.0 beta 1 already described here two months ago: https://bugs.pypy.org/issue1350 So... is there any estimate for the release date of 2.0 beta 2? Thanks, Dinu

3 3

test_all.py can't recognize has multi inherited classes
by James Lan 15 Feb '13

15 Feb '13

Hi All, I tried to run test cases for jvm backend by the following command, pypy pypy/test_all.py rpython/translator/jvm/test but what I got was 10 tests defined in rpython/translator/jvm/test/test_backendopt.py although there are two dozens of test files in that directory. After experiment, I found that it failed to collect test within a multi inherited class. Take test_constant.py as an example, it defines a class, class TestConstant(BaseTestConstant, JvmTest): pass and JvmTest is defined as, class JvmTest(BaseRtypingTest, OORtypeMixin): ...... When I executed the folloing, ypy pypy/test_all.py rpython/translator/jvm/test/test_constant.py --collectonly it reported 0 item was collected. If I remove BaseTestConstant from TestConstant's super classes, it still reports 0 item collected; but if I remove JvmTest from its super classes, it reports 18 items are collected. I'm wondering how the daily test solve this problem? Thanks, James Lan

3 4

Re: [pypy-dev] Generator leaks
by Mark Roberts 15 Feb '13

15 Feb '13

On Tue, Feb 12, 2013 at 10:14 AM, <pypy-dev-request(a)python.org> wrote: > Hi pypy-dev (and hi armin :) > > Quick question - do we make https://bugs.pypy.org/issue1282 a release > blocker? As far as I understand this is a chain-of-destructors > scenario. Can we do better than wait N gc.collects? If not, can we fix > generators? > > Cheers, > fijal Making sure this is fixed would greatly help some of my code. Is it possible to flag these as a chain for collection in a single pass? -Mark

2 1