Mailman 3 October 2011 - pypy-dev

pypy translation error
by Shawn Walker 12 Oct '11

12 Oct '11

Greetings, I've been working on getting pypy to build on Solaris 11 Express using gcc 4.5. I could use some help deciphering the following error I encountered during translation using "python2.6 translate.py -Ojit": [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 308, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/translator/driver.py", line 809, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/translator/tool/taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/translator/driver.py", line 286, in _do [translation:ERROR] res = func() [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/translator/driver.py", line 323, in task_annotate [translation:ERROR] s = annotator.build_types(self.entry_point, self.inputtypes) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 103, in build_types [translation:ERROR] return self.build_graph_types(flowgraph, inputcells, complete_now=complete_now) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 194, in build_graph_types [translation:ERROR] self.complete() [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 250, in complete [translation:ERROR] self.processblock(graph, block) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 448, in processblock [translation:ERROR] self.flowin(graph, block) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 508, in flowin [translation:ERROR] self.consider_op(block.operations[i]) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 710, in consider_op [translation:ERROR] raise_nicer_exception(op, str(graph)) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/annrpython.py", line 707, in consider_op [translation:ERROR] resultcell = consider_meth(*argcells) [translation:ERROR] File "<4151-codegen /export/home/swalker/devel/pypy/pypy/annotation/annrpython.py:745>", line 3, in consider_op_simple_call [translation:ERROR] return arg.simple_call(*args) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/unaryop.py", line 175, in simple_call [translation:ERROR] return obj.call(getbookkeeper().build_args("simple_call", args_s)) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/unaryop.py", line 696, in call [translation:ERROR] return bookkeeper.pbc_call(pbc, args) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/bookkeeper.py", line 667, in pbc_call [translation:ERROR] results.append(desc.pycall(schedule, args, s_previous_result, op)) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/description.py", line 798, in pycall [translation:ERROR] return self.funcdesc.pycall(schedule, args, s_previous_result, op) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/description.py", line 283, in pycall [translation:ERROR] result = self.specialize(inputcells, op) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/description.py", line 279, in specialize [translation:ERROR] return self.specializer(self, inputcells) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/specialize.py", line 80, in default_specialize [translation:ERROR] graph = funcdesc.cachedgraph(key, builder=builder) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/description.py", line 237, in cachedgraph [translation:ERROR] graph = self.buildgraph(alt_name, builder) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/annotation/description.py", line 200, in buildgraph [translation:ERROR] graph = translator.buildflowgraph(self.pyobj) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/translator/translator.py", line 77, in buildflowgraph [translation:ERROR] graph = space.build_flow(func) [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/objspace/flow/objspace.py", line 279, in build_flow [translation:ERROR] ec.build_flow() [translation:ERROR] File "/export/home/swalker/devel/pypy/pypy/objspace/flow/flowcontext.py", line 273, in build_flow [translation:ERROR] self.space.unwrap(e.get_w_value(self.space)))) [translation:ERROR] Exception': found an operation that always raises AttributeError: generated by a constant operation: getattr [translation:ERROR] .. v119 = simple_call(v118, fd_0) [translation:ERROR] .. '(pypy.rlib.rsocket:269)PacketAddress.as_object' [translation:ERROR] Processing block: [translation:ERROR] block@3 is a <class 'pypy.objspace.flow.flowcontext.SpamBlock'> [translation:ERROR] in (pypy.rlib.rsocket:269)PacketAddress.as_object [translation:ERROR] containing the following operations: [translation:ERROR] v120 = getattr(space_0, ('newtuple')) [translation:ERROR] v121 = getattr(space_0, ('wrap')) [translation:ERROR] v118 = getattr(self_0, ('get_ifname')) [translation:ERROR] v119 = simple_call(v118, fd_0) [translation:ERROR] v122 = simple_call(v121, v119) [translation:ERROR] v123 = getattr(space_0, ('wrap')) [translation:ERROR] v124 = getattr(self_0, ('get_protocol')) [translation:ERROR] v125 = simple_call(v124) [translation:ERROR] v126 = simple_call(v123, v125) [translation:ERROR] v127 = getattr(space_0, ('wrap')) [translation:ERROR] v128 = getattr(self_0, ('get_pkttype')) [translation:ERROR] v129 = simple_call(v128) [translation:ERROR] v130 = simple_call(v127, v129) [translation:ERROR] v131 = getattr(space_0, ('wrap')) [translation:ERROR] v132 = getattr(self_0, ('get_hatype')) [translation:ERROR] v133 = simple_call(v132) [translation:ERROR] v134 = simple_call(v131, v133) [translation:ERROR] v135 = getattr(space_0, ('wrap')) [translation:ERROR] v136 = getattr(self_0, ('get_addr')) [translation:ERROR] v137 = simple_call(v136) [translation:ERROR] v138 = simple_call(v135, v137) [translation:ERROR] v139 = newlist(v122, v126, v130, v134, v138) [translation:ERROR] v140 = simple_call(v120, v139) [translation:ERROR] --end-- If I understand the above error correctly, it's either saying get_ifname doesn't exist as an attribute (function) or that as_object doesn't exist. I'm not familiar with pypy's translation errors, so I'm uncertain how to interpret the above. Any assistance is appreciated, -- Shawn Walker

2 7

strange error in urlunparse
by Max Lavrenov 10 Oct '11

10 Oct '11

Hello all. I make some experiments with pypy in our twisted project and get strange error in standard urlparse.urlunparse function def urlunparse(data): """Put a parsed URL back together again. This may result in a slightly different, but equivalent URL, if the URL that was parsed originally had redundant delimiters, e.g. a ? with an empty query (the draft states that these are equivalent).""" scheme, netloc, url, params, query, fragment = data if params: url = "%s;%s" % (url, params) return urlunsplit((scheme, netloc, url, query, fragment)) If i try using apache benchmark , after ~500 successfull responses i am starting to get error on line "if params": (216 line in real urlparse.py file) with message "local variable 'params' referenced before assignment". How it's possible? My pypy version is "Python 2.7.1 (7acf2b8fcafd, Sep 26 2011, 11:38:29) [PyPy 1.6.1-dev0 with GCC 4.6.1] on linux2" Best regards, Max Lavrenov

5 11

Feedback about the PPA packages
by Sebastien Douche 09 Oct '11

09 Oct '11

Hi all, I'm testing the packages and I don't notice any problems with the packaging. No complain but just a remark: the good thing with cpython packaging is you can install N versions (py2.6, py2.7...) in the same machine and it doesn't to be the case with pypy packages (am I wrong?). -- Sebastien Douche <sdouche(a)gmail.com> Twitter : @sdouche

3 4

Benchmarking PyPy performance on real-world Django app
by Igor Katson 09 Oct '11

09 Oct '11

When I first started benchmarking one of my Django sites, http://trip-travel.ru/ (using postgres driver pypq), I was disappointed by the results. PyPy was visually much slower than cPython (I just looked at how the site loads in the browser) But today I got some incredible results, I finally made PyPy to work faster than cPython, and found out that it got faster after loading the page several hundred times with "ab" or "siege" Here a the results, of mean response time by querying the home page with apache's "ab" (cPython 2.7.2, Django 1.3, PyPy 1.6.0), served with cherrypy wsgi server: After 10 requests (excluding the first request): cPython - 163.529 ms PyPy - 460.879 ms 50 request more: cPython - 168.539 PyPy - 249.850 100 requests more: cPython - 166.278 ms PyPy - 131.104 100 requests more: cPython - 165.820 PyPy - 115.446 300 requests more: cPython - 165.543 PyPy - 107.636 300 requests more: cPython - 166.425 PyPy - 103.065 As we can see, the JIT needs much time to warm up, but when it does, the result is pretty noticeable. By the way, with psycopg2, the site responds for 155.766 ms in average (only 10 ms faster), so using PyPy with Django makes much sense for me. As for now, pypy cannot run with uWSGI, which I use in production, but maybe i'll switch to PyPy for production deployments if "PyPy + PyPQ + Some pure python WSGI server" suite will outperform (uWSGI + cPython + psycopg2). Though, the need to load the page 500 times after each server reload is not comfortable. <http://trip-travel.ru/>

7 17

PyPy 1.7 coming
by Maciej Fijalkowski 09 Oct '11

09 Oct '11

Hi I would like to start thinking about PyPy 1.7 and I volunteer for being a release manager. It seems modulo few failing tests we're generally in a good shape. Things I would like to get into. * my json improvements branch * justin's memory pressure branch that will hopefully fix "leak" in tornado Anyone wants to get something else there? Cheers, fijal

5 6

Re: [pypy-dev] Benchmarking PyPy performance on real-world Django app
by Serhat Sevki Dincer 08 Oct '11

08 Oct '11

My favorite pypy version is 46768: It passes its own tests + It runs Django 1.3.1 :P Igor, did you try this version by any chance?

2 1

Bugs in using `easy_install` in PyPy 1.6 on Windows
by Ram Rachum 08 Oct '11

08 Oct '11

Hey, I remember that I had trouble using `easy_install` when I was just setting up PyPy 1.6 on my XP box. I had no time to document it at that time, but I believe my workflow was to download and run distribute_setup.py, then do `easy_install pip`, and then `pip install nose`, and it didn't work so I resorted to downloading tarballs manually and running `setup.py install`, which worked. Can you add this to the test suite? I think it's something that needs to be tested automatically before any PyPy release on any platform.

4 4

Why `pypy-c.exe`?
by Ram Rachum 07 Oct '11

07 Oct '11

Why is PyPy's executable called `pypy-c.exe` on Windows? I just renamed mine to `pypy.exe`, is that okay?

4 8

Can't pickle a numpy object?
by mike c 06 Oct '11

06 Oct '11

Hi there, I'm new to pypy and trying it out on some numerical projects and the speed of pypy+numpy is about 4x faster than cpython+numpy. Pretty impressive! However, I want to pickle some of my numpy objects and I get the error: TypeError: can't pickle numarray objects (full error is included below) I realise that the numpy implementation in pypy is currently a proof-of-concept, and so I was wondering what I would have to change to get numarray's to be pickle-able. As simple as adding a something like a __pickle__ method to numarray? Or is the problem deeper than that? Mike. >>>> import pickle, numpy >>>> a = numpy.array([1,2,3]) >>>> pickle.dumps(a) Traceback (most recent call last): File "<console>", line 1, in <module> File "/Users/mike/pypy-1.6/lib-python/modified-2.7/pickle.py", line 1423, in dumps Pickler(file, protocol).dump(obj) File "/Users/mike/pypy-1.6/lib-python/modified-2.7/pickle.py", line 224, in dump self.save(obj) File "/Users/mike/pypy-1.6/lib-python/modified-2.7/pickle.py", line 306, in save rv = reduce(self.proto) File "/Users/mike/pypy-1.6/lib-python/2.7/copy_reg.py", line 70, in _reduce_ex raise TypeError, "can't pickle %s objects" % base.__name__ TypeError: can't pickle numarray objects

2 1

Contributing
by Jez 06 Oct '11

06 Oct '11

Hi all, I am a college student interested in contributing to PyPy. I am not too sure exactly what I would like to work on, but I would ultimately like to get involved with the core JIT code, and I would prefer to work on improving the generated code rather than working on tools like the jitviewer. I would be grateful if you guys could point me to some good first bugs, and / or suggest some projects that would be in line with my interests. A little more on myself: I contributed to a fairly popular browser extension called Vimium for about a year, and then I spent this summer hacking on Firefox. All that ws mostly front-end work in Javascript, though I am pretty decent at C++ as well. I'm hoping to do more low-level systems work now, and learn some interesting theory in the process. Let me know how I might participate! Cheers, Jez Ng

2 1