Mailman 3 September 2011 - pypy-dev

CUDA/OpenCL under PyPy
by Valery Khamenya 12 Sep '11

12 Sep '11

Hi all, (replying, please, Cc to me ) I was quite surprised to see that cooperhead could be compiled and installed OK under PyPy. Of course it didn't work, because micronumpy is still young: "AttributeError: 'module' object has no attribute 'float64' " Did anyone try to execute some numeric stuff using CUDA from PyPy ? CUDA + PyPy -- it would be just fantastic. best regards -- Valery A.Khamenya

3 3

CTypes backend for Cython Status
by Romain Guillebert 11 Sep '11

11 Sep '11

Hi The Google Summer of Code has ended and I didn't give the current status to anyone yet (I was very busy with a report I had to write for my university). There is still work to do on the project (there was more work than I expected, especially because of semantic differences between Cython and ctypes) so I'll talk about what needs to be done (even if it does not sound good compared to talking about what has been done) from the most important to the least important in my opinion : - Pointer vs Array, Cython mixes the two while ctypes does not, this can probably be fixed by using arrays everywhere (if we can convert pointers into arrays) - Take into account header files declared globally - Macros, this is probably the biggest part but it's doable, Cython has the types of the arguments and the return value so it's possible to generate a C function corresponding to a macro - Pointer to functions Some of them are trivial, others just require good ideas and macros demands a big amount of work. I'm still working on it and if someone wants to give a hand, I'll be happy to explain what I've done. Thanks Romain

3 3

speed and 1.6
by Alex Gaynor 09 Sep '11

09 Sep '11

Can someone with the appropriate permissions add a tag for 1.6 on speed.pypy.org? Thanks, Alex -- "I disapprove of what you say, but I will defend to the death your right to say it." -- Evelyn Beatrice Hall (summarizing Voltaire) "The people's good is the highest law." -- Cicero

4 8

Errors running pypy with ctype library
by Greg Bowyer 08 Sep '11

08 Sep '11

Hi all, I have a rather interesting in house networking tool that uses pcap to sniff packets, take them into twisted and replay them against a target. Internally the tight loop for packet reassembly is currently run via twisted and some custom parsing and packet reconstruction code, I have been investigating if I can make this code faster _without_ reimplementing the capture part in C, as such I think I have two options: * Pypy (which I would prefer as it means that I hopefully will gain performance improvements over time, as well as JIT acceleration throughout the code) * Cython (which will let me change the main loop to be mostly C without having to write a lot of C) The tool currently uses an old style cPython c extension to bind python to pcap, since this will be slow in pypy I found the first semi implemented ctype pcap binding from google code here (http://code.google.com/p/pcap/) (I didnt write it so it may be broken) The following test code works fine on cPython2.7 --------------- %< --------------- from pycap import pycap pp = pycap.open_live('eth0', 1596, True, 250) bpf = pycap.compile(r'tcp dst port 80') bpf = pycap.compile(pp, 'tcp', True, 0) def process(user, pkthdr, packet): print 'callback' print 'pkthdr[0:7]', pkthdr.contents.len cb = pycap.CALLBACK(process) pycap.loop(pp, 100, cb, "greg") --------------- >% --------------- but fails with the following error on pypy trunk --------------- %< --------------- greg@localhost ~/projects/pcap-read-only/packet $ /home/greg/projects/pypy/pypy/translator/goal/pypy-c Python 2.7.1 (ddff981df9d5, Sep 06 2011, 19:21:21) [PyPy 1.6.0-dev1 with GCC 4.4.5] on linux2 Type "help", "copyright", "credits" or "license" for more information. And now for something completely different: ``this is a self-referential channel topic'' >>>> import pycap >>>> from pycap import pycap >>>> pp = pycap.open_live('eth0', 1596, True, 250) pycap/__buildin_funcs__/pcap_native_funcs.py:188: RuntimeWarning: C function without declared arguments called handle=pcap_c_funcs.pcap_open_live(source,snaplen,promisc,to_ms,error) Segmentation fault --------------- >% --------------- The segmentation fault might be down to pcap being very twitchy about its inputs rather than pypy itself having a segfault Any ideas whats wrong in the ctypes binding here ? -- Greg

2 2

PyCON UK Sept 24 + 25
by Laura Creighton 08 Sep '11

08 Sep '11

John Pinner wants to know if any of us are coming and will there be a PyPy sprint. Laura

2 1

deepcopy slower in PyPY ?!
by Jorge de Jesus 08 Sep '11

08 Sep '11

Hi to all I've benchmark/profile some code (PyWPS API) and PyPy-c is 2/3x times slower than CPython. This was done in a virtual machine using x86_64 The code being benchmark spends most of the time making calls to copy/deepcopy. I've found that this was an issue in PyPy 1.6 (https://bugs.pypy.org/issue767), but the issue has been closed. So I've downloaded the latest dev version but PyPy-c continues to be slow compared to CPython. Does anyone has extra information on this issue ? Thank you Jorge -------------------------------------------------------------------------------- Plymouth Marine Laboratory Registered Office: Prospect Place The Hoe Plymouth PL1 3DH Website: www.pml.ac.uk Click here for PML Annual Review Registered Charity No. 1091222 PML is a company limited by guarantee registered in England & Wales company number 4178503 Please think before you print -------------------------------------------------------------------------------- This e-mail, its content and any file attachments are confidential. If you have received this e-mail in error please do not copy, disclose it to any third party or use the contents or attachments in any way. Please notify the sender by replying to this e-mail or e-mail forinfo(a)pml.ac.uk and then delete the email without making any copies or using it in any other way. The content of this message may contain personal views which are not the views of Plymouth Marine Laboratory unless specifically stated. You are reminded that e-mail communications are not secure and may contain viruses. Plymouth Marine Laboratory accepts no liability for any loss or damage which may be caused by viruses. --------------------------------------------------------------------------------

4 6

Re: [pypy-dev] Moving the project forward
by Jesse Noller 08 Sep '11

08 Sep '11

I've put up a splash page for the project this AM: http://speed.python.org/ jesse

6 10

segfault in translation; C backend
by wlavrijsen＠lbl.gov 08 Sep '11

08 Sep '11

Hi, I have a crash in the translation chain when I enable the CINT back-end, and I just don't seem to be able to figure it out: [c] 132000 nodes [ array: 15760 framework rtti: 724 func: 10234 group: 1 struct: 131169 ] * [c] 133000 nodes [ array: 16008 framework rtti: 738 func: 10312 group: 1 struct: 132216 ] *** Break *** segmentation violation this segfault occurs in pypy_g_wrap_value__get_elem(). What I've found so far, using python rather than pypy-c, is that it is really a problem in passing an array with an erroneous address to ctypes: #0 B_get (ptr=0x1, size=1) at /install/Python-2.6.7/Modules/_ctypes/cfield.c:549 #1 0xb7984b7d in CData_get (type=0x850adac, getfunc=0, src=0x5af43bb4, index=0, size=1, adr=0x1 <Address 0x1 out of bounds>) at /install/Python-2.6.7/Modules/_ctypes/_ctypes.c:2798 #2 0xb798650f in Array_item (_self=0x5af43bb4, item=0x8056d9c) at /install/Python-2.6.7/Modules/_ctypes/_ctypes.c:4248 #3 Array_subscript (_self=0x5af43bb4, item=0x8056d9c) at /install/Python-2.6.7/Modules/_ctypes/_ctypes.c:4310 #4 0xb7e910aa in PyObject_GetItem (o=0x5af43bb4, key=0x8056d9c) at Objects/abstract.c:141 #5 0xb7f32e12 in PyEval_EvalFrameEx (f=0x8b28b74, throwflag=0) at Python/ceval.c:1261 Note that at #2, the debug code claims that the 2nd argument is an item object, yet, it's a Py_ssize_t index value in reality. I don't know why this is wrong. Further, the array comes in when writing a node for one of my module types, see this node and the obj it carries (note the address of the dependency "value" that is produced): (Pdb+) up > /home/wlav/pypydev/pypy/pypy/translator/c/database.py(294)add_dependencies() -> self.get(value) (Pdb+) print value * <C object Array of void at 0x1> (Pdb+) print self <pypy.translator.c.database.LowLevelDatabase object at 0x47cfecec> (Pdb+) print node.name pypy_g_pypy_module_cppyy_interp_cppyy_W_CPPNamespace.wcppn_super (Pdb+) print node.obj struct pypy.module.cppyy.interp_cppyy.W_CPPScope { super=..., inst_space=None, inst_data_members=..., inst_handle=..., inst_methods=..., inst_name=... } None (Pdb+) print node.nodekind struct (Pdb+) print node.typename struct pypy_pypy_module_cppyy_interp_cppyy_W_CPPScope0 @ (Pdb+) print node.obj.inst_data_members * struct dicttable { num_items=0, num_pristine_entries=8, entries=... } (Pdb+) print node.typename struct pypy_pypy_module_cppyy_interp_cppyy_W_CPPScope0 @ (Pdb+) print node.obj._TYPE GcStruct pypy.module.cppyy.interp_cppyy.W_CPPScope { super, inst_space, inst_data_members, inst_handle, inst_methods, inst_name } So, I've been removing bits and pieces from that class, hoping to find the real problem when it stops crashing, but no luck so far. Removing bits is a bit harder then it sounds, b/c if the system as a whole is not conistent anymore, it won't get past the rtyper. Anyone has a better way of nailing this bug? Thanks! Best regards, Wim -- WLavrijsen(a)lbl.gov -- +1 (510) 486 6411 -- www.lavrijsen.net

1 1

Status of ARM backend
by Eric van Riet Paap 05 Sep '11

05 Sep '11

Hi, Can someone please give us an update on the status of the ARM backend. Is it time already to get our iPhones and Androids out of our pockets and start creating that killer app using PyPy? cheers, Eric

5 4

Re: [pypy-dev] [pypy-commit] pypy default: fix bz2. tests didn't find this.
by Maciej Fijalkowski 05 Sep '11

05 Sep '11

On Wed, Aug 31, 2011 at 8:18 AM, justinpeel <noreply(a)buildbot.pypy.org> wrote: > Author: Justin Peel <notmuchtotell(a)gmail.com> > Branch: > Changeset: r46937:b4d8eb5fdf6c > Date: 2011-08-31 00:17 -0600 > http://bitbucket.org/pypy/pypy/changeset/b4d8eb5fdf6c/ > > Log: fix bz2. tests didn't find this. > > diff --git a/pypy/module/bz2/interp_bz2.py b/pypy/module/bz2/interp_bz2.py > --- a/pypy/module/bz2/interp_bz2.py > +++ b/pypy/module/bz2/interp_bz2.py > @@ -446,7 +446,9 @@ > result = self.buffer[pos:pos + n] > self.pos += n > else: > - result = self.buffer > + pos = self.pos > + assert pos >= 0 > + result = self.buffer[pos:] > self.pos = 0 > self.buffer = "" > self.readlength += len(result) > _______________________________________________ > pypy-commit mailing list > pypy-commit(a)python.org > http://mail.python.org/mailman/listinfo/pypy-commit > This should come with a test

2 1