Mailman 3 July 2011 - pypy-dev

17 Jul '11

I have a couple questions about the sandboxing feature: - Currently this is a two-process model, but early on the assertion was made that this could be done in a single process, perhaps but not necessarily separated by two OS-level threads. Is this (still?) true? What would you need to invoke to create such a pypy? - How granular can the control on imported/run functions be? Can you have a full interpreter that does everything, or an interpreter that allows socket access and that is it? Thanks, Van

3 8

Düsseldorf sprint at the end of august?
by Antonio Cuni 15 Jul '11

15 Jul '11

Hi all, I know that there is a vague plan to have a sprint in Düsseldorf in the last week of august, on time with the end of Eurostars. Can we make it more concrete, decided the dates, and announce it, please? It's very likely that I'll go on vacation in the 3rd week of august, thus it would be nice to know the dates to do a proper travel plan. ciao, Anto

2 1

Re: [pypy-dev] Object identity and dict strategies
by Laura Creighton 13 Jul '11

13 Jul '11

What do we want to happen when somebody -- say in a C extension -- takes the id of an object that is scheduled to be removed when the gc next runs? Laura

3 7

Re: [pypy-dev] bounties for pypy
by Laura Creighton 13 Jul '11

13 Jul '11

In a message of Wed, 13 Jul 2011 23:30:21 +0900, "Seung Soo, Ha" writes: >--===============0151346978== >Content-Type: multipart/alternative; boundary=0016e65b5d7e9f60b104a7f4413 >2 > >--0016e65b5d7e9f60b104a7f44132 >Content-Type: text/plain; charset=UTF-8 > >Has anyone considered? > >http://www.fossfactory.org > > >There are a lot of projects, and the money involved makes me believe that >they are worth considering. >http://www.fossfactory.org/browse.php >--===============0151346978==-- They weren't one of the sites I have looked at, but I will start looking at it now. Thank you. Laura

1 0

Compiling RPython with ctypes
by Andrew Evans 12 Jul '11

12 Jul '11

Hello I am running into some snags developing an executable in pypy with translate.py and wondering what the best method for me to do this with my code would be. I am developing an Exploit Framework and one of the features I would like to have is compiling an executable. I am wondering if this is even possible with my code but it does run in the PyPy Interpreter As an example I would like to compile this code import array from ctypes import * myCode = array.array('b', "\xda\xde\xd9\x74\x24\xf4\xb8\x22\xd2\x27\x7a\x29\xc9\xb1\x4b" "\x5b\x31\x43\x1a\x83\xeb\xfc\x03\x43\x16\xe2\xd7\x3b\xbc\x7a" "\x17\xbc\x95\x4b\xd7\xd8\x92\xec\xe7\xa5\x65\x94\x08\x2d\x25" "\x69\x9d\x41\xba\xdc\x2a\xe1\xca\xf7\x25\xe2\xca\x07\xbe\xa2" "\xfe\x8a\x80\x5e\x74\xd4\x3c\xc1\x49\xb5\xb7\x91\x69\x12\x4c" "\x2c\x4e\xd1\x06\xaa\xd6\xe4\x4c\x3f\x6c\xff\x1b\x1a\x51\xfe" "\xf0\x78\xa5\x49\x8d\x4b\x4d\x48\x7f\x82\xae\x7a\xbf\x19\xfc" "\xf9\xff\x96\xfa\xc0\x30\x5b\x04\x04\x25\x90\x3d\xf6\x9d\x71" "\x37\xe7\x56\xdb\x93\xe6\x83\xba\x50\xe4\x18\xc8\x3d\xe9\x9f" "\x25\x4a\x15\x14\xb8\xa5\x9f\x6e\x9f\x29\xc1\xad\x72\x01\x53" "\xd9\x27\x5d\xac\xe6\xb1\xa5\xd2\xdc\xca\xa9\xd4\xdc\x4b\x6e" "\xd0\xdc\x4b\x71\xe0\x12\x3e\x97\xd1\x42\xd8\x57\xd6\x92\x43" "\xa9\x5c\x9c\x0d\x8e\x83\xd3\x70\xc2\x4c\x13\x73\x1b\xc4\xf6" "\x9b\x43\x29\x07\xa4\xfd\x17\x1c\xb9\xa0\x1a\x9f\x3a\xd4\xd4" "\xde\x82\xee\x16\xe0\x04\x07\xa0\x1f\xfb\x28\x26\xd1\x5f\xe6" "\x79\xbd\x0c\xf7\x2f\x39\x82\xc7\x80\xbe\xb1\xcf\xc8\xad\xc5" "\x2f\xf7\x4e\x57\xb4\x26\xf5\xdf\x51\x17\xda\x7c\xba\x39\x41" "\xf7\x9a\xb0\xfa\x92\xa8\x1a\x8f\x39\x2e\x2e\x06\xa6\x80\xf0" "\xb5\x16\x8f\x9b\x65\x78\x2e\x38\x01\xa6\x96\xe6\xe9\xc8\xb3" "\x92\xc9\x78\x53\x38\x68\xed\xcc\xcc\x05\x98\x62\x11\xb8\x06" "\xee\x38\x54\xae\x83\xce\xda\x51\x10\x40\x68\xe1\xf8\xed\xe9" "\x66\x8c\x78\x95\x58\x4e\x54\x34\xfd\xea\xaa") buffer = myCode.buffer_info()[0] my_callback = CFUNCTYPE(c_int) I would appreciate any suggestions *cheers and ty :D

4 3

Object identity and dict strategies
by Alex Gaynor 11 Jul '11

11 Jul '11

Hi all, I've now spoken with several developers about the object identity that arises out of hte new dict strategies, and all seem to think that the current implementation breaks Python's semantics, that is: x = 3 z = {x: None} assert next(iter(z)) is x will fail. The only solution I see to this that maintains the correct semantics in all cases is to specialize is/id() for primitive types. That is to say, all integers of any given value have the same id() and x is y is true. Doing x is y is true is easy, you simply have a multimethod which dispatches on the types and compares intval for W_IntObjects (objects of differing types can never have the same identity) however the question is what to use for id() that is unique, never changes for an int, and doesn't intersect with any other live object. In particular the last constraint is the most difficult I think. Alex -- "I disapprove of what you say, but I will defend to the death your right to say it." -- Evelyn Beatrice Hall (summarizing Voltaire) "The people's good is the highest law." -- Cicero

11 22

integrity of code
by Samuel Ytterbrink 09 Jul '11

09 Jul '11

Hi! I was just thinking and then ask my self... Dose writing things in RPython and then compile the code with translate and a c compiler make it as hard to read as a c program... thinking that python some times get a hard time being a commercial tool for app making, companies don't want end users to be able to read there code. Am i correct and if so are there any improvements you could do to make the interpreter read a more 'seacret' version of python code, some kinde of binary code( or dose the byetcode work for this). Hope this is not a stupid or foolish topic. -- //Samuel Ytterbrink

2 1

Re: [pypy-dev] Floating point computation
by Ilya Osadchiy 09 Jul '11

09 Jul '11

>>> The Translation and JIT backend for PyPy may be able to allow Python >>> programmers to use SIMD instructions directly from Python. >> >> We kind of want to do that automatically for numpy operations. > > Can all basic SIMD instructions be mapped to numpy array operations? > If so, why doesn't numpy already use them? (Or does it?) > I think CPython's numpy may be compiled with auto-vectorization and therefore use SIMD. It also has optional dependency for lapack, and AFAIK most lapacks use SIMD. > > And if not, then is there some existing C extension module for CPython > that exposes them somehow? Of course CPython cannot hope for > impressive speedups with such an extension module, but such a module > in PyPy could be JITted and give massive speed benefits. > I think that JITting element-wise operations to SIMD assembly is feasible. Logically you can see it like: normal JIT => loop unroll => instruction reordering => substitute N instructions of same type with 1 simd instruction Of course there are problems (loads and stores need special treatment, not every instruction has simd equivalent, register allocation differs, etc) But I think the bigger problem is JITting SIMD for things like matrix multiply and fft, which are more than a single loop and the order of calculations may seriously differ between scalar and simd versions.

1 0

Floating point computation
by Zariko Taba 08 Jul '11

08 Jul '11

Hi pypy list, I'd like to prototype an interpreter in rpython. But this interpreter must feature floating point support. Something like the context in the decimal module of python : (decimal is basically a floating point unit in python) import decimal # do an operation decimal.Decimal("6e4565465") * decimal.Decimal("6e67654") # Verify overflow decimal.getcontext().flags[decimal.Overflow] # leads 1 => overflow ! My interpreter must provide access to the "flags" field (OverFlow, Inexact, DivisionByZero...) Currently I have a prototype in c and I directly use the intrinsics of X86 (sse2) to retrieve theses flags : // compute a sqrt using intrinsics __builtin_ia32_sqrtss(...); // get status register of sse2 fpu int mxcsr = __builtin_ia32_stmxcsr(); // extract overflow bit : overflow = (mxcsr & 0x8); // extract ... If I want to implement this in rpython, I see 2 solutions : 1. Porting decimal to rpython : seems to be a lot of work and I wonder about the performances. 2. Wrapping floating in a c library and use ctype : code clarity and jit integration will be bad. Do you see another possibility ? Any advices on this ? Thanks ! Zariko.

4 7

pypy 1.5 on Windows: sqlite connection args
by Caleb Hattingh 08 Jul '11

08 Jul '11

In lib-pypy/_sqlite3.py, line 239 (in Win 1.5 stable release) in class Connection(object): def __init__(self, database, isolation_level="", detect_types=0, timeout=None, cached_statements=None, factory=None): ...might need to become: def __init__(self, database, isolation_level="", detect_types=0, timeout=None, cached_statements=None, factory=None, *check_same_thread=False *): I am testing the web framework web2py against pypy, and this issue came up. I don't know too much about sqlite itself. Spent a lot of time modifying code to explicitly close file handles because of the different behaviour of the ref counting cpython vs. the gc pypy.

2 1