Mailman 3 December 2009 - pypy-dev

new speed.pypy.org site?
by holger krekel 26 Feb '10

26 Feb '10

Hi Miquel, all, regarding the new speed.pypy.org host I realized that the current setting is not suited for setting up another VM. Too few resources and old-ish software. I plan to order a new host, setup speed.pypy.org there (and migrate existing VMs later). Takes a week or two i guess. Hope this doesn't block you. Could maybe someone here on the list (temporarily) offer a suitable VM to run Django Apps/DBs where Miquel can get an account? i'd then point the "speed.pypy.org" DNS entry to it. The earlier the site gets running the earlier we can all follow speed developments with the PyPy JIT :) best, holger -- Metaprogramming, Python, Testing: http://tetamap.wordpress.com Python, PyPy, pytest contracting: http://merlinux.eu

7 10

Parallel translation?
by Sven-Hendrik Haase 10 Jan '10

10 Jan '10

Hey, I just translated SVN trunk of PyPy with JIT enabled and I was very pleased by the results as I noticed that PyPy with JIT is now two times faster in Pystone (I know that's not saying too much) than Cpython. However, translating took a very long time due to not being able to make use of my other CPU cores. I did not find a switch to compile using multiple shells (as in -jN) so I was wondering whether such a feature was planned or even possible. At least for the compilation part, this should be very possible. -- Sven-Hendrik

9 9

Re: [pypy-dev] Failed to translate interpreter to JIT on Windows
by Armin Rigo 24 Dec '09

24 Dec '09

Hi, On Wed, Dec 23, 2009 at 10:48:10PM +0800, Olli Wang wrote: > ... > "C:\cygwin\home\olliwang\pypy-trunk\lib-python\modified-2.5.2\encodings\_ > _init__.py", line 32, in <module> > from encodings import aliases > ImportError: cannot import name 'aliases' > >>>> Sorry, no clue about it. Others on pypy-dev may speak if they already encountered something similar. Otherwise it just looks like you are missing the file lib-python\modified-2.5.2\encodings\aliases.py. A bientot, Armin.

1 0

Failed to translate interpreter to JIT on Windows
by Olli Wang 23 Dec '09

23 Dec '09

Hi, I was trying to translate Python interpreter to JIT backend on WIndows but failed. It's no problem to translate it to C backend. Do I miss something? Thanks. [c:writing] implement_40.c [c:writing] implement_41.c [c:writing] implement_42.c [translation:info] written: c:\docume~1\olliwa~1\locals~1\temp\usession-26\testi ng_1\testing_1.c [translation:info] Compiling c source... [platform:execute] make in c:\docume~1\olliwa~1\locals~1\temp\usession-26\testin g_1 [platform:ERROR] cl : Command line warning D9024 : unrecognized source file type 'Wang\\pypy-trunk\\pypy\\translator\\c', object file assumed [platform:ERROR] cl : Command line warning D9027 : source file 'Wang\\pypy-trunk \\pypy\\translator\\c' ignored [platform:ERROR] cl : Command line warning D9024 : unrecognized source file type 'Wang\\pypy-trunk\\pypy\\translator\\c\\src\\libffi_msvc', object file assumed [platform:ERROR] cl : Command line warning D9027 : source file 'Wang\\pypy-trunk \\pypy\\translator\\c\\src\\libffi_msvc' ignored [platform:ERROR] NMAKE : fatal error U1077: '"C:\Program Files\Microsoft Visual Studio 9.0\VC\BIN\cl.exe"' : return code '0x2' [platform:ERROR] Stop. [platform:ERROR] cl.exe /nologo /MD /O2 /Oi /Ob1 /c /FAs /Fatesting_1.s testing_1.c /Ic:\\Python26\\include /IC:\\cygwin\\home\\Olli Wang\\pypy-trunk\\ pypy\\translator\\c /IC:\\cygwin\\home\\Olli Wang\\pypy-trunk\\pypy\\translator \\c\\src\\libffi_msvc [platform:ERROR] testing_1.c [platform:ERROR] c:\documents and settings\olli wang\local settings\temp\usessio n-26\testing_1\common_header.h(12) : fatal error C1083: Cannot open include file : 'src/stack.h': No such file or directory [Timer] Timings: [Timer] annotate --- 395.8 s [Timer] rtype_lltype --- 540.0 s [Timer] pyjitpl_lltype --- 371.9 s [Timer] backendopt_lltype --- 229.9 s [Timer] stackcheckinsertion_lltype --- 72.2 s [Timer] database_c --- 559.6 s [Timer] source_c --- 661.0 s [Timer] compile_c --- 0.5 s [Timer] =========================================== [Timer] Total: --- 2830.9 s [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "./translate.py", line 277, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \driver.py", line 741, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip ()) [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \tool\taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \driver.py", line 279, in _do [translation:ERROR] res = func() [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \driver.py", line 504, in task_compile_c [translation:ERROR] cbuilder.compile() [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \c\genc.py", line 447, in compile [translation:ERROR] self.translator.platform.execute_makefile(self.targetdir ) [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \platform\windows.py", line 281, in execute_makefile [translation:ERROR] self._handle_error(returncode, stdout, stderr, path.join ('make')) [translation:ERROR] File "C:\cygwin\home\Olli Wang\pypy-trunk\pypy\translator \platform\windows.py", line 197, in _handle_error [translation:ERROR] raise CompilationError(stdout, stderr) [translation:ERROR] CompilationError: <CompilationError err="cl : Command line warning D9024 : unrecognized source file type 'Wang\\\\pypy-trunk\\\\pypy\\\\tra nslator\\\\c', obje...sting_1\\common_header.h(12) : fatal error C1083: Cannot o pen include file: 'src/stack.h': No such file or directory\n"> -- Olli Wang OLLI WANG PRODUCTIONS - http://olliwang.com A BLOG ABOUT MY LIFE AND MY WORK

4 5

release / funding bits
by holger krekel 21 Dec '09

21 Dec '09

Hi all, not sure how many of pypy-dev subscribers are following the PyPy status blog, so here are some brief pointers to two recent posts: PyPy-1.2 release planning: http://tinyurl.com/yacbb8t Accelerating PyPy by funding: http://tinyurl.com/yakb3en feedback as always welcome, here or on the posts (i am still waiting to get to know a common way to bidirectionally map e-mail threads to blog post comments) cheers, holger

1 0

AES Implementation in RPython
by Olli Wang 20 Dec '09

20 Dec '09

Hi, I implemented the AES in RPython and made some benchmarks. You may want to take a look at http://olliwang.com/2009/12/20/aes-implementation-in-rpython/ I know that RPython is designed to write Python interpreter, but the translated C performance is really really impressive. If RPython could be integrated into normal Python code seamlessly, that would be fantastic! -- Olli Wang OLLI WANG PRODUCTIONS - http://olliwang.com A BLOG ABOUT MY LIFE AND MY WORK

2 1

The builtin tuple() function doesn't work
by Olli Wang 19 Dec '09

19 Dec '09

Hi, I tried to convert a list to tuple in RPython such as tuple([1, 2, 3]), but it would cause errors during translating. Is that a bug? I did find the builtin_tuple() function in http://codespeak.net/pypy/dist/pypy/annotation/builtin.py, so it should work, right? Thanks. -- Olli Wang OLLI WANG PRODUCTIONS - http://olliwang.com A BLOG ABOUT MY LIFE AND MY WORK

3 2

Success and Thanks! : Advice needed debugging a Sys.exit error
by Andrew Francis 18 Dec '09

18 Dec '09

Hi Carl and Stephan: >Message: 4 >Date: Mon, 14 Dec 2009 13:45:44 +0100 >From: Carl Friedrich Bolz <cfbolz(a)gmx.de> >Subject: Re: [pypy-dev] Advice needed debugging a Sys.exit error > involving py.py and Stackless.py >To: pypy-dev(a)codespeak.net >Message-ID: <4B263378.3000102(a)gmx.de> >Content-Type: text/plain; charset=ISO-8859-1; format=flowed CB>unfortunately I don't really have time to dig deeply into your code. I CB>just wanted to give you the following hint: if you install greenlets for CB>CPython, you can test the lib/stackless.py code on top of CPython. Carl, I took your advice and ran stackless.py on top of greenlets and CPython. The test programmes worked! I will write more tests in the days to come. However this is a really need approach. This should be documented somewhere for other folks to try! CB>This makes it possible to distinguish problems in the pure app-level CB>code in lib/stackless.py from problems in the RPython-implementation of CB>coroutines in PyPy. Given that you are changing the applevel code only, CB>it is much more likely that the problem is actually caused by something CB>you changed. I changed only stackless.py. In turn, I changed very little code outside of adding the select function. I am not sure what I am looking for but I started to look at pypy/module/_stackless for clues. If I had to guess, I am thinking a culprit may involve stackless_flags - I am not setting a flag in the correct spot in the new code. Once again, thanks for your help. Cheers, Andrew

1 0

Leysin Winter Sprint: 23-30th January 2010
by Armin Rigo 18 Dec '09

18 Dec '09

===================================================================== PyPy Leysin Winter Sprint (23-30th January 2010) ===================================================================== .. image:: http://www.ermina.ch/002.JPG The next PyPy sprint will be in Leysin, Switzerland, for the seventh time. This is a fully public sprint: newcomers and topics other than those proposed below are welcome. ------------------------------ Goals and topics of the sprint ------------------------------ * The main idea of the sprint is to prepare the upcoming release of PyPy. This means mostly JIT or JIT-related work. It is a bit hard to be more precise right now, because it depends on how much is left to do in the core JIT. So work will be focused either on the JIT itself or on "make this or that feature of PyPy more JIT-friendly". Of course, as usual, we are ready to add any other task -- please mention on the mailing list what you would like to work on; the list of task is not really fixed. * And as usual, the main side goal is to have fun in winter sports :-) We can take a day off for ski. ----------- Exact times ----------- Officially, 23-30 January 2010. The idea is that the 23rd should be the arrival day, so we won't work too much until the 24th. ----------------------- Location & Accomodation ----------------------- Leysin, Switzerland, "same place as before". Let me refresh your memory: both the sprint venue and the lodging will be in a very spacious pair of chalets built specifically for bed & breakfast: http://www.ermina.ch/. The place has a good ADSL Internet connexion with wireless installed. You can of course arrange your own lodging anywhere (so long as you are in Leysin, you cannot be more than a 15 minutes walk away from the sprint venue), but I definitely recommend lodging there too -- you won't find a better view anywhere else (though you probably won't get much worse ones easily, either :-) Please *confirm* that you are coming so that we can adjust the reservations as appropriate. The rate so far has been around 60 CHF a night all included in 2-person rooms, with breakfast. There are larger rooms too (less expensive) and maybe the possibility to get a single room if you really want to. Please register by svn: http://codespeak.net/svn/pypy/extradoc/sprintinfo/leysin-winter-2010/people… or on the pypy-sprint mailing list if you do not yet have check-in rights: http://codespeak.net/mailman/listinfo/pypy-sprint You need a Swiss-to-(insert country here) power adapter. There will be some Swiss-to-EU adapters around -- bring a EU-format power strip if you have one.

2 3

Questions about RPython
by Olli Wang 17 Dec '09

17 Dec '09

Hi, I was trying to develop a tiny application using RPython and I have a few of questions. Obviously, RPython has the advantage of translating the code to various backends so we can get much better performance than Python scripts running on top of any Python implementation, so I was wondering, is it possible to rewrite the full Python's standard library using RPython so people can treat RPython as a general purpose programming language? (is that a good idea?) BTW, in my tiny experiment application. I want to create an empty file and write something there. Unfortunately, the open() function is not supported in RPython and the os.open() can't create a new file if not existed. So how do I `touch` a new file in RPython? Thanks. -- Olli Wang OLLI WANG PRODUCTIONS - http://olliwang.com A BLOG ABOUT MY LIFE AND MY WORK

4 3