Mailman 3 August 2008 - pypy-dev

Pypy IRC meeting fri 17:00 UTC on #pypy (freenode.net)
by Samuele Pedroni 18 Sep '08

18 Sep '08

Hi all, since EuroPython there's been some thinking and planning about doing a new release of PyPy 1.1 before the end of the year with a focus related to the recent work on compatibility with applications and CPython and stability. We think that an important step in the process is to improve and consolidate our testing infrastructure with the goal of making it easy to spot regressions. After some people availability checking on #pypy we agreed on scheduling a meeting: this Friday 29 Aug at 17:00 UTC (19:00 CEST) on #pypy IRC channel (freenode.net) The topics to discuss are: - which machines do we have available or we need (we would like at least to cover Linux x86-32 and windows 32bits) - requirements for our testing infrastructure - status of buildbot related work, what would it take to use buildbot for all out testing needs? - things to do first This is an open meeting, anybody interested in topics is invited to participate. It should not last more than 1 hour. We are also planning on having a sprint in October around the testing/release topics and others, we may also try at this meeting to finalize location and dates for that. regards.

3 5

master thesis with pypy
by Severin 04 Sep '08

04 Sep '08

Hello everybody, I am Severin - a student at ETH in Zurich. Currently i'm enrolled at the Masters program in computer science. The next 6 month, starting from the 15th of September I will do my thesis. This more or less means working on a project. Since me and my mentor (Nicholas Matsakis) both share interest in python we came up with the idea to do some work with the pypy project. We started to talk about what we could do and what would be interesting for us. In some way we wanted to '*improve multiprocessor capabilities*' in pypy. We had some ideas so far, but we are not yet fixed on something. I was wondering if somebody of you has something that is of particular interest to the pypy community. Some ideas that might be interesting to look at for me. Any kind of input or idea is welcome... Best regards, Severin

5 6

translate.py failes
by Ветошкин Никита 04 Sep '08

04 Sep '08

Hi, everybody. Tried to play with pypy, but translating to c failes because of lack of memory. Used command: python translate.py. OS: gentoo linux, amd64 RAM: 4Gb Traceback attached to the letter. nekto0n [cbuild:execute] cc -O3 -fomit-frame-pointer -pthread -c -O3 -fomit-frame-pointer -pthread -c __thread_test.c -o __thread_test.o [Timer] Timings: [Timer] annotate --- 679.5 s [Timer] rtype_lltype --- 487.4 s [Timer] backendopt_lltype --- 458.8 s [Timer] stackcheckinsertion_lltype --- 70.2 s [Timer] database_c --- 971.2 s [Timer] source_c --- 0.4 s [Timer] =========================================== [Timer] Total: --- 2667.5 s [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 278, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/driver.py", line 797, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/driver.py", line 268, in _do [translation:ERROR] res = func() [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/driver.py", line 492, in task_source_c [translation:ERROR] c_source_filename = cbuilder.generate_source(database) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/c/genc.py", line 127, in generate_source [translation:ERROR] CBuilder.have___thread = check_under_under_thread() [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/cbuild.py", line 696, in check_under_under_thread [translation:ERROR] noerr=True) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/cbuild.py", line 654, in build_executable [translation:ERROR] compiler.build(noerr=noerr) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/cbuild.py", line 578, in build [translation:ERROR] self._build() [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/cbuild.py", line 638, in _build [translation:ERROR] extra_preargs=compile_extra) [translation:ERROR] File "/usr/lib64/python2.5/distutils/ccompiler.py", line 701, in compile [translation:ERROR] self._compile(obj, src, ext, cc_args, extra_postargs, pp_opts) [translation:ERROR] File "/usr/lib64/python2.5/distutils/unixccompiler.py", line 180, in _compile [translation:ERROR] extra_postargs) [translation:ERROR] File "/var/tmp/pypy-svn/dist/pypy/translator/tool/cbuild.py", line 482, in spawn_and_log [translation:ERROR] return spawn(cmd, *args, **kwds) [translation:ERROR] File "/usr/lib64/python2.5/distutils/ccompiler.py", line 1042, in spawn [translation:ERROR] spawn (cmd, dry_run=self.dry_run) [translation:ERROR] File "/usr/lib64/python2.5/distutils/spawn.py", line 37, in spawn [translation:ERROR] _spawn_posix(cmd, search_path, dry_run=dry_run) [translation:ERROR] File "/usr/lib64/python2.5/distutils/spawn.py", line 127, in _spawn_posix [translation:ERROR] pid = os.fork() [translation:ERROR] OSError: [Errno 12] Cannot allocate memory [translation] start debugger... > /usr/lib64/python2.5/distutils/spawn.py(127)_spawn_posix() -> pid = os.fork()

6 11

commit bot
by Maciej Fijalkowski 30 Aug '08

30 Aug '08

what about moving from CIA to keenan (the bot that is sitting on #pypy-commits and did not have a single downtime since last few months) for commit messages on #pypy? CIA was down again yesterday. cheers, fijal

2 2

works in python2.4, fails in pypy
by Ondrej Certik 29 Aug '08

29 Aug '08

Hi, I am using pypy in Debian: ondra@fuji:~/sympy$ python2.4 Python 2.4.5 (#2, Jul 20 2008, 20:55:34) [GCC 4.3.1] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import sympy >>> ondra@fuji:~/sympy$ pypy Python 2.4.1 (pypy 1.0.0 build 55235) on linux2 Type "help", "copyright", "credits" or "license" for more information. ``the 'super' keyword is not that huggable'' >>>> import sympy Traceback (most recent call last): File "<console>", line 1, in <interactive> File "/home/ondra/sympy/sympy/__init__.py", line 16, in <module> from sympy.core import * File "/home/ondra/sympy/sympy/core/__init__.py", line 13, in <module> from function import Lambda, WildFunction, Derivative, diff, FunctionClass, \ File "/home/ondra/sympy/sympy/core/function.py", line 361, in <module> class WildFunction(Function, Atom): File "/home/ondra/sympy/sympy/core/function.py", line 68, in __new__ return type.__new__(cls, name, bases, attrdict) TypeError: instance layout conflicts in multiple inheritance >>>> Do you know what this error means and how should we fix sympy so that it works on top of pypy? Ondrej

4 18

pypy-jvm translation, patch
by Marek Paška 28 Aug '08

28 Aug '08

Hi, today, I tried to translate pypy-jvm, but the translation failed with the trace below. The following patch makes the translation to be completed: Index: pypy/translator/jvm/metavm.py =================================================================== --- pypy/translator/jvm/metavm.py (revision 57667) +++ pypy/translator/jvm/metavm.py (working copy) @@ -93,6 +93,7 @@ (ootype.Signed, ootype.UnsignedLongLong): jvm.I2L, (ootype.SignedLongLong, ootype.Signed): jvm.L2I, (ootype.UnsignedLongLong, ootype.SignedLongLong): None, + (ootype.UnsignedLongLong, ootype.Unsigned): jvm.L2I, } class _CastPrimitive(MicroInstruction): However, I am not really sure whether the patch is really correct :-) Pypy-jvm does not work anyway, it is the problem I reported several weeks ago: paskma@paskma:goal$ ./pypy-jvm 'import site' failed Python 2.4.1 (pypy 1.0.0 build 100000) on linux2 Type "help", "copyright", "credits" or "license" for more information. And now for something completely different: ``nothing is true'' Error calling sys.excepthook: debug: OperationError: debug: operror-type: ImportError debug: operror-value: cannot import name 'curdir' (Don't be confused by the build number, I am using git-svn.) Marek Paška The traceback: [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 278, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/driver.py", line 797, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/tool/taskengine.py", line 116, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/driver.py", line 268, in _do [translation:ERROR] res = func() [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/driver.py", line 709, in task_source_jvm [translation:ERROR] self.jvmsource = self.gen.generate_source() [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/genjvm.py", line 266, in generate_source [translation:ERROR] GenOO.generate_source(self) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/genoo.py", line 68, in generate_source [translation:ERROR] self.gen_pendings() [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/genoo.py", line 83, in gen_pendings [translation:ERROR] node.render(self.ilasm) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/node.py", line 899, in render [translation:ERROR] method.render(gen) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/function.py", line 129, in render [translation:ERROR] self.render_normal_block(block) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/node.py", line 473, in render_normal_block [translation:ERROR] return OOFunction.render_normal_block(self, block) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/function.py", line 218, in render_normal_block [translation:ERROR] self._render_op(op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/node.py", line 574, in _render_op [translation:ERROR] OOFunction._render_op(self, op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/function.py", line 351, in _render_op [translation:ERROR] instr_list.render(self.generator, op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/metavm.py", line 247, in render [translation:ERROR] instr.render(generator, op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/metavm.py", line 62, in render [translation:ERROR] jmethod.return_type, op.result) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/metavm.py", line 21, in _invoke_method [translation:ERROR] gen.load(arg) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/generator.py", line 495, in load [translation:ERROR] return render_sub_op(value, self.db, self) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/function.py", line 24, in render_sub_op [translation:ERROR] instr_list.render(generator, op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/oosupport/metavm.py", line 247, in render [translation:ERROR] instr.render(generator, op) [translation:ERROR] File "/home/data/opt/svnpypy/vanilla-dist/pypy/translator/jvm/metavm.py", line 102, in render [translation:ERROR] opcode = CASTS[(FROM, TO)] [translation:ERROR] KeyError: (<UnsignedLongLong>, <Unsigned>)

1 0

ANN: pylib/pytest 0.9.2 released
by holger krekel 22 Aug '08

22 Aug '08

Welcome to the 0.9.2 py lib and py.test release - mainly fixing Windows issues, providing better packaging and integration with setuptools. Summry of main features: * py.test: cross-project testing tool with many advanced features * py.execnet: ad-hoc code distribution to SSH, Socket and local sub processes * py.magic.greenlet: micro-threads on standard CPython ("stackless-light") * py.path: path abstractions over local and subversion files * rich documentation of py's exported API * tested against Linux, Win32, OSX, works on python 2.3-2.6 good entry points: Pypi pages: http://pypi.python.org/pypi/py/ Download/Install: http://codespeak.net/py/0.9.2/download.html Documentation/API: http://codespeak.net/py/0.9.2/index.html the CHANGELOG excerpt for the 0.9.1 -> 0.9.2 transition: * refined installation and metadata, created new setup.py, now based on setuptools/ez_setup (thanks to Ralf Schmitt for his support). * improved the way of making py.* scripts available in windows environments, they are now added to the Scripts directory as ".cmd" files. * py.path.svnwc.status() now is more complete and uses xml output from the 'svn' command if available (Guido Wesdorp) * fix for py.path.svn* to work with svn 1.5 (Chris Lamb) * fix path.relto(otherpath) method on windows to use normcase for checking if a path is relative. * py.test's traceback is better parseable from editors (follows the filenames:LINENO: MSG convention) (thanks to Osmo Salomaa) * fix to javascript-generation, "py.test --runbrowser" should work more reliably now * removed previously accidentally added py.test.broken and py.test.notimplemented helpers. * there now is a py.__version__ attribute best and have fun, holger krekel -- collaborative expert contracting: http://merlinux.eu PyPy Python/Compiler tool chain: http://codespeak.net/pypy pylib py.test/greenlets/svn APIs: http://pylib.org

1 0

Translate pypy-c
by Bruno Gola 19 Aug '08

19 Aug '08

Hi! I'm working on branch 2.5-features and trying to translate pypy-c. Probably some of the changes I made are not RPython and the translator crashes. Some of theses changes I've already found and fixed, but now I can't find out how to fix this error (traceback http://paste.pocoo.org/show/82666/). The traceback points to checkFlag() in pyassem.py, but it's identical to trunk. I've written some code that uses this method (visitImport() and visitFrom() in pycodegen.py). I don't know much about the translator. Does anyone have any idea about what's wrong? Thanks, -- Bruno Fialho Marques Gola <brunogola(a)gmail.com> http://www.brunogola.com.br Cel: (11) 9294-5883

2 2

Building pypy-c on mac os x
by Raj Bandyopadhyay 15 Aug '08

15 Aug '08

Hi all I was wondering if pypy-c can be built on Mac OS X, and if there are any special options to use? I tried building it on a Linux/x86 machine and it worked fine (took a while to build), but on a mac, it seems to bring the machine down completely (the machine becomes non-responsive during the process). This is a mac running Leopard with Intel core-duo processors. Is this a known issue? Thanks Raj

3 2

Re: [pypy-dev] Unable to translate locks
by Marek Paška 14 Aug '08

14 Aug '08

Hi, well, I've solved this problem. The point is that the lock in my example is created at import time, before translation. Works fine if the initialization is moved into a function that can be translated. Marek Paška On Wed, Jul 30, 2008 at 18:10, Marek Paška <paskma(a)gmail.com> wrote: > Hi! > > I tried this option and it does not change anything. In fact, this > option is not even needed for pypy interpreter translation, with > --withmod-thread the pypy interpreter is compiled successfully and the > thread module is usable regardless of the --thread option. As I > understand, the --thread option only affects runtime behavior, e.g., > ensures that GC is aware of multiple threads or so. Or am I wrong? > > It seems, there is some magic used when the thread module is > translated. Something that affects annotation... I don't know. I spent > several days debugging it but PyPy is rather complex. > > Cheers, > > Marek Paška > > On Wed, Jul 30, 2008 at 09:34, Armin Rigo <arigo(a)tunes.org> wrote: >> Hi, >> >> On Tue, Jul 29, 2008 at 12:55:33PM +0200, Marek Pa?ka wrote: >>> paskma@paskma:goal$ ./translate.py mytasks_err.py >> >> I think you need to specify the --thread option: >> >> ./translate.py --thread mytasks_err.py >> >> >> A bientot, >> >> Armin >> >

1 0