Mailman 3 January 2020 - pypy-dev

PyPy Winter Sprint + cpyext
by Stefan Beyer 20 Dec '22

20 Dec '22

Hey everyone! Those of you who attended or followed one of the last two winter sprints in Leysin might know me, the others probably won't. I'm (still) a Master's student writing my thesis on PyPy's current issue with cross-heap cycles when using cpyext. The main point is, that they are not collected and stay around as floating garbage, even if they are not reachable any more. Correct me if I'm wrong, but I didn't notice anyone else working on that topic (and/or committing something) since I've picked it up two years ago (yeah, I know, that long ago...). I saw that you would be working on "cpyext performance and completeness" during the current winter sprint this week and thought that this might also concern my thesis. So I thought I'll give you an update. I recently pushed my current (non-optimized, breaking-some-tests, but more or less working) implementation of the "CPython-style" GC-extension for cpyext. It is still in an early stage and not all cases (legacy and non-legacy-finalizers, weakrefs) are handled. However, I picked up some pace during the last couple of weeks and I'm determined to finish this implementation during the following weeks (some quirks with the tests have been haunting me, but I think I figured most of them out by now). After that, I will implement a second alternative implementation (to compare to, mostly for the sake of my thesis), which will take some more time. I also added a couple of fancy test cases (the so called "dot-tests"), so that we can test complex object graphs a little bit easier (and also because it was kind of cool to have another language inside PyPy/RPython, even if it was only for the tests...), with more test cases to come (the current ones are a bit messy). None of the new changes concerning low-latency applications are currently integrated, but that should not be too hard. I guess it won't make much sense for me to join you at this year's winter sprint, especially as I won't be able to get there before Thursday, but I might be able to join you over the IRC channel (or some other form of communication if you like). If there is anything that is worth discussing please let me know! Also feel free to comment on my code, but beware that I might change some things once I try to do some optimizations (probably not many, but at least fix the worst issues) and make it a little bit more readable. You can find my code on the cpyext-gc-cycle branch.<https://bitbucket.org/pypy/pypy/commits/branch/cpyext-gc-cycle> Looking forward to hearing from you! Greetings, Stefan

2 2

Transition to foss.heptapod.net
by Matti Picus 30 Jan '20

30 Jan '20

Heptapod has opened their gitlab+mercurial offering to foss projects on https://foss.heptapod.net. I am one of the team of people they have recruited to administer the offering, you can read more about it here https://heptapod.net/heptapod-as-a-bitbucket-replacement.html#heptapod-as-a… I opened a request to move the pypy group (repos, issues, prs, wiki) to https://foss.heptapod.net, in accordance with previous discussions. Here is the request: https://foss.heptapod.net/heptapod/foss.heptapod.net/issues/11#note_6190 Please comment on that issue which repos seem still relevant. I plan to archive the numpy/numpypy ones at github.com/pypy. Matti

2 1

Leysin Winter sprint 2020
by Armin Rigo 29 Jan '20

29 Jan '20

Hi all, We will do again this year a Winter sprint in Leysin, Switzerland. The exact work topics are not precisely defined, but will certainly involve HPy (https://github.com/pyhandle/hpy) as well as the Python 3.7 support in PyPy (the py3.7 branch in the pypy repo). More details will be posted here, but for now, here is the early planning: it will occur for one week starting around the 27 or 28th of February. It will be in Les Airelles, a different bed-and-breakfast place from the traditional one in Leysin. It is a nice old house at the top of the village. There are various rooms for 2, 4 or 5 people, costing 40 to 85 CHF per person per night. I'd recommend the spacious, 5 people room (divided in two subrooms of 2 and 3), with a great balcony, at 50 CHF pp. We'd like to get some idea soon about the number of people coming. Please reply to this mail to me personally, or directly put your name in https://bitbucket.org/pypy/extradoc/src/extradoc/sprintinfo/leysin-winter-2… . A bientôt, Armin.

4 4

Tensorflow build errors
by Shuaib Osman 13 Jan '20

13 Jan '20

Hi, I'm trying to compile tensorflow r1.14 from source following the instruction on the TF website. Here's my setup: pypy3 virtual environment with: - Pypy3 (latest version 7.3) on ubuntu 18.04 - Cuda 10.1 installed - numpy 1.18.1 installed I've asked for XLA jit compilation and CUDA support from the ./configure script the build command: bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package compiles about 23000 targets and then fails with this stacktrace: ... Traceback (most recent call last): File "/home/vretiel/.cache/bazel/_bazel_vretiel/ec2591a0fe29386400d95468f7c519e5/execroot/org_tensorflow/bazel-out/host/bin/tensorflow/python/keras/api/create_tensorflow.python_api_1_keras_python_api_gen_compat_v1.runfiles/org_tensorflow/tensorflow/python/pywrap_tensorflow.py", line 58, in <module> from tensorflow.python.pywrap_tensorflow_internal import * File "/home/vretiel/.cache/bazel/_bazel_vretiel/ec2591a0fe29386400d95468f7c519e5/execroot/org_tensorflow/bazel-out/host/bin/tensorflow/python/keras/api/create_tensorflow.python_api_1_keras_python_api_gen_compat_v1.runfiles/org_tensorflow/tensorflow/python/pywrap_tensorflow_internal.py", line 28, in <module> _pywrap_tensorflow_internal = swig_import_helper() File "/home/vretiel/.cache/bazel/_bazel_vretiel/ec2591a0fe29386400d95468f7c519e5/execroot/org_tensorflow/bazel-out/host/bin/tensorflow/python/keras/api/create_tensorflow.python_api_1_keras_python_api_gen_compat_v1.runfiles/org_tensorflow/tensorflow/python/pywrap_tensorflow_internal.py", line 20, in swig_import_helper import _pywrap_tensorflow_internal ModuleNotFoundError: No module named '_pywrap_tensorflow_internal' The exact same commands (./configure {with the same options} and bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package) work perfectly when compiling against cpython 3.6. So there's some path/name mangling going on with pypy3. Any idea how I can get this compilation to work? Thanks.

1 0

Help with a revamped ww.pypy.org web site
by Matti Picus 08 Jan '20

08 Jan '20

In the nikola branch of pypy.org https://bitbucket.org/pypy/pypy.org/src/nikola/ I reworked the website content and layout reusing the work from https://github.com/frsdun/pypy-website. I would like to deploy it soon, as I think it is an improvement. You can try it out by checking out the branch, then running "make auto" which will - build a virtualenv - pip install nikola and other packages into the virtualenv - convert the rst sources into html in teh public directory - start a server on 0.0.0.0 (be careful if you don't want to open a socket to the world, use "make build", then run "venv_nikola/bin/nikola serve") - connect with a browser: try your computer, tablet, or phone Comments, criticisms, and especially pull requests are welcome. I am not a front-end designer. Still to do: - import the blog to move away from morepypy.blogger.com and self-host static pages - import the comments too Matti P.S. I have also started making the benchmarks run at speed.pypy.org work on python3. Help there is welcome as well.

2 2