Mailman 3 August 2018 - pypy-dev

last benchmark run was June 2
by Matti Picus 01 Sep '18

01 Sep '18

We lost the machine that was running our benchmark suite, the last run sees to have been June2 http://speed.pypy.org/changes/. Choices: - Ask the PSF to run on the machine that is used to run benchmarks for speed.python.org. The machine, speed-python.osuosl.org, is very powerful and not heavily used, a description of it is https://speed.python.org/about/ under "The Machine". The users with psf-authorized access to the machine, from https://github.com/python/psf-chef, are fijal, zware, mattip, haypo (results of "grep python-speed -r ." in that repo) - Use one of bencher4, baroquesoftware.com, or any other pypy-specific donated machine. - Stop running benchmarks Any thoughts? Do we need nightly benchmarks or should we run them less often? Should we also be running py3.5 benchmarks? Should we upload to speed.python.org, speed.pypy.org or both? Matti

2 1

translation problems on unicode-utf8-py3
by Matti Picus 31 Aug '18

31 Aug '18

I have two failures with translation that I need some help with on the unicode-utf8-py3 branch. Occasionally while translating the branch locally, I get an error [translation:ERROR] UnsupportedFieldExc: unexpected array(struct(struct)) [translation] start debugger... > /home/matti/pypy_stuff/pypy_35/rpython/jit/codewriter/heaptracker.py(111)all_interiorfielddescrs() -> raise UnsupportedFieldExc("unexpected array(struct(struct))") I can get to the offending struct <GcArray of utf8_loc_elem { baseindex: Signed, ofs: FixedSizeArray of 16 Char } > The struct is from rpython/rlib/rutf8.py: UTF8_INDEX_STORAGE = lltype.GcArray(lltype.Struct('utf8_loc_elem', ('baseindex', lltype.Signed), ('ofs', lltype.FixedSizeArray(lltype.Char, 16)), )) and is returned from the function create_utf8_index_storage which is called in that file as well as in objspace/std/unicodeobject.py I put more of the error messsage and the code bits in this gist https://gist.github.com/mattip/057554dd7eba64f8cbf2bc1a70c1c6eb The second strange failure is of a own z_translation test http://buildbot.pypy.org/summary/longrepr?testname=test__codecs_translates&… Any help would be welcome. Matti

2 1

bencher4 fialing own py3 builds
by Matti Picus 29 Aug '18

29 Aug '18

Own nightly builds on p3.5 are failing numerous cpyext tests. The problem seems to be related to the _cffi_backend module somehow hitting an assert at import, but I cannot reproduce the problem locally. I have tried many things on the unicode-utf8-py3 branch to solve the problem, but to no avail. See the last 3 or 4 commits on that branch. Any help would be greatly appreciated. Perhaps we should retire bencher4 and find another build machine, one that we can control a bit more? Matti

3 2

PyOpenCL wants to move from cffi to pybind11
by Matti Picus 17 Aug '18

17 Aug '18

PyOpenCL allows one to write kernels for OpenCL in python and uses numpy arrays as the data to pass around. They now use cffi bindings, but are thinking of moving to PyBind11. https://lists.tiker.net/pipermail/pyopencl/2018-August/002395.html They claim 1500 less code lines and a 2x speedup (on cpython). It seems this is a step backwards for us, PyBind11 uses the python c-api to wrap C++ code and I do not see how we can make that JIT freindly. On the other hand, I do not know how easy it is to move form PyBind11 to cppyy. Any thoughts? I used to follow their codebase closely, now I just lurk on the mailing list, and do not use the package myself. Matti

2 1