Mailman 3 February 2019 - pypy-dev

PyPy Winter Sprint + cpyext
by Stefan Beyer 21 Dec '22

21 Dec '22

Hey everyone! Those of you who attended or followed one of the last two winter sprints in Leysin might know me, the others probably won't. I'm (still) a Master's student writing my thesis on PyPy's current issue with cross-heap cycles when using cpyext. The main point is, that they are not collected and stay around as floating garbage, even if they are not reachable any more. Correct me if I'm wrong, but I didn't notice anyone else working on that topic (and/or committing something) since I've picked it up two years ago (yeah, I know, that long ago...). I saw that you would be working on "cpyext performance and completeness" during the current winter sprint this week and thought that this might also concern my thesis. So I thought I'll give you an update. I recently pushed my current (non-optimized, breaking-some-tests, but more or less working) implementation of the "CPython-style" GC-extension for cpyext. It is still in an early stage and not all cases (legacy and non-legacy-finalizers, weakrefs) are handled. However, I picked up some pace during the last couple of weeks and I'm determined to finish this implementation during the following weeks (some quirks with the tests have been haunting me, but I think I figured most of them out by now). After that, I will implement a second alternative implementation (to compare to, mostly for the sake of my thesis), which will take some more time. I also added a couple of fancy test cases (the so called "dot-tests"), so that we can test complex object graphs a little bit easier (and also because it was kind of cool to have another language inside PyPy/RPython, even if it was only for the tests...), with more test cases to come (the current ones are a bit messy). None of the new changes concerning low-latency applications are currently integrated, but that should not be too hard. I guess it won't make much sense for me to join you at this year's winter sprint, especially as I won't be able to get there before Thursday, but I might be able to join you over the IRC channel (or some other form of communication if you like). If there is anything that is worth discussing please let me know! Also feel free to comment on my code, but beware that I might change some things once I try to do some optimizations (probably not many, but at least fix the worst issues) and make it a little bit more readable. You can find my code on the cpyext-gc-cycle branch.<https://bitbucket.org/pypy/pypy/commits/branch/cpyext-gc-cycle> Looking forward to hearing from you! Greetings, Stefan

2 2

PyPy3 on OpenBSD?
by Jiri Navratil 28 Feb '19

28 Feb '19

Hello, I need PyPy3 on OpenBSD 6.4 amd64. I found only pypy-5.3.1p0 in packages, but not any PyPy3 version. Exist some binaries or documentation for OpenBSD? I see PyPy3 only in dependencies on https://pypy.readthedocs.io/en/latest/build.html How I choose pypy3 during build? Thank you, Jiří -- Jiri Navratil, https://jiri.navratil.cz, +420 222 767 131

1 0

Fwd: Re: Users of PyPy on ARM 32bit
by Carl Friedrich Bolz-Tereick 27 Feb '19

27 Feb '19

-------- Original Message -------- From: Gelin Yan <dynamicgl(a)gmail.com> Sent: February 8, 2019 3:26:30 PM GMT+01:00 To: Carl Friedrich Bolz <cfbolz(a)gmx.de> Subject: Re: [pypy-dev] Users of PyPy on ARM 32bit > > Hi Carl > We are using pypy with raspberry pi 3 for smart irrigation. Pypy works fine to us. Regards gelin yan

4 3

Contributing to pypy development
by Mohamed Yousif 24 Feb '19

24 Feb '19

Greetings! I'm very interested in contributing to pypy development. But I'm really not sure how (or where) to start. So a little bit of a help would be great! I'm not sure what to do next. - i'm quite interested in jit development and i'd be very excited to work there. - i use Golang in my work and I really like how seamlessly i can integrate C code with it (definitely much easier than python). So, if i can help here that would be fine too. (i only used c++ recently in my work but i think i get some of the basics right and I'm very keen to learn more). My goal is to make python used in different domains. If you want it for its simplicity, no problem! As well as for high performance cases. PS. how much of a time i need to commit per week? I can handle up to 10 hours i guess. Regards Mohamed

1 0

More feedback on new pypy.org
by Maciej Fijalkowski 20 Feb '19

20 Feb '19

Hi everyone! Here is the next iteration of pypy.org - https://baroquesoftware.com/pypy-website/web/ - after adding some feedback. Note that no work has been done on content just yet. Feel free to provide more feedback. We also need to decide what to do with the logo. Best, Maciej Fijalkowski

3 2

PyPy 2.7 v7.0.0 on ARM HF
by Jorge Herskovic 20 Feb '19

20 Feb '19

I use PyPy on a Raspberry Pi 3 to drive Octoprint - it's faster than using Python, and more entertaining. The lack of a v7 for ARM was frustrating, and I tried cross-compiling my own. All I found were the instructions for 2.4.0, and I adapted them the best I could. Unfortunately I couldn't hit the combination of Raspbian and Ubuntu (or Debian) that would compile; headers were missing, or something else invariably broke. In frustration, I ended up translating PyPy using a completely emulated system under QEMU running 32-bit Debian Jessie. The good news: it worked! The translation completed successfully. The bad news: It took 48,800 seconds on a fairly current CPU. I don't recommend it for testing. Cheers, Jorge

1 0

pip_pypy3 throws exception when updating
by Joseph Reagle 19 Feb '19

19 Feb '19

Homebrew on MacOS Mojave just updated to pypy3 7.0.0 and reminded me to update the setup tools. Doing so, though, throws an exceptions. ``` ─➤ pip_pypy3 install --upgrade pip setuptools Collecting pip Using cached https://files.pythonhosted.org/packages/d7/41/34dd96bd33958e52cb4da2f1bf081… Collecting setuptools Using cached https://files.pythonhosted.org/packages/d1/6a/4b2fcefd2ea0868810e92d519daca… Installing collected packages: pip, setuptools Found existing installation: pip 10.0.1 Uninstalling pip-10.0.1: Successfully uninstalled pip-10.0.1 Found existing installation: setuptools 39.0.1 Uninstalling setuptools-39.0.1: Successfully uninstalled setuptools-39.0.1 Successfully installed pip-19.0.2 setuptools-40.8.0 Traceback (most recent call last): File "/usr/local/bin/pip_pypy3", line 11, in <module> sys.exit(main()) File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/__init__.py", line 246, in main File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/basecommand.py", line 264, in main File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/basecommand.py", line 81, in _build_session File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/download.py", line 338, in __init__ File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/download.py", line 127, in user_agent File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_internal/utils/misc.py", line 829, in get_installed_version File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 558, in __init__ File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 614, in add_entry File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 1882, in find_eggs_in_zip File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 1399, in has_metadata File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 1756, in _has File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 1633, in zipinfo File "/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/pip-10.0.1-py3.6.egg/pip/_vendor/pkg_resources/__init__.py", line 1590, in load FileNotFoundError: [Errno 2] No such file or directory: '/usr/local/Cellar/pypy3/7.0.0/libexec/site-packages/setuptools-39.0.1-py3.6.egg' ╭─reagle@hom ~ ╰─➤ pip_pypy3 install --upgrade pip setuptools 1 ↵ Requirement already up-to-date: pip in /usr/local/Cellar/pypy3/7.0.0/libexec/site-packages (19.0.2) Requirement already up-to-date: setuptools in /usr/local/Cellar/pypy3/7.0.0/libexec/site-packages (40.8.0) ╭─reagle@hom ~ ╰─➤ ```

2 1

pypy3 - Import cv2
by Amy 15 Feb '19

15 Feb '19

Hi, I found a problem while using cv2. In my code, I already imported cv2 and installed pip install opencv-python already, however, it gives following error. Collecting cv2 Could not find a version that satisfies the requirement cv2 (from versions: ) No matching distribution found for cv2. When I try with python, it is working well, however, when I try with pypy3, it is not importing cv even though there is a opencv-python in the site-packages. Please help me with this error! I have been working on this error for a week.

2 1

Why is pypy slower?
by Joseph Reagle 13 Feb '19

13 Feb '19

Hello all, thank you for your work on pypy. I'm a pypy newbie and thought to try it on a program I use a lot and where I appreciate fast response times (especially when running on a webhost). I keep my bibliography notes in interconnected XML-based mindmaps (Freeplane). `fe.py` parses and walks those XML files and generates output (bibtex, YAML, wikipedia, or HTML that highlights a queried search) [1]. [1]: https://github.com/reagle/thunderdell/blob/master/fe.py Running it with pypy is slower: ``` > time python3 fe.py -cq Giddens python3 fe.py -cq Giddens 1.46s user 0.16s system 97% cpu 1.649 total > time pypy3 fe.py -cq Giddens pypy3 fe.py -cq Giddens 2.81s user 0.26s system 93% cpu 3.292 total ``` I tried to use the pypy profiler but it would seemingly lockup (and vmprof.com seems down to boot). I've attached a cProfile. As you might expect, it spends a lot of time parsing XML, doing the regex search on nodes, and parsing citation strings. Any idea why pypy is slower?

6 10

Using Opencv-python with Pypy
by Amy 13 Feb '19

13 Feb '19

Hi, I am Amy and using pypy with python3.6.6. I need to import "python -m pip install opencv-python" to run the program and try to import with pypy like "pypy3 -m pip install opencv-python". However, it give an error: "Could not find a version that satisfies the requirement opencv-python (from versions: ) No matching distribution found for opencv-python You are using pip version 9.0.1, however version 19.0.2 is available. You should consider upgrading via the 'python -m pip install --upgrade pip' command." (by the way, I upgraded all the tools (pip and wheel) to the lastest version but they keep saying me to upgrade it). Do you have any idea to solve this problem? I need pypy to upgrade the speed of my program which is reading a large video and want to increase the average frame numbers. Thank you!

3 2