Mailman 3 December 2017 - pypy-dev

About gurobipy
by Luis José Novoa 31 May '18

31 May '18

Hi All, My name is Luis Novoa. Im working on a large scale optimization problem using python/gurobipy for my implementation. I was wondering if any of you in this list has used gurobipy with pypy, or if it is even possible at this time. Thanks in advance, Luis.

9 9

Re: [pypy-dev] Mysterious IndexError in service running with PyPy
by William ML Leslie 22 May '18

22 May '18

Where is the code that changes the size of self.heap? How do we know that size(self.heap) is constant? My guess is that some thread changes this; but l is not recomputed. On 18 Dec 2017 6:59 PM, "hubo" <hubo(a)jiedaibao.com> wrote: > I'm reporting this issue in this mail group, though I don't know if it is > related with PyPy, because it is really strange, and is not able to > reproduce stably. But I hope someone may know the reason or have some > points. > > I'm running some SDN services written in Python with PyPy 5.3.0. The > related code is here: > > https://github.com/hubo1016/vlcp/blob/8022e3a3c67cf4305af503d507640a730ca39… > > The full code is also in the repo, but may be too complex to describe. But > this related piece is quite simple: > > def _siftdown(self, pos): > temp = self.heap[pos] > l = len(self.heap) > while pos * 2 + 1 < l: > cindex = pos * 2 + 1 > pt = self.heap[cindex] > if cindex + 1 < l and self.heap[cindex+1][0] < pt[0]: > cindex = cindex + 1 > pt = self.heap[cindex] > if pt[0] < temp[0]: > self.heap[pos] = pt > self.index[pt[1]] = pos > else: > break > pos = cindex > self.heap[pos] = temp > self.index[temp[1]] = pos > It is a simple heap operation. The service uses a heap to process timers. > When the service is not busy, it usually runs this piece of code several > times per minute. > > I have 32 servers running this service. They are quite stable in about > three months, but one day one of the services crashes on line 100 reporting > IndexError: > pt = self.heap[cindex] > > As you can see, cindex = pos * 2 + 1, which is tested by the while > pre-conditon just two lines before. And there is not any multi-threading > issues here because this piece of code always runs in the same thread. So > it is not possible in theory for this to happen. > > Only the following facts are known about this issue: > > 1. It reproduces - through quite rarely. I've met this kind of > crashes 4 times, each with different machine, so it should not be related > to hardware issuess. Since I've got 32 servers, it might take more than one > year to reproduce with a single server. > 2. It seems not to be related to pressures. All of the crashes happens > at night, when there are little requests. Only some cleanup tasks are > running in fixed interval. > > The services are running with PyPy 5.3.0. I've upgraded a few of them to > 5.9, but it will take a long time to validate whether this still happens. > And It is not validated on CPython too. I'm also trying to collect more > debugging information for this issue, but it is very hard since it rarely > reproduces. > > It is not a serious issue. It could be workarounded with a auto-restart, > but I'm searching the cause. > > > 2017-12-18 > ------------------------------ > hubo > > _______________________________________________ > pypy-dev mailing list > pypy-dev(a)python.org > https://mail.python.org/mailman/listinfo/pypy-dev > >

2 3

PhD Positions in programming language runtimes (Python)
by David Bremner 02 May '18

02 May '18

1 Position I: Python on OMR =========================== The candidate will explore the benefits and challenges of using OMR [1] components (e.g. JIT, GC) in Python [2,3] runtimes. This may involve extending OMR in novel ways to better support Python, or vice-versa. If questions like how to balance fast startup time for scripting applications against good performance for compute-intensive workloads sound interesting, this might an opportunity for you. 2 Position II: Python and PGAS ============================== The candidate will implement support for parallel programming with Python, using the PGAS [4] (parallel global address space) model. The PGAS model can significantly simplify the implementation of parallel algorithms on distributed and shared memory computers. Challenges include enabling parallelism while dealing with Python's Global Interpreter Lock (GIL), and implementing distributed garbage collection efficiently. 3 Qualifications ================ Normally applicants to the Computer Science PhD program at UNB require a Master's degree in computer science or a closely related area. This project will require substantial hands-on and experimental work, and being comfortable with Python and C++. Familiarity with Linux and Open Source Software development would be a plus. For position I, exposure to programming language concepts like GC, JIT, and bytecode would be helpful. For position II, experience with parallel programming frameworks and/or languages such as MPI, OpenMP, X10 is an asset. 4 Environment ============= This project is supported by the IBM Centre for Advanced Studies (Atlantic) at the University of New Brunswick [5]. We have a lively group of students, postdocs, and research assistants working on related problems. Students work closely with both UNB researchers and technical experts from IBM, gaining valuable perspective and experience. 5 Support ========= These positions are "fully funded"; the exact funding package is subject to finalization but will be consistent with other fully funded students in Computer Science at UNB. You can find some information about expenses on the UNB web site [6]. 6 Contact ========= Send your resumé and unofficial transcripts by email to Stephen MacKay <smackay3(a)unb.ca> Please specify which position(s) you are interested in. [1]: [http://www.eclipse.org/omr/] [2]: [http://www.python.org] [3]: [http://www.pypy.org] [4]: [http://www.pgas.org/] [5]: [http://www.unb.ca/research/casatlantic/] [6]: [http://www.unb.ca/fredericton/studentservices/international/new_internation…]

1 1

Re: [pypy-dev] pypy 5.10 release
by blanch 02 Jan '18

02 Jan '18

hello, thanks for the 5.10 release! just a problem on the mac: it seems that the pypy3 binaries are linked against a libffi provided by a package manager (homebrew?), since dyld is looking for /usr/local/opt/libffi/lib/libffi.6.dylib (see below the error reported and otool output). since i do not use homebrew, it fails to execute on my mac. i have the problem with the pypy3 pre-sierra version, but according to a comment on the morepypy blog [0], the problem exist for high sierra version of pypy3 and for pypy2 (which looks for /usr/local/opt/openssl/lib/libssl.1.0.0.dylib) thanks again for your work, and best wishes for 2018! renaud 0. https://www.blogger.com/comment.g?blogID=3971202189709462152&postID=3223396… % pypy3 dyld: Library not loaded: /usr/local/opt/libffi/lib/libffi.6.dylib Referenced from: /Users/Shared/src/pypy3-v5.10.0-osx64-2/bin//libpypy3-c.dylib Reason: image not found Trace/BPT trap % otool -L /Users/Shared/src/pypy3-v5.10.0-osx64-2/bin/libpypy3-c.dylib /Users/Shared/src/pypy3-v5.10.0-osx64-2/bin/libpypy3-c.dylib: @rpath/libpypy3-c.dylib (compatibility version 0.0.0, current version 0.0.0) /usr/lib/libutil.dylib (compatibility version 1.0.0, current version 1.0.0) /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 1238.0.0) /usr/lib/libexpat.1.dylib (compatibility version 7.0.0, current version 8.0.0) /usr/lib/libbz2.1.0.dylib (compatibility version 1.0.0, current version 1.0.5) /usr/lib/libz.1.dylib (compatibility version 1.0.0, current version 1.2.8) /usr/local/opt/libffi/lib/libffi.6.dylib (compatibility version 7.0.0, current version 7.1.0) /usr/lib/libncurses.5.4.dylib (compatibility version 5.4.0, current version 5.4.0) -- Renaud Blanch http://iihm.imag.fr/blanch/ mailto:renaud.blanch@imag.fr tel:+33.4.57.42.14.56

2 1

Pypy's facelift and certificate issues
by Kotrfa 01 Jan '18

01 Jan '18

Hi, thank you for all your hard work, I really appreciate it. Firstly, it seems that the website SSL certificate expired or something. At my latest Chromium reports "Not secure". Secondly, I totally understand that there are more pressing issues than cool website, but the current design and functionality is IMO really putting people off. So I am going to through away some things which seems weird to ME (and I understand it's subjective - please take it as a friendly feedback). The jQuery versions suggests November 2012, the design idea seems even older... There are old information such as "*We are soon releasing a beta supporting Python 3.3." *or the fact that the donations bars are still present even though they are closed (and hence could be moved into some blog post). Blog is also terrible, this is how it renders on my laptop (the same with the external display): https://imgur.com/a/qkjEa . The logo could be surely polished as well (I like the idea, but it seems a bit childish). Even though I am not professional front end developer, I am quite confident this feedback is not far from what a professional would say. It's also not about having "cool" website for itself, but that a nice projects attracts good people. I myself am questioning how good, from technical point of view, Pypy's project can be if the site looks like like it does and the most convenient way how to reach the devs is through mailing list... Best, Daniel

3 6

(no subject)
by Mona Shetg 30 Dec '17

30 Dec '17

1 0

speed.pypy.org
by Gerald Jansen 28 Dec '17

28 Dec '17

On the main page, all the links to http://speed.pypy.org/ give 502 Bad Gateway nginx/1.1.19 Not pretty.

1 0

Dual release v5.10.0 of PyPy2 and PyPy3 is out
by Maciej Fijalkowski 25 Dec '17

25 Dec '17

The PyPy team is proud to release both PyPy2.7 v5.10 (an interpreter supporting Python 2.7 syntax), and a final PyPy3.5 v5.10 (an interpreter for Python 3.5 syntax). The two releases are both based on much the same codebase, thus the dual release. This release is an incremental release with very few new features, the main feature being the final PyPy3.5 release that works on linux and OS X with beta windows support. It also includes fixes for `vmprof`_ cooperation with greenlets. Compared to 5.9, the 5.10 release contains mostly bugfixes and small improvements. We have in the pipeline big new features coming for PyPy 6.0 that did not make the release cut and should be available within the next couple months. As always, this release is 100% compatible with the previous one and fixed several issues and bugs raised by the growing community of PyPy users. As always, we strongly recommend updating. There are quite a few important changes that are in the pipeline that did not make it into the 5.10 release. Most important are speed improvements to cpyext (which will make numpy and pandas a bit faster) and utf8 branch that changes internal representation of unicode to utf8, which should help especially the Python 3.5 version of PyPy. This release concludes the Mozilla Open Source `grant`_ for having a compatible PyPy 3.5 release and we're very grateful for that. Of course, we will continue to improve PyPy 3.5 and probably move to 3.6 during the course of 2018. You can download the v5.10 releases here: http://pypy.org/download.html We would like to thank our donors for the continued support of the PyPy project. We would also like to thank our contributors and encourage new people to join the project. PyPy has many layers and we need help with all of them: `PyPy`_ and `RPython`_ documentation improvements, tweaking popular `modules`_ to run on pypy, or general `help`_ with making RPython's JIT even better. .. _vmprof: http://vmprof.readthedocs.io .. _grant: https://morepypy.blogspot.com/2016/08/pypy-gets-funding-from-mozilla-for.ht… .. _`PyPy`: index.html .. _`RPython`: https://rpython.readthedocs.org .. _`modules`: project-ideas.html#make-more-python-modules-pypy-friendly .. _`help`: project-ideas.html What is PyPy? ============= PyPy is a very compliant Python interpreter, almost a drop-in replacement for CPython 2.7 and CPython 3.5. It's fast (`PyPy and CPython 2.7.x`_ performance comparison) due to its integrated tracing JIT compiler. We also welcome developers of other `dynamic languages`_ to see what RPython can do for them. The PyPy release supports: * **x86** machines on most common operating systems (Linux 32/64 bits, Mac OS X 64 bits, Windows 32 bits, OpenBSD, FreeBSD) * newer **ARM** hardware (ARMv6 or ARMv7, with VFPv3) running Linux * big- and little-endian variants of **PPC64** running Linux, * **s390x** running Linux .. _`PyPy and CPython 2.7.x`: http://speed.pypy.org .. _`dynamic languages`: http://rpython.readthedocs.io/en/latest/examples.html Changelog ========= * improve ssl handling on windows for pypy3 (makes pip work) * improve unicode handling in various error reporters * fix vmprof cooperation with greenlets * fix some things in cpyext * test and document the cmp(nan, nan) == 0 behaviour * don't crash when calling sleep with inf or nan * fix bugs in _io module * inspect.isbuiltin() now returns True for functions implemented in C * allow the sequences future-import, docstring, future-import for CPython bug compatibility * Issue #2699: non-ascii messages in warnings * posix.lockf * fixes for FreeBSD platform * add .debug files, so builds contain debugging info, instead of being stripped * improvements to cppyy * issue #2677 copy pure c PyBuffer_{From,To}Contiguous from cpython * issue #2682, split firstword on any whitespace in sqlite3 * ctypes: allow ptr[0] = foo when ptr is a pointer to struct * matplotlib will work with tkagg backend once `matplotlib pr #9356`_ is merged * improvements to utf32 surrogate handling * cffi version bump to 1.11.2 .. _`matplotlib pr #9356`: https://github.com/matplotlib/matplotlib/pull/9356

1 0

pypy 5.10 release
by Matti Picus 25 Dec '17

25 Dec '17

I have uploaded the pypy 5.10 release tarballs for both pypy2.7 and pypy3.5 to https://bitbucket.org/pypy/pypy/downloads, sha256 hashes are available from https://bitbucket.org/pypy/pypy.org/src/41427b24c7395f4a5a6636ef0d072c83982… Please download and test before we release to make sure the tarballs are valid Matti

2 1

numpy Installation in pypy on window 7 with python ver. 3.6
by 이대수 23 Dec '17

23 Dec '17

Hi, I've been trying to install "numpy" in pypy using pip install numpy. I'm using window7(64bit) and the python ver. 3.6. And I downloaded "Windows binary (32bit) (you might need the VS 2008 runtime library installer vcredist_x86.exe.)" - The above version is for python 2.7 and window 32 bit. Despite the facts, I just downloaded it and installed pip for pypy. though it worked, the error kept showing up when I tried to install numpy, using "pip install numpy". ------------------------------------------------------------------------------- Here's the question. 1. Would it work if I install "Windows binary (32bit) (you might need the VS 2008 runtime library installer vcredist_x86.exe.)" this version on window7(64bit) with python ver. 2.7 ? 2. Or do I have to use "window(64bit) & python ver.2.7"? (I'm asking since I saw somebody say "This version now works on window 64bit too!").

2 1