Mailman 3 February 2018 - pypy-dev

About gurobipy
by Luis José Novoa 31 May '18

31 May '18

Hi All, My name is Luis Novoa. Im working on a large scale optimization problem using python/gurobipy for my implementation. I was wondering if any of you in this list has used gurobipy with pypy, or if it is even possible at this time. Thanks in advance, Luis.

9 9

Re: [pypy-dev] Mysterious IndexError in service running with PyPy
by William ML Leslie 22 May '18

22 May '18

Where is the code that changes the size of self.heap? How do we know that size(self.heap) is constant? My guess is that some thread changes this; but l is not recomputed. On 18 Dec 2017 6:59 PM, "hubo" <hubo(a)jiedaibao.com> wrote: > I'm reporting this issue in this mail group, though I don't know if it is > related with PyPy, because it is really strange, and is not able to > reproduce stably. But I hope someone may know the reason or have some > points. > > I'm running some SDN services written in Python with PyPy 5.3.0. The > related code is here: > > https://github.com/hubo1016/vlcp/blob/8022e3a3c67cf4305af503d507640a730ca39… > > The full code is also in the repo, but may be too complex to describe. But > this related piece is quite simple: > > def _siftdown(self, pos): > temp = self.heap[pos] > l = len(self.heap) > while pos * 2 + 1 < l: > cindex = pos * 2 + 1 > pt = self.heap[cindex] > if cindex + 1 < l and self.heap[cindex+1][0] < pt[0]: > cindex = cindex + 1 > pt = self.heap[cindex] > if pt[0] < temp[0]: > self.heap[pos] = pt > self.index[pt[1]] = pos > else: > break > pos = cindex > self.heap[pos] = temp > self.index[temp[1]] = pos > It is a simple heap operation. The service uses a heap to process timers. > When the service is not busy, it usually runs this piece of code several > times per minute. > > I have 32 servers running this service. They are quite stable in about > three months, but one day one of the services crashes on line 100 reporting > IndexError: > pt = self.heap[cindex] > > As you can see, cindex = pos * 2 + 1, which is tested by the while > pre-conditon just two lines before. And there is not any multi-threading > issues here because this piece of code always runs in the same thread. So > it is not possible in theory for this to happen. > > Only the following facts are known about this issue: > > 1. It reproduces - through quite rarely. I've met this kind of > crashes 4 times, each with different machine, so it should not be related > to hardware issuess. Since I've got 32 servers, it might take more than one > year to reproduce with a single server. > 2. It seems not to be related to pressures. All of the crashes happens > at night, when there are little requests. Only some cleanup tasks are > running in fixed interval. > > The services are running with PyPy 5.3.0. I've upgraded a few of them to > 5.9, but it will take a long time to validate whether this still happens. > And It is not validated on CPython too. I'm also trying to collect more > debugging information for this issue, but it is very hard since it rarely > reproduces. > > It is not a serious issue. It could be workarounded with a auto-restart, > but I'm searching the cause. > > > 2017-12-18 > ------------------------------ > hubo > > _______________________________________________ > pypy-dev mailing list > pypy-dev(a)python.org > https://mail.python.org/mailman/listinfo/pypy-dev > >

2 3

PhD Positions in programming language runtimes (Python)
by David Bremner 02 May '18

02 May '18

1 Position I: Python on OMR =========================== The candidate will explore the benefits and challenges of using OMR [1] components (e.g. JIT, GC) in Python [2,3] runtimes. This may involve extending OMR in novel ways to better support Python, or vice-versa. If questions like how to balance fast startup time for scripting applications against good performance for compute-intensive workloads sound interesting, this might an opportunity for you. 2 Position II: Python and PGAS ============================== The candidate will implement support for parallel programming with Python, using the PGAS [4] (parallel global address space) model. The PGAS model can significantly simplify the implementation of parallel algorithms on distributed and shared memory computers. Challenges include enabling parallelism while dealing with Python's Global Interpreter Lock (GIL), and implementing distributed garbage collection efficiently. 3 Qualifications ================ Normally applicants to the Computer Science PhD program at UNB require a Master's degree in computer science or a closely related area. This project will require substantial hands-on and experimental work, and being comfortable with Python and C++. Familiarity with Linux and Open Source Software development would be a plus. For position I, exposure to programming language concepts like GC, JIT, and bytecode would be helpful. For position II, experience with parallel programming frameworks and/or languages such as MPI, OpenMP, X10 is an asset. 4 Environment ============= This project is supported by the IBM Centre for Advanced Studies (Atlantic) at the University of New Brunswick [5]. We have a lively group of students, postdocs, and research assistants working on related problems. Students work closely with both UNB researchers and technical experts from IBM, gaining valuable perspective and experience. 5 Support ========= These positions are "fully funded"; the exact funding package is subject to finalization but will be consistent with other fully funded students in Computer Science at UNB. You can find some information about expenses on the UNB web site [6]. 6 Contact ========= Send your resumé and unofficial transcripts by email to Stephen MacKay <smackay3(a)unb.ca> Please specify which position(s) you are interested in. [1]: [http://www.eclipse.org/omr/] [2]: [http://www.python.org] [3]: [http://www.pypy.org] [4]: [http://www.pgas.org/] [5]: [http://www.unb.ca/research/casatlantic/] [6]: [http://www.unb.ca/fredericton/studentservices/international/new_internation…]

1 1

help to unsubscribe
by Daniel 12 Feb '18

12 Feb '18

2018年1月14日 01:00于 pypy-dev-request(a)python.xn--org:-7z8fk634a > > Send pypy-dev mailing list submissions to > pypy-dev(a)python.org > > To subscribe or unsubscribe via the World Wide Web, visit > https://mail.python.org/mailman/listinfo/pypy-dev > or, via email, send a message with subject or body 'help' to > pypy-dev-request(a)python.org > > You can reach the person managing the list at > pypy-dev-owner(a)python.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of pypy-dev digest..." > > > Today's Topics: > > 1. Re: pypy 5.10.1 release candidates are up, please try them > out (Neal Becker) > 2. Re: pypy 5.10.1 release candidates are up, please try them > out (Neal Becker) > 3. Re: pypy 5.10.1 release candidates are up, please try them > out (Armin Rigo) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 12 Jan 2018 14:11:51 -0500 > From: Neal Becker <ndbecker2(a)gmail.com> > To: pypy-dev(a)python.org > Subject: Re: [pypy-dev] pypy 5.10.1 release candidates are up, please > try them out > Message-ID: <p3b15q$khv$1(a)blaine.gmane.org> > Content-Type: text/plain; charset="ISO-8859-1" > > Matti Picus wrote: > > > > > > > On 12/01/18 14:33, Neal Becker wrote: > >> Haven't tried pypy for some time, but just tried it on fedora 27. > >> pypy > >> pypy: error while loading shared libraries: libbz2.so.1.0: cannot open > >> shared object file: No such file or directory > >> > >> I d/l pypy3-v5.10.1-linux64.tar.bz2 and installed locally. > >> > >> _______________________________________________ > >> pypy-dev mailing list > >> pypy-dev(a)python.org > >> https://mail.python.org/mailman/listinfo/pypy-dev > > Thanks for the report. There is a libbz2 package available on rpm. > > > > On python3, the _bz2 module depends on this library. What happens when > > you do > > > > python3 -c"import _bz2; print(_bz2)" > > and then check the dependencies of the `_bz2.**.so` with ldd ? > > On Ubuntu it also depends on libbz2.so > > Matti > python3 -c"import _bz2; print(_bz2)" > <module '_bz2' from '/usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m- > x86_64-linux-gnu.so'> > > $ ldd /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so > linux-vdso.so.1 (0x00007ffdfbfaf000) > libbz2.so.1 => /lib64/libbz2.so.1 (0x00007f3ed6099000) > > > > ------------------------------ > > Message: 2 > Date: Fri, 12 Jan 2018 14:35:44 -0500 > From: Neal Becker <ndbecker2(a)gmail.com> > To: pypy-dev(a)python.org > Subject: Re: [pypy-dev] pypy 5.10.1 release candidates are up, please > try them out > Message-ID: <p3b2ik$drm$1(a)blaine.gmane.org> > Content-Type: text/plain; charset="ISO-8859-1" > > Neal Becker wrote: > > > Matti Picus wrote: > > > >> > >> > >> On 12/01/18 14:33, Neal Becker wrote: > >>> Haven't tried pypy for some time, but just tried it on fedora 27. > >>> pypy > >>> pypy: error while loading shared libraries: libbz2.so.1.0: cannot open > >>> shared object file: No such file or directory > >>> > >>> I d/l pypy3-v5.10.1-linux64.tar.bz2 and installed locally. > >>> > >>> _______________________________________________ > >>> pypy-dev mailing list > >>> pypy-dev(a)python.org > >>> https://mail.python.org/mailman/listinfo/pypy-dev > >> Thanks for the report. There is a libbz2 package available on rpm. > >> > >> On python3, the _bz2 module depends on this library. What happens when > >> you do > >> > >> python3 -c"import _bz2; print(_bz2)" > >> and then check the dependencies of the `_bz2.**.so` with ldd ? > >> On Ubuntu it also depends on libbz2.so > >> Matti > > python3 -c"import _bz2; print(_bz2)" > > <module '_bz2' from '/usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m- > > x86_64-linux-gnu.so'> > > > > $ ldd > > /usr/lib64/python3.6/lib-dynload/_bz2.cpython-36m-x86_64-linux-gnu.so > > linux-vdso.so.1 (0x00007ffdfbfaf000) libbz2.so.1 => /lib64/libbz2.so.1 > > (0x00007f3ed6099000) > locate libbz2.so > /usr/lib/libbz2.so.1 > /usr/lib/libbz2.so.1.0.6 > /usr/lib64/libbz2.so > /usr/lib64/libbz2.so.1 > /usr/lib64/libbz2.so.1.0.6 > > So Fedora has libbz2.so.1 and libbz2.so.1.0.6, but no libbz2.so.1.0. In > fact, isn't depending on libbz2.so.1.0 an error? > > > > ------------------------------ > > Message: 3 > Date: Fri, 12 Jan 2018 23:03:18 +0100 > From: Armin Rigo <armin.rigo(a)gmail.com> > To: Neal Becker <ndbecker2(a)gmail.com> > Cc: PyPy Developer Mailing List <pypy-dev(a)python.org> > Subject: Re: [pypy-dev] pypy 5.10.1 release candidates are up, please > try them out > Message-ID: > <CAMSv6X09qVmfGTKSkq1X0X-Rkf8wZMt5_dr6jhpK8qBMM_ykRw(a)mail.gmail.com> > Content-Type: text/plain; charset="UTF-8" > > Hi Neal, > > On 12 January 2018 at 20:35, Neal Becker <ndbecker2(a)gmail.com> wrote: > > So Fedora has libbz2.so.1 and libbz2.so.1.0.6, but no libbz2.so.1.0. In > > fact, isn't depending on libbz2.so.1.0 an error? > > Unless I'm mistaken, it's what we get from ``gcc -lbz2`` on Ubuntu. > If you think doing so gives a dependency that is erroneous, then the > problem is either inside gcc or Ubuntu, not PyPy. > > In general, taking a binary compiled for Linux distribution X and > trying to use it in Linux distribution Y only works if the stars are > correctly aligned. This is known and documented in > http://pypy.org/download.html#linux-binaries-and-common-distributions > > > A bient?t, > > Armin. > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > pypy-dev mailing list > pypy-dev(a)python.org > https://mail.python.org/mailman/listinfo/pypy-dev > > > ------------------------------ > > End of pypy-dev Digest, Vol 81, Issue 17 > **************************************** >

1 0

installing numpy for pypy
by Anirudh Reddy 09 Feb '18

09 Feb '18

Hello pypy dev team, I've been trying to install numpy for pypy as i need matplotlib, etc modules which need numpy and not _numpypy but I'am not able to do so. when i try it with , pypy -m pip install numpy it gives me this error pypy -m pip install numpy(ERROR).txt <https://mail.google.com/mail/u/0/?ui=2&ik=037bdf9ffc&view=att&th=1617b127bb…> when i try it with , *sudo pypy -m pip install git+https://github.com/numpy/numpy.git <https://github.com/numpy/numpy.git>* *I get ,* install git repo(ERROR).txt <https://mail.google.com/mail/u/0/?ui=2&ik=037bdf9ffc&view=att&th=1617b13ab4…> please help me

2 1

Help with PyTuple_SetItem error
by Hart, William E 06 Feb '18

06 Feb '18

The CPython differences documentation here: http://doc.pypy.org/en/latest/cpython_differences.html References the exception `SystemError('PyTuple_SetItem called on tuple after use of tuple")’ but it’s not clear when/why this exception gets triggered. I’m trying to use scipy with pypy, and the ODE integrator is raising this exception for code that works on CPython. I can’t figure out what I might change in the configuration or the ODE integrator, or whether to conclude that this is a bug in scipy’s compatibility with pypy. Thanks, --Bill

2 3

[CFP] ICOOOLPS 2018
by Tim Felgentreff 05 Feb '18

05 Feb '18

Call for Papers: ICOOOLPS'18 ============================ 13th Workshop on Implementation, Compilation, Optimization of Object- Oriented Languages, Programs and Systems Co-located with ECOOP 2018 held Mon 16 - Sun 22 July in Amsterdam, Netherlands Twitter: @ICOOOLPS URL: https://conf.researchr.org/track/ecoop-issta-2018/ICOOOLPS-2018-papers The ICOOOLPS workshop series brings together researchers and practitioners working in the field of language implementation and optimization. The goal of the workshop is to discuss emerging problems and research directions as well as new solutions to classic performance challenges. The topics of interest for the workshop include techniques for the implementation and optimization of a wide range of languages including but not limited to object-oriented ones. Furthermore, meta-compilation techniques or language-agnostic approaches are welcome, too. ### Topics of Interest A non-exclusive list of topics of interest for this workshop is: - Implementation and optimization of fundamental languages features (from automatic memory management to zero-overhead metaprogramming) - Runtime systems technology (libraries, virtual machines) - Static, adaptive, and speculative optimizations and compiler techniques - Meta-compilation techniques and language-agnostic approaches for the efficient implementation of languages - Compilers (intermediate representations, offline and online optimizations,…) - Empirical studies on language usage, benchmark design, and benchmarking methodology - Resource-sensitive systems (real-time, low power, mobile, cloud) - Studies on design choices and tradeoffs (dynamic vs. static compilation, heuristics vs. programmer input,…) - Tooling support, debuggability and observability of languages as well as their implementations ### Workshop Format and Submissions This workshop welcomes the presentation and discussion of new ideas and emerging problems that give a chance for interaction and exchange. More mature work is welcome as part of a mini-conference format, too. We aim to interleave interactive brainstorming and demonstration sessions between the formal presentations to foster an active exchange of ideas. The workshop papers will be published in ACM DL or an open archive (to be confirmed). Papers are to be submitted using the sigplanconf LaTeX template (http://www.sigplan.org/Resources/LaTeXClassFile/). Please submit contributions via EasyChair: https://easychair.org/conferences/submission_show_all.cgi?a=17114062 ### Important Dates Submissions: 18 May 2018 Author Notification: 8 June 2018 ### Program Committee The program committee consists of the organizers and the following reviewers: Nada Amin, University of Cambridge Clément Béra, RMOD - INRIA Lille Nord Europe Shigeru Chiba, University of Tokyo Benoit Daloze, JKU Linz Görel Hedin, Lund University Eric Jul, University of Oslo Stefan Marr, University of Kent Eliot Miranda, Cadence Design Systems Sarah Mount, King's College London Tobias Pape, Hasso Plattner Institute Jennifer Sartor, Vrije Universiteit Brussel + University Ghent ### Workshop Organizers Tim Felgentreff, Oracle Labs Potsdam Olivier Zendra, INRIA / LORIA

1 0

Joining the Leysin sprint
by Floris Bruynooghe 02 Feb '18

02 Feb '18

Hi, I would be interested in joining the Leysin sprint and possibly contribute to either the cffi work and/or some of the testing work. I won''t be able to attend the entire sprint however am tentatively thinking of the 1st half, so arriving on Sat 17 leaving on Wed 21 March. Is this something which is possible? I could probably be flexible as well and attend the 2nd half of the week instead, starting from Wed, if this is easier logistically. Kind Regards, Floris

2 3