Mailman 3 October 2017 - pypy-dev

About gurobipy
by Luis José Novoa 31 May '18

31 May '18

Hi All, My name is Luis Novoa. Im working on a large scale optimization problem using python/gurobipy for my implementation. I was wondering if any of you in this list has used gurobipy with pypy, or if it is even possible at this time. Thanks in advance, Luis.

9 9

PhD Positions in programming language runtimes (Python)
by David Bremner 02 May '18

02 May '18

1 Position I: Python on OMR =========================== The candidate will explore the benefits and challenges of using OMR [1] components (e.g. JIT, GC) in Python [2,3] runtimes. This may involve extending OMR in novel ways to better support Python, or vice-versa. If questions like how to balance fast startup time for scripting applications against good performance for compute-intensive workloads sound interesting, this might an opportunity for you. 2 Position II: Python and PGAS ============================== The candidate will implement support for parallel programming with Python, using the PGAS [4] (parallel global address space) model. The PGAS model can significantly simplify the implementation of parallel algorithms on distributed and shared memory computers. Challenges include enabling parallelism while dealing with Python's Global Interpreter Lock (GIL), and implementing distributed garbage collection efficiently. 3 Qualifications ================ Normally applicants to the Computer Science PhD program at UNB require a Master's degree in computer science or a closely related area. This project will require substantial hands-on and experimental work, and being comfortable with Python and C++. Familiarity with Linux and Open Source Software development would be a plus. For position I, exposure to programming language concepts like GC, JIT, and bytecode would be helpful. For position II, experience with parallel programming frameworks and/or languages such as MPI, OpenMP, X10 is an asset. 4 Environment ============= This project is supported by the IBM Centre for Advanced Studies (Atlantic) at the University of New Brunswick [5]. We have a lively group of students, postdocs, and research assistants working on related problems. Students work closely with both UNB researchers and technical experts from IBM, gaining valuable perspective and experience. 5 Support ========= These positions are "fully funded"; the exact funding package is subject to finalization but will be consistent with other fully funded students in Computer Science at UNB. You can find some information about expenses on the UNB web site [6]. 6 Contact ========= Send your resumé and unofficial transcripts by email to Stephen MacKay <smackay3(a)unb.ca> Please specify which position(s) you are interested in. [1]: [http://www.eclipse.org/omr/] [2]: [http://www.python.org] [3]: [http://www.pypy.org] [4]: [http://www.pgas.org/] [5]: [http://www.unb.ca/research/casatlantic/] [6]: [http://www.unb.ca/fredericton/studentservices/international/new_internation…]

1 1

Delimited Continuations in PyPy?
by Timothy Baldridge 15 Dec '17

15 Dec '17

I recently came across this paper: https://www.microsoft.com/en-us/research/publication/implementing-algebraic… The gist is that they use setjmp/longjmp to create delimited continuations in compliant C99. It seems like this method is fairly close to what PyPy already does with stacklets. Any reason why this couldn't be ported to PyPy? Of course there'd have to be some sort of stack integration as with stacklets, but it seems that that mostly boils down to making sure the GC has a way to trace the bits of the stack contained in the continuations. I'm considering trying my hand at using their library via rffi, and copying what I need from _stacklet_shadowstack.py. But perhaps there's something I'm missing that makes this a no-go from the start. Thanks, Timothy Baldridge

3 3

Leysin Winter sprint
by Armin Rigo 04 Nov '17

04 Nov '17

Hi all, I'm trying to organise the next winter sprint a bit in advance. It might tentatively be occurring in March 2018. If people have preferences for the exact week, please do tell :-) A bientôt, Armin.

4 4

Enhancing the package.py script to download and build dependencies
by Matti Picus 28 Oct '17

28 Oct '17

danchr has submitted a pull request that enables our cffi build step (executed twice - once during tranlation and once during packaging) to download external dependencies. This is needed for MacOSX where the versions of OpenSSL, lzma, and _gdbm are not current or missing for pypy3. Since it is a departure from current practice, I would like to solicit a wider base of opinions before committing. The pull request can be seen here https://bitbucket.org/pypy/pypy/pull-requests/571/support-for-embedding-pyp… and the builds produced are here http://buildbot.pypy.org/nightly/py3.5-mac-embedding Any thoughts? Matti

1 0

Enhancing the package.py script to download and build dependencies
by Matti Picus 28 Oct '17

28 Oct '17

1 0

fiber support
by David Callahan 18 Oct '17

18 Oct '17

folly:fibers (https://github.com/facebook/folly/tree/master/folly/fibers ) is a C++ package for lightweight, cooperatively scheduled threads. We have an application which extends this to CPython by adding the following save/restore code around task function invocation: auto tstate = PyThreadState_Get(); CHECK_NOTNULL(tstate); auto savedFrame = tstate->frame; auto savedExcType = tstate->exc_type; auto savedExcValue = tstate->exc_value; auto savedExcTraceback = tstate->exc_traceback; func(); tstate->frame = savedFrame; tstate->exc_type = savedExcType; tstate->exc_value = savedExcValue; tstate->exc_traceback = savedExcTraceback; (here func is a boost::python::object) This does not work in PyPy 5.9 immediately because the thread state object does not expose these fields nor are there accessor methods. Is there a way to get similar effect in PyPy? Thanks david

3 4

New django-hotsauce development group
by Etienne Robillard 16 Oct '17

16 Oct '17

Hi, I'm pleased to announce the availability of a new public discussion group for Django-hotsauce: https://groups.google.com/forum/#!forum/django-hotsauce Talented CPython and PyPy developers are invited to join and meet the django-hotsauce community. Best regards, Etienne -- Etienne Robillard tkadm30(a)yandex.com http://www.isotopesoftware.ca/

1 0

AttributeError: 'built in-code' object has no attribute 'co_code'
by Etienne Robillard 13 Oct '17

13 Oct '17

Hi, I'm trying to port django-hotsauce to PyPy. I'm getting an exception when I use Cython compiled under CPython: DEBUG:Traceback (most recent call last): File "lib/notmm/controllers/wsgi.pyx", line 206, in notmm.controllers.wsgi.BaseController.get_response (lib/notmm/controllers/wsgi.c:4174) File "/home/erob/src/django-hotsauce-pypy/lib/notmm/utils/django_compat.py", line 230, in resolve sub_match = pattern.resolve(new_path) File "/home/erob/src/django-hotsauce-pypy/lib/notmm/utils/django_compat.py", line 155, in resolve return (self.callback, args, kwargs) File "/home/erob/src/django-hotsauce-pypy/lib/notmm/utils/django_compat.py", line 166, in _get_callback raise ViewDoesNotExist, "Tried %s in module %s. Error was: %s" % (func_name, mod_name, str(e)) ViewDoesNotExist: Tried index in module mainapp.research.views. Error was: 'builtin-code' object has no attribute 'co_code' Traceback (most recent call last): File "/usr/lib/pypy/lib-python/2.7/wsgiref/handlers.py", line 85, in run self.result = application(self.environ, self.start_response) File "/usr/lib/pypy/lib-python/2.7/wsgiref/validate.py", line 176, in lint_app iterator = application(environ, start_response_wrapper) File "/home/erob/src/django-hotsauce-oauthclient/lib/wsgi_oauth2/middleware.py", line 292, in __call__ return self.application(environ, start_response) File "lib/notmm/controllers/wsgi.pyx", line 136, in notmm.controllers.wsgi.BaseController.__call__ (lib/notmm/controllers/wsgi.c:2842) File "lib/notmm/controllers/wsgi.pyx", line 151, in notmm.controllers.wsgi.BaseController.application (lib/notmm/controllers/wsgi.c:3177) AttributeError: 'builtin-code' object has no attribute 'co_code' 127.0.0.1 - - [12/Oct/2017 16:37:03] "GET / HTTP/1.1" 500 59 In wsgi.pyx: with sessionmanager(environ): request.environ.update(environ) #assert request.environ['PATH_INFO'] == request.path_url response = self.get_response(request=request) return response(environ, start_response) Any ideas why using a @contextmanager here yield this exception with PyPy 5.6.0 and Cython 0.25.2 ? Thank you in advance, Etienne

3 9

A small bug in cppyy's setup.py
by Shaheed Haque 11 Oct '17

11 Oct '17

Hi, In cppyy 0.3.1, there is a bug in setup.py for systems where pypy is not detected. I believe an incomplete patch is: ========== $ diff -U5 setup.py.original setup.py --- setup.py.original 2017-10-11 11:36:54.632924969 +0100 +++ setup.py 2017-10-11 11:38:08.732492901 +0100 @@ -18,10 +18,11 @@ else: requirements = ['cppyy-backend'] add_pkg = ['cppyy'] except ImportError: requirements = ['CPyCppyy'] + add_pkg = [] setup( name='cppyy', version='0.3.1', ========== Without this assignment to define add_pkg, the reference to "add_pkg" fails in the setup() call. I describe the patch as incomplete because I'm not sure what the array should contain. I do see that the relevant direction contains both a "cppyy" and a "cppyy_compat" directory. Any clarification welcomed. Thanks, Shaheed P.S. If a bug report, or a PR is preferred, please advise.

2 1