Mailman 3 June 2018 - pypy-dev

[PATCH] FreeBSD build fix
by David CARLIER 18 Jul '18

18 Jul '18

Here a new version of the patch. Kind regards.

2 1

Translating of FreeBSD fails for v6.0.0
by David Naylor 01 Jul '18

01 Jul '18

Hi When trying to translate the latest version of PyPy on FreeBSD I get the following error: [translation:info] Error: File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/goal/translate.py", line 318, in main drv.proceed(goals) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 554, in proceed result = self._execute(goals, task_skip = self._maybe_skip()) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/tool/taskengine.py", line 114, in _execute res = self._do(goal, taskcallable, *args, **kwds) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 278, in _do res = func() File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/translator/driver.py", line 315, in task_annotate s = annotator.build_types(self.entry_point, self.inputtypes) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 92, in build_types return self.build_graph_types(flowgraph, inputs_s, complete_now=complete_now) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 140, in build_graph_types self.complete() File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 229, in complete self.complete_pending_blocks() File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 224, in complete_pending_blocks self.processblock(graph, block) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 398, in processblock self.flowin(graph, block) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 501, in flowin self.consider_op(op) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/annrpython.py", line 653, in consider_op resultcell = op.consider(self) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/flowspace/operation.py", line 104, in consider return spec(annotator, *self.args) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/unaryop.py", line 118, in simple_call_SomeObject return s_func.call(argspec) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/unaryop.py", line 978, in call return bookkeeper.pbc_call(self, args) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/bookkeeper.py", line 535, in pbc_call results.append(desc.pycall(whence, args, s_previous_result, op)) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/description.py", line 398, in pycall s_result = self.specialize(inputcells, op) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/description.py", line 281, in specialize return self.specializer(self, inputcells) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/specialize.py", line 303, in memo _, _, memotable = memotables.find(firstvalues) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/tool/algo/unionfind.py", line 48, in find info = self.info_factory(obj) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/annotator/specialize.py", line 293, in compute_one_result value = func(*args) File "/home/dbn/ports/ports/lang/pypy/work/pypy2-v6.0.0-src/rpython/rlib/rarithmetic.py", line 154, in _should_widen_type r_class = rffi.platform.numbertype_to_rclass[tp] [translation:ERROR] KeyError: <Void> Processing block: block@28[n_1] is a <class 'rpython.flowspace.flowcontext.SpamBlock'> in (rpython.rlib.rarithmetic:139)widen__NoneType containing the following operations: v630 = simple_call((function typeOf), n_1) v631 = simple_call((function _should_widen_type), v630) v632 = bool(v631) --end-- My best guess is a call to `widen` with a None value is being specialized. But, how does one see more information about the translation back trace (i.e. the context of the specialization of `widen`)? Any, any idea why this is triggering on FreeBSD? Regards

2 1

Memory leaking with iterator.close() in PyPy3
by hubo 28 Jun '18

28 Jun '18

In PyPy3, when an iterator is closed with "close()" method, the iterator leaks and cannot be collected. Execute the following script in PyPy3, the memory usage is increasing very fast, and gc.collect() cannot collect the memory def test(): yield 1 while True: t = test() t.close() The tested version: Python 3.5.3 (fdd60ed87e94, Apr 24 2018, 06:10:04) [PyPy 6.0.0 with GCC 6.2.0 20160901] This is not reproduced in CPython 3.5 and PyPy2. 2018-06-28 hubo

3 4

A quick question for you!
by Etienne Robillard 19 Jun '18

19 Jun '18

Hi, Quick question: Does anyone of you know what is the effect of enabling gc.enable() in sitecustomize.py when using PyPy? Can it reduce latency for long-lived WSGI applications? Thanks, Etienne -- Etienne Robillard tkadm30(a)yandex.com https://www.isotopesoftware.ca/

2 2

state of pypy 3.6 support
by Carl Friedrich Bolz-Tereick 17 Jun '18

17 Jun '18

Hi all, Matti asked in an issue what the state of PyPy 3.6 support is, and whether we're close to an alpha: https://bitbucket.org/pypy/pypy/issues/2849/syntax-bug-for-keyword-only-arg… Since that's a strange place to have this discussion, I thought I'd move it here. Armin replied: "what I fear is that we didn't start seriously on the infinite list of small new things in 3.6. If that's true, then not close at all. It makes me wonder if we shouldn't do a "3.(5+1/2)" where we take the few major new things from 3.6 (which are already implemented in the 3.6 branch as far as I can tell) and release that. I guess they're all syntax tricks so they could all be backported without trouble." I am not quite so pessimistic. I agree that we implemented most of the big visible features and also I agree that there are quite a few details left. However, I think if a few people pushed for a couple for days, we could end up in a pretty decent state. I tried to classify the remaining problems here: https://bitbucket.org/pypy/pypy/wiki/Status%20of%20PyPy3%20support%20for%20… I will try to slowly chip away at some of these, but given my still limited time to work right now I'd need some help. Maybe we should have a dedicated "finish 3.6 virtual sprint" or something? What do others think? Cheers, Carl Friedrich

2 1

[CFP] Workshop on Virtual Machines and Language Implementations (VMIL’18)
by William ML Leslie 14 Jun '18

14 Jun '18

Stefan Marr had sent this on some JVM lists; but it's super relevant for those of us doing research on or with pypy, too. ======================================================================== Call for Papers Workshop on Virtual Machines and Language Implementations (VMIL’18) Co-located with SPLASH 2018 November 4, 2018, Boston, USA https://2018.splashcon.org/track/vmil-2018 Follow us on twitter @vmil18 ======================================================================== The concept of virtual machines is pervasive in the design and implementation of programming systems. Virtual machines and the languages they implement are crucial in the specification, implementation and/or user-facing deployment of most programming technologies. The VMIL workshop is a forum for researchers and cutting-edge practitioners in language virtual machines, the intermediate languages they use, and related issues. The workshop is intended to be welcoming to a wide range of topics and perspectives, covering all areas relevant to the workshop’s theme. Aspects of interest include, but are not limited to: - design issues in VMs and IRs (e.g. IR design, VM modularity, polyglotism) - compilation (static and dynamic compilation strategies, optimizations, data representations) - memory management - concurrency (both internal and user-facing) - tool support and related infrastructure (profiling, debugging, liveness, persistence) - the experience of VM development (use of high-level languages, bootstrapping and self-hosting, reusability, portability, developer tooling, etc) - empirical studies on related topics, such as usage patterns, the usability of languages or tools, experimental methodology, or benchmark design #### Submission Guidelines We invite high-quality papers in the following two categories: Research and experience papers: These submissions should describe work that advances the current state of the art in the above or related areas. The suggested length of these submissions is 6-10 pages (maximum 10pp). Work-in-progress or position papers: These papers should document ongoing efforts in an area of interest which have not yet yielded final results, and/or should present and defend the authors' position on a topic related to the broad area of the workshop. The suggested length of these submissions is 4-6 pages (maximum 6pp). For the first submission deadline, all paper types are considered for publication in the ACM Digital Library, except if the authors prefer not to be included. Publication of work-in-progress and position papers at VMIL is not intended to preclude later publication elsewhere. Submissions will be judged on novelty, clarity, timeliness, relevance, and potential to stimulate discussion during the workshop. For the second deadline, we will consider only work-in-progress and position papers. These will not be published in the ACM DL, and will only appear on the web site. The address of the submission site is: https://vmil18.hotcrp.com/ #### Important Dates All deadlines are Anywhere on Earth (AoE), i.e. GMT/UTC−12:00 hour Abstract Submission 07 August 2018 Paper Submission 17 August 2018 Paper Notification 14 September 2018 ACM Camera Ready Deadline 28 September 2018 “Late submission” deadline 07 September 2018 (WIP/position papers only) “Late submission” notification 30 September 2018 Workshop Date 04 November 2018 #### Format Instructions Please use the SIGPLAN acmart style for all papers: http://www.sigplan.org/Resources/Author/. The provided double-column template is available for Latex and Word. #### Program Committee Stephen Kell, University of Cambridge Stefan Marr, University of Kent Leif Andersen, Northeastern University Steve Blackburn, Australian National University Stephen Dolan, University of Cambridge Apala Guha, Simon Fraser University Christine H. Flood, Red Hat Roberto Ierusalimschy, PUC-Rio Tomas Kalibera, Czech Technical University Christos Kotselidis, The University of Manchester Doug Lea, State University of New York (SUNY) Oswego Sanhong Li, Alibaba Inc. Mark Marron, Microsoft Research Erez Petrank, Technion Julien Ponge, INSA Lyon, CITI Laboratory / Red Hat Richard Roberts, Victoria University of Wellington Jeremy Singer, University of Glasgow Sam Tobin-Hochstadt, Indiana University -- Stefan Marr School of Computing, University of Kent http://stefan-marr.de/research/ _______________________________________________ mlvm-dev mailing list mlvm-dev(a)openjdk.java.net http://mail.openjdk.java.net/mailman/listinfo/mlvm-dev -- William Leslie Notice: Likely much of this email is, by the nature of copyright, covered under copyright law. You absolutely MAY reproduce any part of it in accordance with the copyright law of the nation you are reading this in. Any attempt to DENY YOU THOSE RIGHTS would be illegal without prior contractual agreement.

1 0

Can you please help?
by Frankie Chan 12 Jun '18

12 Jun '18

Dear sir/ madam, This is Frankie from Hong Kong. I am interested in Pypy for its high-speed processing. I am now using Python 3.6. I would like to install Pypy to my 64-bit Windows 10. First, I downloaded the zip file from - Windows binary (32bit) <https://bitbucket.org/pypy/pypy/downloads/pypy3-v6.0.0-win32.zip> *BETA* Second, I downloaded and installed Build Tools for Visual Studio 2017 and Team Explorer. Then, I ran: "C:\Program Files (x86)\Microsoft Visual Studio\2017\Community\VC\Auxiliary\Build\vcvars64.bat" editbin /largeaddressaware "C:\Program Files\Python36\pypy3-v6.0.0-win32\pypy3.exe" So far so good. Then, I typed: "C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe" numpy "C:\Program Files\Python36\pypy3-v6.0.0-win32\bin\easy_install-3.5.exe" pandas In both cases, an error appeared: SystemError: Cannot compile 'Python.h'. Perhaps you need to install pypy-dev|pypy-devel. Can you please help? Thank you very much. Regards, Frankie

2 1

https pypy.org has got an invalid certificate now
by Armin Rigo 08 Jun '18

08 Jun '18

Hi, Who knows how to fix this? https://pypy.org/ complains that it has got an invalid certificate. Armin

6 7

Adding support for PEP526: variable annotations
by Tin Tvrtković 08 Jun '18

08 Jun '18

Hi, it'd be great if we could get variable annotations in PyPy even before PyPy 3.6 comes out. There's predecent with f-strings. I'm asking because it's a major chore to strip out variable annotations while trying out PyPy, (mostly) everything else can be worked around with imports etc. Thanks for your efforts on PyPy ;) Tin

2 2

Django-hotsauce/ZODB 5.4.0/PyPy nightly sprint!!
by Etienne Robillard 08 Jun '18

08 Jun '18

Yo people I'm doing a nightly hacking sprint for django-hotsauce on pypy and got some cool bugs I would like to share: Traceback (most recent call last): File "/usr/local/bin/schevo", line 11, in <module> load_entry_point('libschevo', 'console_scripts', 'schevo')() File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 32, in __call__ return self.main(arg0, args) File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 74, in main return command()(*args) File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 32, in __call__ return self.main(arg0, args) File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 74, in main return command()(*args) File "/home/erob/src/libschevo/lib/schevo/script/command.py", line 32, in __call__ return self.main(arg0, args) File "/home/erob/src/libschevo/lib/schevo/script/db_evolve.py", line 86, in main db = schevo.database.open(url) File "/home/erob/src/libschevo/lib/schevo/database.py", line 371, in open db = Database(backend) File "/home/erob/src/libschevo/lib/schevo/database2.py", line 95, in __init__ self._update_extent_maps_by_name() File "/home/erob/src/libschevo/lib/schevo/database2.py", line 1633, in _update_extent_maps_by_name for extent in self._extent_maps_by_id.itervalues(): File "/usr/local/lib/python2.7/dist-packages/ZODB/Connection.py", line 791, in setstate p, serial = self._storage.load(oid) File "/usr/local/lib/python2.7/dist-packages/ZODB/mvccadapter.py", line 143, in load r = self._storage.loadBefore(oid, self._start) File "/home/erob/work/ZEO-5.1.0/src/ZEO/ClientStorage.py", line 520, in loadBefore return self._server.load_before(oid, tid) File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 783, in load_before return self.__call(self.client.load_before_threadsafe, oid, tid) File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 748, in call return self.wait_for_result(result, self.timeout) File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/client.py", line 756, in wait_for_result return future.result(timeout) File "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py", line 405, in result return self.__get_result() File "/usr/local/lib/python2.7/dist-packages/futures-3.0.5-py2.7.egg/concurrent/futures/_base.py", line 357, in __get_result raise type(self._exception), self._exception, self._traceback ZEO.Exceptions.ClientDisconnected: connection lost erob@marina:/home/www/isotopesoftware.ca/trunk$ Not sure about this first one! :) The command I'm trying to run is: % schevo db evolve --app blogengine2 zodb://127.0.0.1:4545 31 The ZODB 5.4.0 server then produce the following traceback: 2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol ------ 2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5' ------ 2018-06-07T21:14:55 ERROR ZEO.asyncio.marshal can't decode message: '((ccopy_reg\n_reconstructor\n(czodbpickle\nbinary\nc__b...' ------ 2018-06-07T21:14:55 ERROR ZEO.asyncio.server Can't deserialize message Traceback (most recent call last): File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 89, in message_received message_id, async, name, args = self.decode(message) File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line 114, in pickle_server_decode return unpickler.load() # msgid, flags, name, args File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/marshal.py", line 164, in server_find_global raise ImportError("import error %s: %s" % (module, msg)) ImportError: import error copy_reg: ------ 2018-06-07T21:14:55 ERROR ZEO.asyncio.base data_received 4 0 True Traceback (most recent call last): File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/base.py", line 128, in data_received self.message_received(collected) File "/home/erob/work/ZEO-5.1.0/src/ZEO/asyncio/server.py", line 94, in message_received if message_id == -1: UnboundLocalError: local variable 'message_id' referenced before assignment ------ 2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected ------ 2018-06-07T21:14:55 INFO ZEO.asyncio.base Connected server protocol ------ 2018-06-07T21:14:55 INFO ZEO.asyncio.server received handshake 'Z5' ------ 2018-06-07T21:14:55 INFO ZEO.StorageServer (127.0.0.1:4545) disconnected Please hit me up if you know how to fix theses errors! :) I'm using PyPy 5.9 and 5.10 for dev and Python 2.7.13 for production with Cython bindings! Cheers, Etienne

2 3