Mailman 3 December 2016 - pypy-dev

About gurobipy
by Luis José Novoa 31 May '18

31 May '18

Hi All, My name is Luis Novoa. Im working on a large scale optimization problem using python/gurobipy for my implementation. I was wondering if any of you in this list has used gurobipy with pypy, or if it is even possible at this time. Thanks in advance, Luis.

9 9

Fwd: Re: Adding init/variables to W_Root
by Carl Friedrich Bolz 14 Jan '17

14 Jan '17

Oops, forgot to cc pypy-dev... Carl Friedrich -------- Original Message -------- From: Carl Friedrich Bolz <cfbolz(a)gmx.de> Sent: December 19, 2016 5:59:01 PM GMT+01:00 To: Frank Wang <frankw(a)mit.edu> Subject: Re: [pypy-dev] Adding init/variables to W_Root Hi Frank, The solution is to add an _attrs_ = ('__weakref__', 'rb_flags',) declaration to the body of W_Root. It's like __slots__, but only for RPython. Cheers, Carl Friedrich On December 19, 2016 5:42:12 PM GMT+01:00, Frank Wang <frankw(a)mit.edu> wrote: >Hi Armin, > >If I modify the line to __slots__ = ('__weakref__', 'rb_flags',), I get >the >following error: > >[translation:ERROR] AssertionError: ><pypy.interpreter.generator.GeneratorIterator object at >0x00000000073e87c8>: to run register_finalizer() untranslated, the >object >must not have __slots__ > >If I remove that line completely, I get the following error, > >[translation:ERROR] Exception: <class >'pypy.objspace.std.dictmultiobject.W_DictMultiObject'> has slots or >_attrs_, but not its base class >Processing block: > block@3 is a <class 'rpython.flowspace.flowcontext.SpamBlock'> > in (pypy.interpreter.mixedmodule:83)MixedModule.getdictvalue > containing the following operations: > v0 = getattr(space_0, ('finditem_str')) > v1 = getattr(self_0, ('w_dict')) > w_value_0 = simple_call(v0, v1, name_0) > v2 = getattr(self_0, ('lazy')) > v3 = bool(v2) > --end-- > >I wonder what error in your opinion is easier to get around. > >Thanks for the help! > >Frank > >On Mon, Dec 19, 2016 at 2:26 AM, Armin Rigo <armin.rigo(a)gmail.com> >wrote: > >> Hi Frank, >> >> On 19 December 2016 at 05:29, Frank Wang <frankw(a)mit.edu> wrote: >> > Attribute 'rb_flags' on <ClassDef 'pypy.interpreter. >> baseobjspace.W_Root'> >> > should be read-only. >> >> Ah, did you adapt or remove this line in class W_Root? >> >> __slots__ = ('__weakref__',) >> >> The annotator complains, I think, because 'rb_flags' is forbidden by >> this line (which is useful to avoid having random attributes >> accidentally move up to W_Root). >> >> >> A bientôt, >> >> Armin. >> > > >------------------------------------------------------------------------ > >_______________________________________________ >pypy-dev mailing list >pypy-dev(a)python.org >https://mail.python.org/mailman/listinfo/pypy-dev

4 10

cannot use "id" in Rpython
by Shubha Ramani 04 Jan '17

04 Jan '17

What can I use then ? I need the address of the function ? [translation:ERROR] Exception: cannot use id() in RPython; see objectmodel.compute_xxx()Processing block: block@19 is a <class 'rpython.flowspace.flowcontext.SpamBlock'> in (pypy.module._vtune.interp_vtune:28)_get_full_name containing the following operations: buf_0 = simple_call((type RStringIO)) v943 = getattr(buf_0, ('write')) v944 = getattr(pycode_0, ('co_code')) v945 = simple_call(v943, v944) v946 = getattr(buf_0, ('getsize')) size_code_0 = simple_call(v946) v947 = getattr(pycode_0, ('co_name')) id_func_0 = id(v947) v948 = getattr(pycode_0, ('co_name')) v949 = simple_call((function _safe), v948) v950 = getattr(pycode_0, ('co_firstlineno')) v951 = getattr(pycode_0, ('co_filename')) v952 = simple_call((function _safe), v951) v953 = newtuple(v949, v950, v952, size_code_0, id_func_0) v954 = mod(('vtune:%s:%d:%s:%d:%d'), v953) --end--[translation] start debugger...> /opt/shubha_vtune_pypy/rpython/annotator/unaryop.py(188)id()-> raise Exception("cannot use id() in RPython; "(Pdb+)

3 8

[translation:ERROR] AnnotatorError: when I try to pass a variable down to x86/assembler.py
by Shubha Ramani 31 Dec '16

31 Dec '16

Trying to pass a dummy variable called "shubha" to the X86 Assembler. Made the following changes to code, am getting the following errors. Please help:rpython/jit/backend/llsupport/llmodel.py class AbstractLLCPU(AbstractCPU): def __init__(self, rtyper, stats, opts, shubha, translate_support_code=Fa\ lse, gcdescr=None): self.setup(self.shubha) /rpython/jit/backend/llsupport/assembler.py class BaseAssembler(object): """ Base class for Assembler generator in real backends """ def __init__(self, cpu, shubha, translate_support_code=False): /rpython/jit/backend/x86/assembler.py class Assembler386(BaseAssembler, VectorAssemblerMixin): _regalloc = None _output_loop_log = None _second_tmp_reg = ecx DEBUG_FRAME_DEPTH = False def __init__(self, cpu, shubha, translate_support_code=False): BaseAssembler.__init__(self, cpu, shubha, translate_support_code) ..........+**%%%%%%**++++++++++++++++++++++++%[13772] translation-task} [Timer] Timings:[Timer] annotate --- 301.5 s[Timer] rtype_lltype --- 315.2 s[Timer] pyjitpl_lltype --- 177.8 s[Timer] ==========================================[Timer] Total: --- 794.5 s[translation:info] Error: File "/opt/shubha_vtune_pypy/rpython/translator/goal/translate.py", line 317, in main drv.proceed(goals) File "/opt/shubha_vtune_pypy/rpython/translator/driver.py", line 551, in proceed result = self._execute(goals, task_skip = self._maybe_skip()) File "/opt/shubha_vtune_pypy/rpython/translator/tool/taskengine.py", line 114, in _execute res = self._do(goal, taskcallable, *args, **kwds) File "/opt/shubha_vtune_pypy/rpython/translator/driver.py", line 278, in _do res = func() File "/opt/shubha_vtune_pypy/rpython/translator/driver.py", line 361, in task_pyjitpl_lltype backend_name=self.config.translation.jit_backend, inline=True) File "/opt/shubha_vtune_pypy/rpython/jit/metainterp/warmspot.py", line 64, in apply_jit warmrunnerdesc.finish() File "/opt/shubha_vtune_pypy/rpython/jit/metainterp/warmspot.py", line 281, in finish self.annhelper.finish() File "/opt/shubha_vtune_pypy/rpython/rtyper/annlowlevel.py", line 217, in finish self.finish_annotate() File "/opt/shubha_vtune_pypy/rpython/rtyper/annlowlevel.py", line 236, in finish_annotate ann.complete_helpers(self.policy) File "/opt/shubha_vtune_pypy/rpython/annotator/annrpython.py", line 116, in complete_helpers self.complete() File "/opt/shubha_vtune_pypy/rpython/annotator/annrpython.py", line 208, in complete raise annmodel.AnnotatorError(text)[translation:ERROR] AnnotatorError: Blocked block -- operation cannot succeed v3556 = getattr(self_279, ('loc_m')) In <FunctionGraph of (rpython.jit.backend.x86.regloc:251)AddressLoc.find_unused_reg at 0x18ca1da8>:Happened at file /opt/shubha_vtune_pypy/rpython/jit/backend/x86/regloc.py line 253 ==> if self.loc_m[0] == eax.value: Known variable annotations: self_279 = SomeInstance(can_be_None=False, classdef=rpython.jit.backend.x86.regloc.AddressLoc) Blocked block -- operation cannot succeed v3557 = getattr(self_280, ('loc_a')) In <FunctionGraph of (rpython.jit.backend.x86.regloc:251)AddressLoc.find_unused_reg at 0x18ca1da8>:Happened at file /opt/shubha_vtune_pypy/rpython/jit/backend/x86/regloc.py line 256 ==> if self.loc_a[0] == eax.value: Known variable annotations: self_280 = SomeInstance(can_be_None=False, classdef=rpython.jit.backend.x86.regloc.AddressLoc) Blocked block -- operation cannot succeed v3558 = getattr(self_281, ('assembler')) In <FunctionGraph of (rpython.jit.backend.x86.regalloc:160)RegAlloc._prepare at 0x87b47130>:Happened at file /opt/shubha_vtune_pypy/rpython/jit/backend/x86/regalloc.py line 163 ==> cpu = self.assembler.cpu self.fm = X86FrameManager(cpu.get_baseofs_of_frame_field()) operations = cpu.gc_ll_descr.rewrite_assembler(cpu, operations, allgcrefs) # compute longevity of variables longevity, last_real_usage = compute_vars_longevity( inputargs, operations) Known variable annotations: self_281 = SomeInstance(can_be_None=False, classdef=rpython.jit.backend.x86.regalloc.RegAlloc) Blocked block -- operation cannot succeed v3559 = getattr(self_282, ('loc_m')) In <FunctionGraph of (rpython.jit.backend.x86.regloc:248)AddressLoc.value_m at 0x9a43bb0>:Happened at file /opt/shubha_vtune_pypy/rpython/jit/backend/x86/regloc.py line 249 ==> return self.loc_m Known variable annotations: self_282 = SomeInstance(can_be_None=False, classdef=rpython.jit.backend.x86.regloc.AddressLoc) Blocked block -- operation cannot succeed v3560 = getattr(self_283, ('loc_a')) In <FunctionGraph of (rpython.jit.backend.x86.regloc:245)AddressLoc.value_a at 0x76b0bb8>:Happened at file /opt/shubha_vtune_pypy/rpython/jit/backend/x86/regloc.py line 246 ==> return self.loc_a Known variable annotations: self_283 = SomeInstance(can_be_None=False, classdef=rpython.jit.backend.x86.regloc.AddressLoc)[translation] start debugger...

1 0

AssertionError in parse_ebnf when nesting + and []
by Tim Baanen 31 Dec '16

31 Dec '16

Hi everyone, This is a copy of an issue I filed at your issue tracker, https://bitbucket.org/pypy/pypy/issues/2459/assertionerror-in-parse_ebnf- when-nesting, where I was told to report it to the mailing list. I was using the rlib.parsing module for parsing a simple language, but I ran into an AssertionError which I can't explain (from the documentation, at least). It seems to occur whenever a symbol like `+` or `*` is used inside `[]` brackets. Here is an example file: from rpython.rlib.parsing.ebnfparse import parse_ebnf > regexes, rules, ToAST = parse_ebnf(""" > test: ["foo"+] "bar"; > """) > When I run this code, both on the default branch and on the `release-pypy2.7-v5.6.0` branch, the following error occurs: test/test_parser.py:10: in <module> > """) > pypy/rpython/rlib/parsing/ebnfparse.py:57: in parse_ebnf > s.visit(visitor) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:110: in visit_file > return node.children[0].visit(self) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:114: in visit_list > child.visit(self) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:131: in visit_production > expansions = node.children[2].visit(self) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:146: in visit_body > expansion = child.visit(self) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:153: in visit_expansion > expansion = child.visit(self) > pypy/rpython/rlib/parsing/tree.py:86: in visit > return getattr(visitor, "visit_" + self.symbol)(self) > pypy/rpython/rlib/parsing/ebnfparse.py:161: in visit_enclosed > assert change == " " or change == newchange > AssertionError > Commenting out the assertion that is failing doesn't seem to cause any problems and the resulting parser has the right behavior. My current workaround is to make a new terminal symbol that behaves like `"foo"+` in the example code, which appears to work but is somewhat less readable. Did I miss something or is this an actual bug in RPython and/or its documentation? Thanks in advance! Tim

1 0

Debug build to analyze core dumps ?
by Shubha Ramani 30 Dec '16

30 Dec '16

How do I build with debug symbols (i.e. -g) so that I can inspect core dumps when you get a traceback like this ?Do you always recompile with pypy ../../rpython/bin/rpython --opt=jit ? RPython traceback: File "implement_11.c", line 5310, in fastfunc_enable_1 File "rpython_rlib_rvtune.c", line 1761, in VTune_enable File "rpython_rlib_rvtune.c", line 2205, in gather_all_code_objs_1 File "rpython_rlib_rvtune.c", line 534, in VTune__write_code_registrationFatal RPython error: AssertionErrorAborted (core dumped)

2 2

RPython Darwin platform description so_prefixes empty
by John Zhang 28 Dec '16

28 Dec '16

Hi all, I have been doing some coding using RFFI to load function pointers from shared libraries (`llexternal` function). However what bothers me is that apparently `Darwin_x86_64` platform class (defined in translator/platform/darwin.py) does not include ‘lib’ in `so_prefixes`. This is causing me some problems with not being able to find my shared libraries on macOS X. I’m wondering if that’s intentional, or just a mistake? It should be a simple fix if it’s a mistake. Regards, John Zhang ------------------------------------------------------ John Zhang Research Assistant Programming Languages, Design & Implementation Division Computer Systems Group ANU College of Engineering & Computer Science 108 North Rd The Australian National University Acton ACT 2601 john.zhang(a)anu.edu.au<mailto:john.zhang@anu.edu.au>

2 5

bitbucket enbled clonebundles
by Matti Picus 28 Dec '16

28 Dec '16

Bitbucket has enabled a feature called clonebundles which it is claimed will make "hg clone" much faster, for hg clients version 3.7 minimum. I have enabled the feature on the pypy repos on bitbucket, after erik from atlassian pointed out its existence. For reference, the toggle is on this page (admin permissions required) https://bitbucket.org/account/user/pypy/features. Since the feature is in beta, please let erik know if you notice a difference Matti

3 2

3.6?
by Armin Rigo 25 Dec '16

25 Dec '16

Hi Philip, Can we get a discussion with respect to Python 3.6? I see that you created a "py3.6" branch. However, the people funded by Mozilla (like me) are more interested in finishing a good 3.5.x version first. (I suppose it's up to discussion if we decide to go for 3.6 immediately, but I guess the answer is no.) That means we'll keep releasing 3.5 versions and won't look into 3.6 before next summer. It's unclear to me that it's worthwhile to start a parallel py3.6 branch right now, as it'll just be merging hell for the next 6 months. Well, I suppose it's your hell, so I can't complain on my own :-) Just to say, maybe your time would be better spent helping us with 3.5, instead of maintaining py3.6 when py3.5 is still fast-moving. A bientôt, Armin.

3 2

[translation:ERROR] Exception: 'no_release_gil' function can release the GIL
by Shubha Ramani 23 Dec '16

23 Dec '16

Why ? I cannot seem to open a file anywhere within assembly.py. When I use "NOT_RPYTHON"in method open_file then I cannot use it in functions like assemble_loop because it's NOT_RPYTHON. Happens when I call the following function in x86/assembly.py: def open_file(self): self.vtune_file = open('.\vtune.log', 'w') self.fixup_target_tokens(rawstart) self.materialize_done(rawstart, full_size, "loop%d" % looptoken.number) self.open_file() [translation:ERROR] Exception: 'no_release_gil' function can release the GIL: <function assemble_loop at 0x0000000070d4d2e0>[GilAnalyzer] analyze_direct_call((rpython.rtyper.lltypesystem.rffi:3)ccall_fopen__arrayPtr_arrayPtr): True[GilAnalyzer] analyze_direct_call((rpython.rtyper.lltypesystem.rffi:236)fopen__arrayPtr_arrayPtr_star_2): True[GilAnalyzer] analyze_direct_call((rpython.rlib.rfile:154)create_file): True[translation] start debugger...> /opt/vtune_pypy/rpython/translator/backendopt/gilanalysis.py(51)analyze()-> " %s\n%s" % (func, err.getvalue()))(Pdb+) print func<function assemble_loop at 0x0000000070d4d2e0>(Pdb+)

2 2