Mailman 3 September 2005 - pypy-dev

bug in http://codespeak.net/moin/pypy/moin.cgi/FrontPage?action=show
by Laura Creighton 10 Oct '05

10 Oct '05

If you click on the 'documentation' link you get a traceback! ooops. I will look at this later unless somebody beats me to it. Laura

5 4

next pypy-sync meeting 20050915
by Christian Tismer 04 Oct '05

04 Oct '05

Hi all, Next #pypy-sync meeting on freenode.net is tomorrow Thursday at 1pm as usual. Regular topics -------------- * activity reports (3 prepared lines of info) * resolve conflicts/blockers Here is my draft proposal of Topics of the week ------------------ A quick point about IRC logging I (Chris) have set up an eggdrop server on tismerysoft.de. This server logs #pypy, #pypy-funding (password), #pypy-sync, #pypy-tb. Let me know tomorrow if it should log something else. To make this service more reliable, I would like to add a second server. I could use another one of mine, but this makes no sense in using the same network. I'd like to ask which other server to use, maybe codespeak, maybe Armin's new server. Anyway, I'd like to take responsibility and the rights to set that up, since I did it before. Participation on the CCC congress in Berlin There is a CCC congress in Berlin 2005–12–27 to 2005–12–30. See http://wiki.chaostreff.ch/index.php/Main_Page They told us on IRC that they are interested in talks from us. This appeared to me to be quite unspecific, they seem to be interested in scientific talks. For PyPy, I anyway thing that it would be good not to emphasize too much on Python itself, but the general aspectsof translation which are possible to tackle with out framework. Se also Armin's draft in pypy/doc. We should collect who wants to give a talk or just attend this congress. We also might talk about how we manage claims about giving a talk. Practice has been to say it somewhere at some time often enough, but I'm not sure if this is a pleasant strategy for everybody to continue with. I would like to ask people who would like to attend in any way to inform me early, because I probably can provide help in finding locals who can share a room. Current optimization activities and allocation of work There are currently several ongoings on optimization, where I can't remember that they were assigned officially in any way. Practice seems to be to justpick an issue which has a good chance to provide a 200 % speedup and then go for it. I am personally not really happy with this and would like to ask about opinions. My proposal is to have a more informal way to decide about activities, by issuing a short IRC meeting and giving everybody a chance to ask for participation. We should also be open to discuss reasons for an individual's rejection. This might be painful, but setting facts by just doing things is a worse practice IMHO. Other activities, follow-up on sync meeting of last week As a conclusion from last week's meeting, docs and reports appear to reduce to a meeting of Holger, Carl, Samuele and Armin one day before the Paris sprint. I would like to ask again, if this was meant this way. There is quite some time left until Paris. Can we talk again about what we want to work on in the meantime, if it is not just optimization? -- The next topic is related, maybe this is a merger. Making money out of PyPy Jacob asked me on the last sprint, if it is possible to make money out of PyPy right now. I passed this around once, but would like to insist. I am personally interested to make PyPy move away a bit from its purely academical status and to think a little bit about how we can create practical applications in the near future, which allow to grow marketable services for our members, in order to reduce PyPy's dependency from the EU sponsoring. Please propose additions and changes, I just listed what immediately came to my mind. I'm also happy if you say some topics are too big and should be moved to another meeting. See you tomorrow at 1 pm. sincerely -- chris -- Christian Tismer :^) <mailto:tismer@stackless.com> tismerysoft GmbH : Have a break! Take a ride on Python's Johannes-Niemeyer-Weg 9A : *Starship* http://starship.python.net/ 14109 Berlin : PGP key -> http://wwwkeys.pgp.net/ work +49 30 802 86 56 mobile +49 173 24 18 776 fax +49 30 80 90 57 05 PGP 0x57F3BF04 9064 F4E1 D754 C2FF 1619 305B C09C 5A3B 57F3 BF04 whom do you want to sponsor today? http://www.stackless.com/

18 31

Trying pypy on Windows
by Amaury Forgeot D Arc 03 Oct '05

03 Oct '05

Hello, I am trying the translated pypy-c on Windows (Win2K, MSVC6, python2.3.3), and I can't make it execute anything. Here is a typical session: ========================================================== C:\dev\pypy\dist-pypy\pypy\translator\goal>pypy-c.exe debug: entry point starting debug: argv -> pypy-c.exe debug: importing code debug: calling code.interact() Python 2.4.1 (pypy 0.7.1 build) on win32 Type "help", "copyright", "credits" or "license" for more information. (InteractiveConsole) >>>> 1+1 ^Z File "<console>", line 1 ^ SyntaxError: Unknown character >>>> ^Z C:\dev\pypy\dist-pypy\pypy\translator\goal> ========================================================== (I typed ^Z twice) Oviously a parser/compiler problem. But bin/py.py works correctly. Is it a known issue? Does it occur on other platforms? And: Where do I start if I want to work out the problem? -- Amaury Forgeot d'Arc Ubix Development www.ubitrade.com

3 2

Project suggestions
by Boria Feigin 02 Oct '05

02 Oct '05

Hi, All I am an undergraduate student (at a top-5 CS university in the UK) looking for a fun final-year project to sink my teeth into. Over the last couple of months, I became quite interested in programming languages, interpreters, virtual machines, and so on. I found out about PyPy at Holger Krekel's talks at 21C3 in December and now it seems like an ideal way to do all of these things! Can anyone suggest pointers to areas of PyPy that need work? Or, better yet, ideas that need further development -- research in literature, prototyping, and implementation? Thanks for your time. Please CC me -- I am not on the list. -- Boris

9 29

Problem with current ReST snapshot
by Christian Tismer 01 Oct '05

01 Oct '05

Hi Holger, while struggling with templates and OOo, I encountered a problem when I tried toswitch to the recent docutils snapshot. There seems to be some problem with mutually exclusive parameters. I tried to track this down by reading the py library, but I have to admit that I could not find the source of the problem in reasonable time, because the related py modules have small or no documentation how they gather their configuration and how they process the input. def get_stylesheet_reference(settings, relative_to=None): """ Retrieve a stylesheet reference from the settings object. """ if settings.stylesheet_path: assert not settings.stylesheet, \ E 'stylesheet and stylesheet_path are mutually exclusive.' > AssertionError: stylesheet and stylesheet_path are mutually e xclusive. [D:\Python23\Lib\site-packages\docutils\utils.py:433] _______________________________________________________________________________ ====== tests finished: 212 passed, 9 failed, 14 skipped in 3.31 seconds ======= I hope this makes some sense for you. cheers -- chris -- Christian Tismer :^) <mailto:tismer@stackless.com> tismerysoft GmbH : Have a break! Take a ride on Python's Johannes-Niemeyer-Weg 9A : *Starship* http://starship.python.net/ 14109 Berlin : PGP key -> http://wwwkeys.pgp.net/ work +49 30 802 86 56 mobile +49 173 24 18 776 fax +49 30 80 90 57 05 PGP 0x57F3BF04 9064 F4E1 D754 C2FF 1619 305B C09C 5A3B 57F3 BF04 whom do you want to sponsor today? http://www.stackless.com/

2 2

Unsuccesfull in translating the interpeter
by Elmo Mäntynen 01 Oct '05

01 Oct '05

I'm using the latest code from the svn. Here's the last bits of the output given: " [getflowgraph] (pypy.interpreter.pyopcode:72) getlocalvarname [getflowgraph] (pypy.module.recparser.pyparser:39) visit_tempsyntaxnode [getflowgraph] (pypy.interpreter.executioncontext:55) return_trace [getflowgraph] (pypy.module._sre.interp_sre:119) marks_pop_keep [annrpython:WARNING] (pypy.interpreter.nestedscope:139)PyNestedScopeFrame.LOAD_DEREF block@49 op=2/ demoting method iscellvar to base class <ClassDef 'pypy.interpreter.pyopcode.PyInterpFrame'> [getflowgraph] (pypy.interpreter.nestedscope:127) iscellvar [getflowgraph] (pypy.interpreter.pyopcode:78) getname_u [getflowgraph] (pypy.interpreter.pyframe:414) cleanup [getflowgraph] (pypy.interpreter.pyframe:360) cleanup [getflowgraph] (pypy.interpreter.pyframe:356) cleanupstack [getflowgraph] (pypy.interpreter.pyframe:373) unroll [getflowgraph] (pypy.interpreter.pyframe:364) unroll [getflowgraph] (pypy.interpreter.pyframe:425) unroll [getflowgraph] (pypy.interpreter.pyframe:392) unroll [getflowgraph] (pypy._cache.pyopcode_a0dbad8943e839e68a3f255215d51bda:63) prepare_exec [getflowgraph] (pypy.module._sre.interp_sre:116) marks_pop [getflowgraph] (pypy.objspace.std.longobject:1689) _get_odd [getflowgraph] (pypy._cache.pyopcode_a0dbad8943e839e68a3f255215d51bda:75) prepare_exec [getflowgraph] (pypy.interpreter.baseobjspace:387) getslice LOOKUP_IN_TYPE_WHERE __rxor__ def lookup_in_type_where___rxor__(space, w_type, name): if not w_type.is_heaptype(): return w_type.cached_where___rxor__ return w_type.lookup_where("__rxor__") [getflowgraph] (?:2) lookup_in_type_where___rxor__ [getflowgraph] (pypy.objspace.std.objspace:471) old_slice_range LOOKUP_IN_TYPE_WHERE __rtruediv__ def lookup_in_type_where___rtruediv__(space, w_type, name): if not w_type.is_heaptype(): return w_type.cached_where___rtruediv__ return w_type.lookup_where("__rtruediv__") [getflowgraph] (?:2) lookup_in_type_where___rtruediv__ [getflowgraph] (pypy.interpreter.baseobjspace:393) delslice [getflowgraph] (pypy._cache.pyopcode_7bd3d4004169eb9bb1af14a0d618572c:39) find_metaclass [getflowgraph] (pypy._cache.pyopcode_6423a0aed865d772ac222358cb6d34d1:43) import_all_from [getflowgraph] (pypy.module.__builtin__.importing:388) _w_long [getflowgraph] (pypy._cache.pyopcode_7bd3d4004169eb9bb1af14a0d618572c:48) find_metaclass [getflowgraph] (pypy._cache.pyopcode_6423a0aed865d772ac222358cb6d34d1:52) import_all_from [getflowgraph] (pypy.lib._osfilewrapper:23) write [getflowgraph] (pypy.interpreter.baseobjspace:390) setslice [getflowgraph] (pypy.objspace.descroperation:82) get_and_call_function__6 [getflowgraph] (pypy.objspace.std.listsort:119) gallop__False [getflowgraph] (pypy.lib._osfilewrapper:30) seek [getflowgraph] (pypy.objspace.std.listsort:223) merge_lo [getflowgraph] (pypy.objspace.std.listsort:326) merge_hi [getflowgraph] (pypy.objspace.std.listsort:560) copyitems [getflowgraph] (pypy.objspace.std.listsort:571) popleft [getflowgraph] (pypy.objspace.std.listsort:577) popright Traceback (most recent call last): File "translate_pypy.py", line 803, in ? analyse(targetspec_dic['target']) File "translate_pypy.py", line 145, in analyse a = t.annotate(inputtypes, policy=policy) File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/translator.py", line 132, in annotate self.annotator.build_types(graph, input_args_types, func) File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/annrpython.py", line 108, in build_types self.complete() File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/annrpython.py", line 194, in complete raise AnnotatorError('%d blocks are still blocked' % AnnotatorError: 1 blocks are still blocked > /home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/annrpython.py(194)complete() -> raise AnnotatorError('%d blocks are still blocked' % (Pdb)" Elmo

1 0

Correction for the annotation process
by Amaury Forgeot D Arc 01 Oct '05

01 Oct '05

Hello, Here is my patch to let the translation go to the end. For the first chunk, it's not really a correction, but I don't know how to code this for the tuplebuilder... C:\dev\pypy\dist-pypy\pypy\interpreter>svn diff Index: pyparser/pythonparse.py =================================================================== --- pyparser/pythonparse.py (revision 17980) +++ pyparser/pythonparse.py (working copy) @@ -34,8 +34,8 @@ enc = 'utf-8' else: enc = _normalize_encoding(_check_for_encoding(textsrc)) - if enc is not None and enc not in ('utf-8', 'iso-8859-1'): - textsrc = recode_to_utf8(builder.space, textsrc, enc) + #if enc is not None and enc not in ('utf-8', 'iso-8859-1'): + # textsrc = recode_to_utf8(builder.space, textsrc, enc) lines = [line + '\n' for line in textsrc.split('\n')] builder.source_encoding = enc @@ -89,11 +89,14 @@ eol = s.find('\n') if eol == -1: return _check_line_for_encoding(s) + assert eol >= 0 enc = _check_line_for_encoding(s[:eol]) - eol2 = s.find('\n', eol + 1) + eol = eol + 1 + eol2 = s.find('\n', eol) if eol2 == -1: - return _check_line_for_encoding(s[eol + 1:]) - return _check_line_for_encoding(s[eol + 1:eol2]) + return _check_line_for_encoding(s[eol:]) + assert eol2 >= 0 + return _check_line_for_encoding(s[eol:eol2]) def _check_line_for_encoding(line): """returns the declared encoding or None""" -- Amaury Forgeot d'Arc Ubix Development www.ubitrade.com

1 0

about forking in taskengine
by Eric van Riet Paap 30 Sep '05

30 Sep '05

hello Samuele, I have been reading your taskengine code with great interest. I was wondering what your plans with regards to forking are. Would it be possible to extend the option so we can specify after which task to fork, instead of having some fixed points as we had before? What would be of great help (to me at least) is if multiple goals could be specified (lets say: generate pypy-c and pypy-llvm). The program could then be smart enough to fork just before the tasklists differ. With the current translate_pypy there is no way to do this. An additional nicety would be if we could have an option where we specify how many of these task to run in parallel (like 'make -j X') . I do realize some things at the moment will not run nicely in parallel (compiling the same file with different compiler options for instance), but that is another problem. cheers Eric

2 1

Re: URGENT: pypy rest template
by Christian Tismer 30 Sep '05

30 Sep '05

Beatrice During wrote: referring to your email > We are in the consortium meeting now and are discussing the deliverables > due in the first year. > > As decided in the last consortium meeting you said you would be finished > with turning the deliverable template into ReST by 12 of sept.... > > When can you finish with this - we are waiting with wp 4 and 5 and 14 > deliverables for this....? and our phone call from Monday. After all, I am asking you for help. I tried to get something final ready with a lot of effort. Actually, I spent much more hours on this than necessary. The problem is that there are some open ends which are not really clear. I planned to ask you for some assistance on Monday, but then failed to do it. Going to do it now, to short-cut efforts a bit, and to get a more realistic result. Currently, I have created a couple of ReST documents, which more or less resemble the given OOo template. I also created OOo stub documents which are able to import some rendered HTML versions of ReST in a half-automated way. This is all halfway imperfect or perfect, depending on POV. For me it is imperfect, because the problem is not well-defined. Problem is that the template document has a) some formatting properties which are hard or not directly possible to model with ReST, but I don't know how relevant this is and if I need to support it, b) has no real content, so I don't know what the real problems will be that I have to solve for the final documents. My problem is further to decide what to to in an automated way and what to declare as some hand editing needed to be done on the final document. Ideally, a single transformation would do it all, but this is quite involved and beyond scope of the task. You could help me very much on drawing the decisions and to come up with a most simple solution this way: - Please, take the existing .sxw template document as it is, and use it to write the piece of information you wanted to write. Fill in the WP related info as it should be. - change its formatting as you see fit. Check if the regular sections like table of contents, listing of participants, and abbreviations used throughout the document are in the shape that we really need and want, and adjust accordingly. - make the document a final document, regardless whether the content is final, but really fill it with the actual stuff, including all possible problems like footnotes, tables and cross-references which might occur, and maybe additional sections which are to be repeated for other documents. Simply *use* the framework in a typical, non-trivial way. - replace the yet unspecified topic, deliverable, WP information and other systematic stuff placeholders with real information, and reference it in exactly the same way if it needs to be referenced in the document. Augment systematic information which might not have been foreseen, yet. This would give me very good input to figure out what is to be parameterized via ReST, and what is just a repeated block of text, which I can either generate from a ReST include, or that can be put into the template OOo document in the first place. What I'm intending to do is to take your document, split it into per WP/deliverable individual pieces which go into the ReST text, and into re-used text blocks which just stay in the template, with no or just little parameterization. So I will generate your ReST source document from your OOo document! I will then set up a procedure as simple as possible (but no simpler) to produce a final PDF document from this. There may or may not be a persistent Open Office document involved at all, I will see what is actually needed. You will anyway get a ReST document back for review ASAP, and we'll have a chance for some interaction on this until we reach coherence. Summary: -------- You could be very helpful by just using the given template, turn it into a real document with some content, and giving it the final shape that you think would be appropriate. Please adjust the given tables according to your use-case, see if the page footers and headers are really like they should be, use the needed features which were not used in the content-less template, so I get a feeling about what I need to expose to the writer of the document and what can be defined in a fixed manner, somewhere (probably in a stub). The content of this doc does not need to be final or complete. It would just be great if it would touch enough needed features like formatting, footnotes, references, left/right/center alignment of tables and text in tables, maybe including pictures, usage of maybe numbered enumerations, and things like column-widths of tables. I need to decide whether I can make use of table layouts stored inside the template, or whether to switch to the newly supported ReST table formatting,and to what extent. If you could focus on these matters and give me some nice doc, early, this would be very helpful. I can send back a transliterated version in a few hours and re-iterate the template. Summary of Summary: ------------------- Please make a document with the features you need and the design you like. Feel free to redefine all the styles as seems fit. This makes this task much easier to handle for me. Right now, I'm blocked because I have too many open questions and unresolved variables to become effective. All the best -- chris -- Christian Tismer :^) <mailto:tismer@stackless.com> tismerysoft GmbH : Have a break! Take a ride on Python's Johannes-Niemeyer-Weg 9A : *Starship* http://starship.python.net/ 14109 Berlin : PGP key -> http://wwwkeys.pgp.net/ work +49 30 802 86 56 mobile +49 173 24 18 776 fax +49 30 80 90 57 05 PGP 0x57F3BF04 9064 F4E1 D754 C2FF 1619 305B C09C 5A3B 57F3 BF04 whom do you want to sponsor today? http://www.stackless.com/

2 1

Fw: Crash!
by Ben.Young＠risk.sungard.com 29 Sep '05

29 Sep '05

Further to my previous mail, current check seems to crash much more often now: $ ./pypy-c.exe debug: entry point starting debug: argv -> c:\Documents and Settings\YoungB\dist\pypy\translator\goal\pypy-c.exe debug: importing code debug: calling code.interact() Python 2.4.1 (pypy 0.7.1 build) on win32 Type "help", "copyright", "credits" or "license" for more information. (InteractiveConsole) >>>> import test >>>> test.rpython.main(100) -> Segfault Cheers, Ben ----- Forwarded by Ben Young/Infinity on 23/09/2005 13:05 ----- Ben Young/Infinity wrote on 22/09/2005 12:47:14: > Hi Everyone, > > Current checkout, compiled pypy (windows as usual): > > $ ./pypy-c.exe > debug: entry point starting > debug: argv -> c:\Documents and > Settings\YoungB\dist\pypy\translator\goal\pypy-c.exe > debug: importing code > debug: calling code.interact() > Python 2.4.1 (pypy 0.7.1 build) on win32 > Type "help", "copyright", "credits" or "license" for more information. > (InteractiveConsole) > >>>> fe > > -> Segfault > > Appears to be a problem throwing exceptions. > > On another point, I notice that when lists of pointers are resized > lots of incref/decrefs happen when all that really needs to happen > is a move operation (or even a memcpy of the whole block)? Also, > could all lists of pointers share the same c representation, with > casts from void*? > > Cheers, > Ben

3 4