Mailman 3 February 2005 - pypy-dev

can you renumber roundup issues
by Laura Creighton 10 Feb '05

10 Feb '05

If you sort by id you get the order: 1 11 12 2 3 4 55 58 59 6 which isn't what we want. I also don't understand why there are gaps -- this is what you get when you sort grouped by 'milestone' I would have expected 1 11 12 13 14 15 16 ... where are those guys? You get them when you group by activity. I don't think that I understand the 'group by' feature at all. can I make my own groups and my own search criteria? I haven't found a url that explains this yet, can you point me at it? I figure adding 10,000 to every issue should do the trick. I have too many issues, but don't expect that we will have more than 99,999 of them. Or perhaps I am being optimistic? Laura

3 2

Pycon sprint - some logistics
by Jacob Hallén 10 Feb '05

10 Feb '05

Here are some loose notes for the Pycon sprint. Please send me comments on things you want to know and things I may have missed mentioning. The following people are known to come: Jacob Hallén Anders Chrigström Samuele Pedroni All 3 are booked on SAS, GOT-CPH-IAD 18 March leaving 07:20, arriving 15:20 BWI-KEF-CPH-GOT, leaving 25 March 20:15, arriving 26 March 15:05 IAD=Washington Dulles BWI=Baltimore International Airport KEF=Keflavik International Airport Holger Krekel Armin Rigo Christian Tismer Bea During These people will not attend: Adrien Di Mascio Ludovic Aubry Michael Hudson Attendance status of the following people is not yet known: Laura Creighton DFKI representative Anders Lehmann Alex Martelli Travel Special offers from KLM and Lufthansa have ended. SAS has a special offer that terminates 2005-02-28. Jacob, Samuele and Anders are booked on this one. Many dates are already blotted out, so book quickly if you want to use this offer. Transit IAD-Washington DC: Public bus: $3.00 (exact fare required) Runs once every hour. Leaves Dulles at XX.30 - XX.40, depending on hour of the day and weekday. Afternoon of 18 march, it will be XX.40. This bus has no special luggage racks, so many people with luggage is a problem. Take the bus to Roslyn, where you can walk to Key Bridge Hotel and Iwo Jima. You can also take the Metro to any place in DC. Washington Flyer Coach: $8.00 About twice per hour. XX.15 and XX.45. Goes to West Falls Church Metro Station, from where you can take the metro to Roslyn, or any other place in DC. Taxi: $45-50 plus tip Hotels: Currently our first choice is Best Western Key Bridge Hotel. This is situated close to Roslyn, which is a Metro station 2 stops from the conference venue. There is a late night store at the Metro and the hotel is clean, simple and relatively cheap. Second choice is Iwo Jima, which is a little further from Roslyn, but still a rather short walk away. We are waiting for people to rspond to Lauras inquiries about a youth hostel, but we should time out on this in a few days. Transit: Washington DC has a nicely working subway system. You buy a pre-paid ticket for some amount of cash. I suggest putting $10 on the card from the start. You insert your card in the gate when entering a station and you do the same when leaving. Depending on how far you have travelled and if it rush-hour or not, the machine will deduct what the fare is. Water: American tap water tastes like swimming-pool. Buy bottled water. The store just outside Roslyn (by the stop for the airport bus) carries water. Buy the gallon bottles of the cheapest brand. Food: There are many food options by the conference venue. On the ground floor and in the basement of the conference building, there is a selection of fast-food. It is cheap and it is garbage. However, it is probably not quite as bad as the conference lunches. If you leave the conference building and go up to Pensylvania Ave. Turn left and go half a block. There is a chinese fast-food place that actually does good food. There is a good sushi restaurant about 4 blocks away from the conference venue. Cross Pensylvania Ave. Turn directly right and go 3 blocks down the street. Just across the street from the conference venue is a mall with restaurants. There is a place that does sandwiches, which are rather good, but quite expensive. There is also Kinkeads in the mall, which is considered to be the #1 gourmet restaurant in DC. They actually have decent food, and compared to quality, this is not all that expensive. Finally, way out on the edge of town is a really nice Japanese restaurant. Very good sushi and very good Japanese dishes in general. It is located on McArthur Boulevard. Time off: If you have any time off in daytime, the Smithsonian Institutions are just a few Metro stops away. They are all for free, so you can simply slip in for an hour and look at their collections. Air&Space Museum is a must for everyone. The National Gallery is strongly recommended by me. Natural History and Ethnographics are probably interesting for some. The Whitehouse, The Congress, the Library of Congress and the Supreme court are also in the neighbourhood, as are the war memorials and a bunch of other stuff. Things to bring: - Beamer - they usually have some, but not enough to go around - Printer - they don't have any of those - Tea and cofee production equipment (110 Volts) - this is a problem - Plug converters - 240 Volts whatever you have -> Mickey Mouse voltage - Ear plugs - you may end up sleeping close to the ice machine, or the hotel elevator, or they may decide to hack up the concrete pavement next to your hotel. Network access usually works very well. This year they seem to be fully wireless. Other details: You must have a machine readable passport to be allowed into the US. They will take your picture and your finger prints on entry to the country.

2 2

OSCON proposals closing Feb 13.
by Laura Creighton 09 Feb '05

09 Feb '05

Are we sending anything? Laura

2 1

'My Python is too slow'
by Laura Creighton 09 Feb '05

09 Feb '05

http://www.linuxdevcenter.com/pub/a/linux/2005/01/27/freevo.html Speeding these guys up would make a nice demo. Laura

1 0

Re: Using PyPy as a compiler
by Hart's Antler 09 Feb '05

09 Feb '05

Hi, unannotated, i found that the pypy to c compiled code runs slower than the same function in python. GCC fails to compile any of the annotated DOM code. Here's some errors it produced for int annotated. module_1d49eab472565cbc4619f8ff8cc35f49.c:214: error: duplicate member `__iter__' module_1d49eab472565cbc4619f8ff8cc35f49.c:215: error: duplicate member `mro' module_1d49eab472565cbc4619f8ff8cc35f49.c:216: error: duplicate member `values' module_1d49eab472565cbc4619f8ff8cc35f49.c:217: error: duplicate member `__repr__' module_1d49eab472565cbc4619f8ff8cc35f49.c:218: error: duplicate member `__hash__' module_1d49eab472565cbc4619f8ff8cc35f49.c:219: error: duplicate member `__ge__' module_1d49eab472565cbc4619f8ff8cc35f49.c:220: error: duplicate member `iteritems' module_1d49eab472565cbc4619f8ff8cc35f49.c:221: error: duplicate member `__getattribute__' module_1d49eab472565cbc4619f8ff8cc35f49.c:222: error: duplicate member `pop' module_1d49eab472565cbc4619f8ff8cc35f49.c:223: error: duplicate member `has_key' module_1d49eab472565cbc4619f8ff8cc35f49.c:224: error: duplicate member `__lt__' module_1d49eab472565cbc4619f8ff8cc35f49.c:225: error: duplicate member `__init__' module_1d49eab472565cbc4619f8ff8cc35f49.c:226: error: duplicate member `__new__' module_1d49eab472565cbc4619f8ff8cc35f49.c:227: error: duplicate member `__contains__' module_1d49eab472565cbc4619f8ff8cc35f49.c:228: error: duplicate member `__cmp__' module_1d49eab472565cbc4619f8ff8cc35f49.c:229: error: duplicate member `__le__' module_1d49eab472565cbc4619f8ff8cc35f49.c:230: error: duplicate member `itervalues' module_1d49eab472565cbc4619f8ff8cc35f49.c:231: error: duplicate member `__doc__' module_1d49eab472565cbc4619f8ff8cc35f49.c:232: error: duplicate member `__len__' module_1d49eab472565cbc4619f8ff8cc35f49.c:233: error: duplicate member `__ne__' module_1d49eab472565cbc4619f8ff8cc35f49.c:234: error: duplicate member `__getitem__' module_1d49eab472565cbc4619f8ff8cc35f49.c: In function `__pyx_f_39module_1d49eab472565cbc4619f8ff8cc35f49_appendChild__2dc4c10c': module_1d49eab472565cbc4619f8ff8cc35f49.c:801: error: request for member `_childNodes' in something not a structure or union module_1d49eab472565cbc4619f8ff8cc35f49.c:801: warning: assignment makes pointer from integer without a cast module_1d49eab472565cbc4619f8ff8cc35f49.c:893: error: request for member `_childNodes' in something not a structure or union module_1d49eab472565cbc4619f8ff8cc35f49.c:893: warning: assignment makes pointer from integer without a cast module_1d49eab472565cbc4619f8ff8cc35f49.c:979: error: request for member `_childNodes' in something not a structure or union module_1d49eab472565cbc4619f8ff8cc35f49.c:979: warning: assignment makes pointer from integer without a cast module_1d49eab472565cbc4619f8ff8cc35f49.c: In function `__pyx_f_39module_1d49eab472565cbc4619f8ff8cc35f49__xpath_attr__2dc4c5dc': module_1d49eab472565cbc4619f8ff8cc35f49.c:2383: error: request for member `ELEMENT_NODE' in something not a structure or union module_1d49eab472565cbc4619f8ff8cc35f49.c:2383: warning: assignment makes pointer from integer without a cast module_1d49eab472565cbc4619f8ff8cc35f49.c: In function `__pyx_f_39module_1d49eab472565cbc4619f8ff8cc35f49__xpath_text__2dc4c5a4': module_1d49eab472565cbc4619f8ff8cc35f49.c:4814: error: request for member `TEXT_NODE' in something not a structure or union -brett __________________________________ Do you Yahoo!? All your favorites on one personal page � Try My Yahoo! http://my.yahoo.com

1 0

LLVM backend
by Carl Friedrich Bolz 08 Feb '05

08 Feb '05

Hi pypy-list! I just checked my LLVM-backend in (I hope I did nothing wrong). It resides in pypy/translator/llvm. It is still a bit rough but should work for most functions that use just ints and bools (I started addint some list and string support but at the moment only lists of length one work and strings are not tested at all). To try it out use the function 'llvmcompile' in the module pypy.translator.llvm.genllvm on an annotated flowgraph: %~/pypy/translator/llvm> python -i genllvm.py >>> t = Translator(test.my_gcd) >>> a = t.annotate([int, int]) >>> f = llvmcompile(t) >>> f(10, 2) 2 >>> You need to have the LLVM executables (llvm-as, llc, llvmc) in your path, as well as 'as' and gcc. The LLVM c/c++ frontend is not needed for genllvm to work (which eases installation a bit). llvmcompile tries to produce LLVM-assembly out the entry function of the translator and of all the functions the entry function calls. The assembly is then optimized by LLVM and native code (a .o file) is generated. Additionally the LLVM backend produces a pyrex wrapper for the generated function to be able to use the LLVM produced version from python. Since all the dynamic features of Python are not supported yet (and since the LLVM optimizers seem to be very good) it is not surprising that the produced functions are pretty fast (faster than C? ;-). How genllvm works: For every function, constant and variable of the flowgraph an object is generated that knows how representate the object in LLVM. These LLVMRepr-objects can have dependencies on other LLVMRepr objects, for example a variable depends on the representation of its type, a function depends on all its variables and constants... (this seems to be a bit similar to the nameof* functions of genc and genjava but I'm not shure of that) To generate LLVM-code this dependenciy-tree is walked depth-first and every object is asked for its global declarations and then for the functions it needs. For example in the global declaration phase the used types would return their own declaration. In the function phase the used types return the space-ops that are defined for them and the functions return their own llvm-code. The code generation for the functions to be translated takes place in the FunctionRepr class. This is quite straightforward since the structure of flowgraphs corresponds very well to the control flow mechanisms of LLVM - for example direct support for phi nodes. So far this works quite well but a lot of issues remain open: - Does my approach makes sense at all? I never did anything even remotely similar so I might be doing lots of stupid things. - I think there should be some more intelligent way to produce the necessary LLLVM-implementations for the space operations of more complex types than just writing them in LLVM-assembler, which can be quite tedious (it's no fun writing programs in SSA form). - List and Strings should be relatively easy to implement with arrays. I'm not quite shure wether I manage to do it, I'll just ask questions if I run into problems. - Are tuples really only used for returning multiple values from a function? If yes they could be avoided altogether using additional pointer arguments that point to where the return value should be stored. - I don't know how exactly 'interned strings' work in CPython so I don't know what to do with dicts yet. - Classes, GC, exceptions and all that... Regards, Carl Friedrich

5 12

Re: [pypy-svn] r8967 - in pypy/dist/pypy: lib tool
by Armin Rigo 08 Feb '05

08 Feb '05

Hi, On Mon, Feb 07, 2005 at 07:58:04PM +0100, tismer(a)codespeak.net wrote: > Log: > added class NiceTranslate for compilation of dynamically > generated methods, see _classobj.py . > The generated code objects have correct source info > instead of just "<string>" Funny how often we reinvent this particular wheel! That's at least the third way to work around this limitation of exec/compile that we have in PyPy. The first one should be removed, the second one is dyncode from the py lib, the third one is yours. My guess is that we need a very simple one that we use systematically for all of our dynamic compilation needs in PyPy, which interfaces nicely with dyncode but does't require the py lib to be imported outside of debugging code. Armin

1 0

Using PyPy as a compiler
by Hart's Antler 08 Feb '05

08 Feb '05

Hi, i am new to PyPy, i'm hoping someone can help me get started. I want to use translator to turn some python code into a pyx files so that i can compile them and later load them as modules in my program. I did a simple test and i was able to get some pyrex code from the translator, but when i saved that to a pyx file and called 'pyrexc mymodule.pyx' on it there were errors. I noticed there is a Pyrex folder (a Pyrex fork?) in the PyPy project, but i'm not what to use in there to convert mymodule.pyx to a .c file so gcc can compile it. btw, is todays current version in svn working? I get alot of errors when calling translator.view(), i'm doing the test.is_perfect_number tutorial. thanks for PyPy, -brett >>> t.view() Traceback (most recent call last): File "<stdin>", line 1, in ? File "translator.py", line 112, in view FlowGraphPage(self).display() File "/root/imp/dist-pypy/pypy/translator/tool/graphpage.py", line 36, in display get_layout(self).display() File "/root/imp/dist-pypy/pypy/translator/tool/pygame/graphclient.py", line 60, in get_layout return InProcessConnexion().download(homepage) File "/root/imp/dist-pypy/pypy/translator/tool/pygame/graphclient.py", line 45, in download return ClientGraphLayout(self, key, page.source, page.links) File "/root/imp/dist-pypy/pypy/translator/tool/pygame/graphclient.py", line 22, in __init__ cmdexec('dot -Tplain %s>%s' % (str(DOT_FILE),str(PLAIN_FILE))) File "/root/imp/dist-pypy/py/process/cmdexec.py", line 66, in posix_exec_cmd ''.join(out), ''.join(err)) py.__impl__.process.cmdexec.ExecutionFailed: ExecutionFailed: 127 dot -Tplain /tmp/usession-4/graph.dot>/tmp/usession-4/graph.plain /bin/sh: line 1: dot: command not found __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com

7 12

dist-simpler-multimethods branch
by Samuele Pedroni 08 Feb '05

08 Feb '05

The branch Armin and me worked on over the weekend is ready to be merged. It is a reimplementation of multimethods for standard objspace using chained single-dispatch and user-defined precedences for types and their conversions. This means that it is clear what matches will be tried, for example for bools bool int long float ANY Although right now precedences and conversions are given in a very exhaustive way in std/model.py, more declarative approaches can be devised for this. Using well-defined precedence lists means that it should be possible, if necessary, to switch to other internal implementations strategies for dispatching. Chained single dispatching is realised by attaching methods to the partecipating classes. (*) Although we are not using it right now, apart for slicing, the approach means that is also easy to have fine control per argument position and per multimethod of what types conversions and precedences are allowed. The branch also reuses gateways instead of its own frame and code special classes. Samuele (*) to give an idea these are the methods attached with indicated where they are put plus the generated free-standing entry-point function for the add example in test_multimethod, you can follow what happens with calls like __add_perform_call(space, W_IntObject(), W_IntObject()) __add_perform_call(space, W_BoolObject(), W_IntObject()) ... In: W_BoolObject def __add__W_IntObject(arg1, space, arg0): return add__Int_Int(space, arg0, delegate_b2i(arg1)) ************************************************************ In: W_IntObject def __add__W_IntObject(arg1, space, arg0): return add__Int_Int(space, arg0, arg1) ************************************************************ In: W_Root def __add__W_IntObject(arg1, space, arg0): return raiseFailedToImplement() ************************************************************ In: W_BoolObject def __add(arg0, space, arg1): return arg1.__add__W_IntObject(space, delegate_b2i(arg0)) ************************************************************ In: W_Root def __add__W_IntObject(arg1, space, arg0): return raiseFailedToImplement() ************************************************************ In: W_IntObject def __add(arg0, space, arg1): return arg1.__add__W_IntObject(space, arg0) ************************************************************ In: W_Root def __add(arg0, space, arg1): return raiseFailedToImplement() ************************************************************ Free-standing entry-point: def __add_perform_call(space, arg0, arg1): return arg0.__add(space, arg1)

1 0

Re: [pypy-dev] Some more tests passing
by Laura Creighton 06 Feb '05

06 Feb '05

In a message of Sat, 05 Feb 2005 11:35:38 GMT, Armin Rigo writes: >Hi Seo, > >On Sat, Feb 05, 2005 at 02:07:34AM +0900, Seo Sanghyeon wrote: >> As of r8877, some more CPython regression tests are passing, unmodified >. > >Cool ! > >> Why don't you reply to this message, if you got some more tests passing >? > >There is a place in lib-python-2.3.4/test/conftest.py where we can list t >he >tests that pass. The idea is that someone with a lot of time before him >could >type 'py.test' in this directory and check that all the tests that used t >o >pass still pass. > > >A bientôt, > >Armin At some point I want to build a 'how to run a CPython test, fix any bugs' for the 60% goal for PyCon. (Assuming Seo doesn't fix them all :-) ) Is this what you want people officially to do? Laura

2 1