Mailman 3 July 2006 - pypy-dev

make _ssl module compile
by Lawrence Oluyede 11 Aug '06

11 Aug '06

I'm trying to feed the _ssl module (feature complete) to the ext. compiler but I get a strange error I've never had before: [translation:ERROR] Error: [translation:ERROR] AttributeError: 'CallEntry' object has no attribute 'get_repr' [translation] start debugger... > /Users/rhymes/scc/pypy/pypy/rpython/rexternalobj.py(20)rtyper_makerepr() -> return entry.get_repr(rtyper, self) (Pdb) self SomeCTypesObject(knowntype=CFunctionType, ownsmemory=False) (Pdb) entry <pypy.rpython.rctypes.afunc.CallEntry object at 0x202fd10> (Pdb) locals() {'entry': <pypy.rpython.rctypes.afunc.CallEntry object at 0x202fd10>, 'rtyper': <pypy.rpython.rtyper.RPythonTyper object at 0x172ef50>, 'self': SomeCTypesObject(knowntype=CFunctionType, ownsmemory=False)} (Pdb) dir(entry) ['__class__', '__delattr__', '__dict__', '__doc__', '__eq__', '__getattribute__', '__hash__', '__init__', '__metaclass__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__str__', '__weakref__', 'compute_annotation', 'compute_result_annotation', 'instance', 'specialize_call', 'type'] I took a look into rctypes.afunc and in fact there's no get_repr (because there's no rfunc.py). What problem is that? -- Lawrence http://www.oluyede.org/blog

2 14

small patch for translator/c/src/ll_osdefs.h for win32
by Scott Dial 02 Aug '06

02 Aug '06

I attempted to translate a pypy-c in windows today. I had to mask out including sys/mman.h. Afterwards, I was able to succesfully translate. Index: ll_osdefs.h =================================================================== --- ll_osdefs.h (revision 30390) +++ ll_osdefs.h (working copy) @@ -42,7 +42,9 @@ #include <sys/types.h> +#if !defined(MS_WINDOWS) #include <sys/mman.h> +#endif #ifdef HAVE_STROPTS_H #include <stropts.h> -- Scott Dial scott(a)scottdial.com scodial(a)indiana.edu

5 18

gateway.applevel and kwargs
by Leonardo Soto 01 Aug '06

01 Aug '06

Hi all, I've recently filled the issue 244 (dict.update() doesn't support keywords argument), and tried to solve it in a naive way, just modifying the applevel definition to: def update(d, o, **kwargs): if hasattr(o, 'keys'): for k in o.keys(): d[k] = o[k] else: for k,v in o: d[k] = v for k in kwargs: d[k] = kwargs[k] But it simply doesn't work: test_dictobject.py[34] .......................FF......... __________________________________________________________________________________________________________________________________________ __________________________________________ entrypoint: AppTest_DictObject().test_update_kwargs ___________________________________________ def test_update_kwargs(self): d = {} E d.update(foo='bar', baz=1) > (application-level) TypeError: update() got 2 unexpected keyword arguments [/home/leo/src/pypy-dist/pypy/objspace/std/test/None</home/leo/src/pypy-dist/pypy/interpreter/gateway.py:754>:3] __________________________________________________________________________________________________________________________________________ ______________________________________ entrypoint: AppTest_DictObject().test_update_dict_and_kwargs ______________________________________ def test_update_dict_and_kwargs(self): d = {} E d.update({'foo': 'bar'}, baz=1) > (application-level) TypeError: update() got an unexpected keyword argument 'baz' [/home/leo/src/pypy-dist/pypy/objspace/std/test/None</home/leo/src/pypy-dist/pypy/interpreter/gateway.py:754>:3] Why?. Should it work or is the lack of kwargs support a known limitation? -- Leonardo Soto M.

2 2

MSVC "too many initializer" problem
by Scott Dial 29 Jul '06

29 Jul '06

Right now, if I were to enter the translatorshell and try to compile any of the snippets I will get an the following error: testing_1.c(2318) : warning C4047: 'initializing' : 'char *' differs in levels of indirection from 'int' testing_1.c(2318) : error C2078: too many initializers Which refers to this line (for this example): static globalfunctiondef_t globalfunctiondefs[] = { {&pypy_gfunc_sieve_of_eratosthenes, "pypy_gfunc_sieve_of_eratosthenes", {"sieve_of_eratosthenes", (PyCFunction)pypy_g_pyfn_sieve_of_eratosthenes, METH_VARARGS|METH_KEYWORDS, { 83,105,101,118,101,32,111,102,32,69,114,97,116,111,115,116,104,101,110,101, 115,10,32,32,32,32,10,32,32,32,32,84,104,105,115,32,111,110,101,32, 105,115,32,102,114,111,109,32,97,110,32,105,110,102,97,109,111,117,115,32, 98,101,110,99,104,109,97,114,107,44,32,34,84,104,101,32,71,114,101,97, 116,32,67,111,109,112,117,116,101,114,10,32,32,32,32,76,97,110,103,117, 97,103,101,32,83,104,111,111,116,111,117,116,34,46,10,10,32,32,32,32, 85,82,76,32,105,115,58,32,104,116,116,112,58,47,47,119,119,119,46,98, 97,103,108,101,121,46,111,114,103,47,126,100,111,117,103,47,115,104,111,111, 116,111,117,116,47,10,32,32,32,32}}}, { NULL } /* Sentinel */ }; I'm not too familiar with structure initialization in MSVC's compiler, but it seems to barf on that one. If anyone has a quick answer, then I am all ears, otherwise I'll have to do some research. -- Scott Dial scott(a)scottdial.com scodial(a)indiana.edu

2 1

Combining strdicts and LLVM-C-Prof ...
by Alexander Schremmer 27 Jul '06

27 Jul '06

Hi, today I made some tests of the strdict code on snake: date size codesize executable richards pystone Thu Jul 27 20:14:33 2006 - - python 2.4.3 795ms ( 1.0x) 40000 ( 1.0x) Thu Jul 27 20:08:02 2006 10425736 2475162 pypy-llvm-30641-x86 2902ms ( 3.6x) 9191 ( 4.4x) Thu Jul 27 20:05:53 2006 10474191 2028604 pypy-llvm-30641-c-prof 1795ms ( 2.3x) 14619 ( 2.7x) Thu Jul 27 19:58:41 2006 10574247 2128805 pypy-llvm-30641-c 2193ms ( 2.8x) 11441 ( 3.5x) Thu Jul 27 17:37:21 2006 10162160 2208132 pypy-c-30634-profopt 2380ms ( 3.0x) 12285 ( 3.3x) Thu Jul 27 16:56:55 2006 10382148 2428236 pypy-c-30634 2590ms ( 3.3x) 10846 ( 3.7x) 2.3x is really neat - 1.0x is not far :-) Kind regards, Alexander

1 0

Failing stackless tests
by Armin Rigo 27 Jul '06

27 Jul '06

Hi all, hi Aurelien, The stackless-related tests are all consistently failing nowadays. Some have been failing for 4 days and others for 9 days. See http://snake.cs.uni-duesseldorf.de/pypytest/summary.html Given that you appear to continue to work on it, but without making tests pass again, I'm a bit worrying exactly about what you are doing? That doesn't seem too much in line with the "test-driven development" approach. A bientot, Armin

4 7

Good news everyone
by Maciek Fijalkowski 27 Jul '06

27 Jul '06

Right now, b'n'b JS client should be almost playable. Speed and key granularity is still an issue, but there should be no problems with zindex and all other problems. Enjoy.

1 0

extension compiler and Python special methods
by Lawrence Oluyede 27 Jul '06

27 Jul '06

As u can see in rev. #30543 I commited a series of methods to complete the mmap module. Those are the special methods (__xyz__) implemented as regular ones. I thought it was best to have the functionality in anyway. When and if we'll have that support it will be only a matter of change methods names to gain compatibility with CPython's code. If you disagree with me let me know, I'll comment out the code or whatever. -- Lawrence http://www.oluyede.org/blog

2 3

pypy development tasks
by Stephan Diehl 27 Jul '06

27 Jul '06

Hi all, starting next week, I'll be able again to continue working on pypy. As a part-part-part time worker, I find it a bit difficult to stay on top on what's going on (and what needs to be done). These are the things, I would continue on, if nobody has a better idea: - write a python module that exposes Coroutine interface (using greenlets, I suppose). This would be usefull for further development of applevel stackless module. As a sideeffect, the stackless module could then be used with CPython. - continue work on applevel stackless module and documentation. Other than that, if I should rather do things like adding docstrings or do other usefull tasks, don't hesitate to tell me :-) Cheers Stephan

2 2

translation with --profopt fails
by Elmo Mäntynen 26 Jul '06

26 Jul '06

Last lines of output (python translate.py --backend=c --profopt='-c "from richards import *;main(iterations=1)"' --text --batch targetpypystandalone.py): """ [flowgraph] (pypy.rpython.memory.gctransform:733)ll_finalizer [flowgraph] (pypy.rpython.memory.gctransform:733)ll_finalizer [flowgraph] (pypy.rpython.memory.gctransform:733)ll_finalizer XXX: operation v805 = direct_call((<* fn eq__Long_Long>), (StdObjSpace), arg0_626, v804) cannot raise, but has exception guarding in graph (?:1)_mm_eq_longS0_W_LongObject_W_BoolObject XXX: operation v807 = direct_call((<* fn eq__Long_Long>), (StdObjSpace), arg0_629, v806) cannot raise, but has exception guarding in graph (?:1)_mm_eq_longS0_W_LongObject_W_IntObject XXX: operation v809 = direct_call((<* fn eq__Long_Long>), (StdObjSpace), arg0_631, v808) cannot raise, but has exception guarding in graph (?:1)_mm_eq_longS0_W_LongObject_W_LongObject [c] 28000 nodes [ array: 3816 boehm rtti: 120 func: 2075 struct: 29285 ] [c] 29000 nodes [ array: 4045 boehm rtti: 120 func: 2149 struct: 29980 ] [c] 30000 nodes [ array: 4129 boehm rtti: 120 func: 2186 struct: 31192 ] [c] 31000 nodes [ array: 4257 boehm rtti: 120 func: 2201 struct: 32700 ] [c] 32000 nodes [ array: 4419 boehm rtti: 137 func: 2279 struct: 33433 ] [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "translate.py", line 335, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/driver.py", line 509, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/tool/taskengine.py", line 108, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/driver.py", line 197, in _do [translation:ERROR] res = func() [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/driver.py", line 301, in task_database_c [translation:ERROR] database = cbuilder.build_database() [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/c/genc.py", line 86, in build_database [translation:ERROR] db.complete() [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/c/database.py", line 302, in complete [translation:ERROR] add_dependencies(node.enum_dependencies()) [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/c/database.py", line 288, in add_dependencies [translation:ERROR] self.get(value) [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/translator/c/database.py", line 179, in get [translation:ERROR] if obj: # test if the ptr is non-NULL [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/rpython/lltypesystem/lltype.py", line 886, in __nonzero__ [translation:ERROR] return self._obj is not None [translation:ERROR] File "/home/drayko/Workfolder/Security/Python/cvs/pypy-dist/pypy/rpython/lltypesystem/lltype.py", line 910, in _getobj [translation:ERROR] raise RuntimeError("accessing already garbage collected %r" [translation:ERROR] RuntimeError: accessing already garbage collected <Array of Char > """ Just in case no one noticed this already... Elmo

3 10