Mailman 3 April 2013 - pypy-dev

Python vs pypy: interesting performance difference [dict.setdefault]
by David Naylor 10 Mar '14

10 Mar '14

Hi, I needed to create a cache of date and time objects and I wondered what was the best way to handle the cache. For comparison I put together the following test: <file="iforkey.py"> import datetime import random import timeit ranges = [datetime.datetime(2011,01, random.randint(1, 31)) for i in xrange(1000)] def ifdict(): cache = {} b = [] for i in ranges: key = i.day if key in cache: b.append(cache[key]) else: date = i.date() cache[key] = date b.append(date) def keydict(): cache = {} b = [] for i in ranges: key = i.day try: b.append(cache[key]) except KeyError: date = i.date() cache[key] = date b.append(date) def defaultdict(): cache = {} b= [] for i in ranges: b.append(cache.setdefault(i, i.date())) print "ifdict:", timeit.repeat("ifdict()", "from __main__ import ifdict", number=10000) print "keydict:", timeit.repeat("keydict()", "from __main__ import keydict", number=10000) print "defaultdict:", timeit.repeat("defaultdict()", "from __main__ import defaultdict", number=10000) </file> # python iforfile.py ifdict: [2.432887077331543, 2.4002890586853027, 2.397233009338379] keydict: [2.3483030796051025, 2.358638048171997, 2.314802885055542] defaultdict: [3.5384328365325928, 3.5329859256744385, 3.5728111267089844] # pypy iforfile.py (pypy 1.5) ifdict: [0.8129069805145264, 0.74648118019104, 0.7432689666748047] keydict: [0.5187451839447021, 0.4662129878997803, 0.4504108428955078] defaultdict: [37.98510789871216, 37.859113931655884, 37.92770600318909] Pypy displays significant slowdown in the defaultdict function, otherwise displays its usual speedup. To check what is the cause I replaced i.date() with i.day and found no major difference in times. It appears dict.setdefault (or it's interaction with jit) is causing a slow down. Regards

4 14

numpy fails trigonometry with complex numbers, what to do?
by Matti Picus 22 Dec '13

22 Dec '13

I am trying to complete complex numbers in numpypy. Progress is good, I picked up from previous work on the numpypy-complex2 branch. Complex numbers come with extensive tests, it seems all the corner cases are covered. In porting the tests to numpypy, I came across a problem: numpy returns different results than cmath. Some of the differences are due to the fact that numpy does not raise a ValueError for dividing by 0 or other silly input values, but other differences are inexplicable (note the sign of the imaginary part): >>> numpy.arccos(complex(0.,-0.)) (1.5707963267948966-0j) >>> cmath.acos(complex(0.,-0.)) (1.5707963267948966+0j) >>> or this one: >>> cmath.acos(complex(float('inf'),2.3)) -infj >>> numpy.arccos(complex(float('inf'),2.3)) (0.78539816339744828-inf*j) Should I ignore the inconsistencies, or fix the 700 out of 2300 test instance failures? What should pypy's numpypy do - be consistent with numpy or with cmath? cmath is easier and probably faster (no need to mangle results or input args), so I would prefer cmath to trying to understand the logic behind numpy. Matti 2280c2365844

4 4

Pypy is slower than Python
by cat street 02 May '13

02 May '13

You can test this code: import time def test(n): m = 10 vals = [] keys = [] for i in xrange(m): vals.append(i) keys.append('a%s'%i) d = None for i in xrange(n): d = dict(zip(keys, vals)) return d if __name__ == '__main__': st = time.time() print test(1000000) print 'use:', time.time() - st -- HomePage: cat.appspot.com

5 11

Biggest Fake Conference in Computer Science
by eliswilson＠hushmail.com 30 Apr '13

30 Apr '13

Biggest Fake Conference in Computer Science We are researchers from different parts of the world and conducted a study on the world’s biggest bogus computer science conference WORLDCOMP http://sites.google.com/site/worlddump1 organized by Prof. Hamid Arabnia from University of Georgia, USA. We submitted a fake paper to WORLDCOMP 2011 and again (the same paper with a modified title) to WORLDCOMP 2012. This paper had numerous fundamental mistakes. Sample statements from that paper include: (1). Binary logic is fuzzy logic and vice versa (2). Pascal developed fuzzy logic (3). Object oriented languages do not exhibit any polymorphism or inheritance (4). TCP and IP are synonyms and are part of OSI model (5). Distributed systems deal with only one computer (6). Laptop is an example for a super computer (7). Operating system is an example for computer hardware Also, our paper did not express any conceptual meaning. However, it was accepted both the times without any modifications (and without any reviews) and we were invited to submit the final paper and a payment of $500+ fee to present the paper. We decided to use the fee for better purposes than making Prof. Hamid Arabnia richer. After that, we received few reminders from WORLDCOMP to pay the fee but we never responded. This fake paper is different from the two fake papers already published (see https://sites.google.com/site/worlddump4 for details) in WORLDCOMP. We MUST say that you should look at the above website if you have any thoughts of participating in WORLDCOMP. DBLP and other indexing agencies have stopped indexing WORLDCOMP’s proceedings since 2011 due to its fakeness. See http://www.informatik.uni-trier.de/~ley/db/conf/icai/index.html for of one of the conferences of WORLDCOMP and notice that there is no listing after 2010. See Section 2 of http://sites.google.com/site/dumpconf for comments from well-known researchers about WORLDCOMP. The status of your WORLDCOMP papers can be changed from scientific to other (i.e., junk or non-technical) at any time. Better not to have a paper than having it in WORLDCOMP and spoil the resume and peace of mind forever! Our study revealed that WORLDCOMP is money making business, using University of Georgia mask, for Prof. Hamid Arabnia. He is throwing out a small chunk of that money (around 20 dollars per paper published in WORLDCOMP’s proceedings) to his puppet (Mr. Ashu Solo or A.M.G. Solo) who publicizes WORLDCOMP and also defends it at various forums, using fake/anonymous names. The puppet uses fake names and defames other conferences to divert traffic to WORLDCOMP. He also makes anonymous phone calls and threatens the critiques of WORLDCOMP (See Item 7 of Section 5 of above website). That is, the puppet does all his best to get a maximum number of papers published at WORLDCOMP to get more money into his (and Prof. Hamid Arabnia’s) pockets. Prof. Hamid Arabnia makes a lot of tricks. For example, he appeared in a newspaper to fool the public, claiming him a victim of cyber-attack (see Item 8 in Section 5 of above website). Monte Carlo Resort (the venue of WORLDCOMP for more than 10 years, until 2012) has refused to provide the venue for WORLDCOMP’13 because of the fears of their image being tarnished due to WORLDCOMP’s fraudulent activities. That is why WORLDCOMP’13 is taking place at a different resort. WORLDCOMP will not be held after 2013. The draft paper submission deadline is over but still there are no committee members, no reviewers, and there is no conference Chairman. The only contact details available on WORLDCOMP’s website is just an email address! We ask Prof. Hamid Arabnia to publish all reviews for all the papers (after blocking identifiable details) since 2000 conference. Reveal the names and affiliations of all the reviewers (for each year) and how many papers each reviewer had reviewed on average. We also ask him to look at the Open Challenge (Section 6) at https://sites.google.com/site/moneycomp1 and respond if he has any professional values. Sorry for posting to multiple lists. Spreading the word is the only way to stop this bogus conference. Please forward this message to other mailing lists and people. We are shocked with Prof. Hamid Arabnia and his puppet’s activities at http://worldcomp-fake-bogus.blogspot.com Search Google using the keyword worldcomp fake for additional links.

1 0

translating with --sandbox fails on latest "default" branch.
by Jonathan Slenders 30 Apr '13

30 Apr '13

Hi. Is it possible that the latest default branch does not translate a sandboxed pypy:? I do: python rpython/bin/rpython -O2 --sandbox pypy/goal/targetpypystandalone.py And get the traceback below after a bit of mandelbrot. Do we consider "default" the most stable branch? It is because I also have a fork (with the await-keyword), and I'd like to keep it up-to-date with the latest stable. Thanks! Jonathan [translation:ERROR] Error: [translation:ERROR] Traceback (most recent call last): [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/goal/translate.py", line 317, in main [translation:ERROR] drv.proceed(goals) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/driver.py", line 733, in proceed [translation:ERROR] return self._execute(goals, task_skip = self._maybe_skip()) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/tool/taskengine.py", line 114, in _execute [translation:ERROR] res = self._do(goal, taskcallable, *args, **kwds) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/driver.py", line 284, in _do [translation:ERROR] res = func() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/driver.py", line 464, in task_database_c [translation:ERROR] database = cbuilder.build_database() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/genc.py", line 175, in build_database [translation:ERROR] db.complete() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/database.py", line 306, in complete [translation:ERROR] add_dependencies(node.enum_dependencies(), node) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/database.py", line 294, in add_dependencies [translation:ERROR] self.get(value, parent and parent._funccodegen_owner) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/database.py", line 226, in get [translation:ERROR] node = self.getcontainernode(container) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/database.py", line 160, in getcontainernode [translation:ERROR] node = nodefactory(self, T, container, **buildkwds) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/node.py", line 844, in __init__ [translation:ERROR] self.make_funcgens() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/node.py", line 851, in make_funcgens [translation:ERROR] self.funcgens = select_function_code_generators(self.obj, self.db, self.name) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/node.py", line 968, in select_function_code_generators [translation:ERROR] return sandbox_transform(fnobj, db) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/c/node.py", line 944, in sandbox_transform [translation:ERROR] graph = rsandbox.get_external_function_sandbox_graph(fnobj, db) [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/translator/sandbox/rsandbox.py", line 166, in get_external_function_sandbox_graph [translation:ERROR] ann.finish() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/rtyper/annlowlevel.py", line 241, in finish [translation:ERROR] self.finish_annotate() [translation:ERROR] File "/home/jonathan/hg/pypy-april/pypy/rpython/rtyper/annlowlevel.py", line 267, in finish_annotate [translation:ERROR] (graph, s_result, s_real_result)) [translation:ERROR] Exception: wrong annotation for the result of <FunctionGraph of (rpython.translator.sandbox.rsandbox:147)sandboxed_ll_os.ll_os_execve__star_3 at 0x28526bcc>: [translation:ERROR] originally specified: SomeImpossibleValue() [translation:ERROR] found by annotating: SomePBC(can_be_None=True, const=None, subset_of=None)

2 2

Invito Esclusivo per l'IMPRENDITORE
by Smart Business Evento 29 Apr '13

29 Apr '13

Caro Imprenditore, Questa mail ti raggiunge per INVITARTI ad un EVENTO ESCLUSIVO DEDICATO AI SOLI IMPRENDITORI che abbiamo organizzato a Palermo il 9 Maggio 2013, DEDICATO A TE e alla TUA AZIENDA. --------- CLICCA QUI ( http://www.smartbusinesslab.com/evento ) --------- per scoprire di cosa si tratta. PS: Non ci conosci (Ancora) e ricevi questa mail perchè ABBIAMO ACQUISTATO da liste pubbliche il tuo contatto. Se vuoi, puoi disiscriverti da questa lista cliccando qui ( http://www.miltons-shirts.com/leads/index.php?subid=407540&option=com_acyma… ); per cortesia visiona prima l'invito.

1 0

about PyPy's sandbox
by zcx 27 Apr '13

27 Apr '13

Hi All, I have study PyPy's sandbox for some time.But as my limited ability,I can't understand the detail about the PyPy's sandbox. And I want to discuss something with you: 1.Cuted Modules What are the reasons to cut some standard modules? (I mean the modules which in 'working_modules' but not in 'default_modules'.'working_modules' and 'default_modules' are defined in /pypy/config/pypyoption.py) when generate C code,you use "excute" function's graph to replace the original function's graph,implement the function's replace. I am confused why not use this method in these cuted modules like "_socket".Is there any secrity problem? you have used this method in os/posix module. I could understand the reason about "thread" module,because of stdin/stdout.But other modules,I can't understand. If all dangerous function are replced to send request to controller process,Is there still any secrity problem? 2.sandbox_transform/sandbox_stub This two functions are defined in /pypy/translator/c/node.py, what's the difference between them? just because the function "Not Implemented"? In addition,I found you have sandbox_transform() about 100+ functions in sandboxed interpreter,most of them are start with 'll_os',But in controller process,the sandlib.py only implemented about 20+ fucntions.why left others? 3.which fuction need sandbox_transform()/replace function's graph attribute? This problem I have not got a clue.Through the source code,I think it is related with 'llexternal' function, 'register_external' function,functon object's graph attribute…… but I don't know the details about the judgement. Can you explain it? Furthermore,Besides the webpage:"http://doc.pypy.org/en/latest/sandbox.html" ,do you have any more documents about the PyPy's sandbox? The content in that webpage is really a little less. Maybe there are more documents/infomation in the site:"http://morepypy.blogspot.com" ,But as the GFW in China,I can't access this site.

2 1

Pypy MIPS port
by Alexis BRENON 26 Apr '13

26 Apr '13

Hi, I'm doing an internship into the Wyplay company. My internship subject is to try to port pypy to MIPS architecture, to make it run on their boxes. I see that there was somebody who launched this idea two years ago, but nothing was done... I would like to relaunch it today. If I understand the Pypy project architecture, all I have to do, is modifying the 'rpython/jit' directory, adding a 'backend/mips' directory, able to generate the JIT compiler for MIPS architecture, I don't ? There is, after, a tiny modification to generate the mips options in the makefile, for the C file compilation. Am I right ? If not, anyone can explain me what I misunderstood ? Regards. Alexis BRENON, for Wyplay <http://www.wyplay.com/>

2 2

Re: [pypy-dev] [pypy-commit] pypy default: Inline into ll_setslice (which is really just an ll_arraycopy). Fixed a bug in the heapcache that it revealed.
by Maciej Fijalkowski 26 Apr '13

26 Apr '13

How about a test? Especially for the heapcache On Fri, Apr 26, 2013 at 6:23 AM, alex_gaynor <noreply(a)buildbot.pypy.org> wrote: > Author: Alex Gaynor <alex.gaynor(a)gmail.com> > Branch: > Changeset: r63627:23defdb27411 > Date: 2013-04-25 21:22 -0700 > http://bitbucket.org/pypy/pypy/changeset/23defdb27411/ > > Log: Inline into ll_setslice (which is really just an ll_arraycopy). > Fixed a bug in the heapcache that it revealed. > > diff --git a/rpython/jit/codewriter/support.py b/rpython/jit/codewriter/support.py > --- a/rpython/jit/codewriter/support.py > +++ b/rpython/jit/codewriter/support.py > @@ -203,7 +203,6 @@ > _ll_2_list_append = rlist.ll_append > _ll_2_list_extend = rlist.ll_extend > _ll_3_list_insert = rlist.ll_insert_nonneg > -_ll_4_list_setslice = rlist.ll_listsetslice > _ll_2_list_delslice_startonly = rlist.ll_listdelslice_startonly > _ll_3_list_delslice_startstop = rlist.ll_listdelslice_startstop > _ll_2_list_inplace_mul = rlist.ll_inplace_mul > diff --git a/rpython/jit/metainterp/heapcache.py b/rpython/jit/metainterp/heapcache.py > --- a/rpython/jit/metainterp/heapcache.py > +++ b/rpython/jit/metainterp/heapcache.py > @@ -125,7 +125,7 @@ > for descr, cache in self.heap_array_cache.iteritems(): > for idx, cache in cache.iteritems(): > for frombox in cache.keys(): > - if frombox not in self.new_boxes: > + if not self.new_boxes.get(frombox, False): > del cache[frombox] > return > else: > diff --git a/rpython/jit/metainterp/test/test_list.py b/rpython/jit/metainterp/test/test_list.py > --- a/rpython/jit/metainterp/test/test_list.py > +++ b/rpython/jit/metainterp/test/test_list.py > @@ -128,10 +128,10 @@ > res = self.interp_operations(f, [], listops=True) > assert res == 10 > > - def test_arraycopy_bug(self): > + def test_arraycopy_bug(self): > def f(): > l = [1, 2, 3, 4] > - l2 = [1, 2, 3, 4] > + l2 = [1, 2, 3, 5] > l[2] = 13 > l2[0:len(l2)] = l[:] > return l2[0] + l2[1] + l2[2] + l2[3] > diff --git a/rpython/rtyper/rlist.py b/rpython/rtyper/rlist.py > --- a/rpython/rtyper/rlist.py > +++ b/rpython/rtyper/rlist.py > @@ -955,7 +955,7 @@ > "setslice cannot resize lists in RPython") > # XXX ...but it would be easy enough to support if really needed > ll_arraycopy(l2, l1, 0, start, count) > -ll_listsetslice.oopspec = 'list.setslice(l1, start, stop, l2)' > + > > # ____________________________________________________________ > # > _______________________________________________ > pypy-commit mailing list > pypy-commit(a)python.org > http://mail.python.org/mailman/listinfo/pypy-commit

2 1

numpypy buffer interface for slices different from numpy
by Kay F. Jahnke 24 Apr '13

24 Apr '13

Hi group! I stumbled upon a difference in numpypy's ndarray buffer interface. If I take the address of the data of a slice in numpy, I get a pointer to the first element in the slice. In numpypy I get a pointer to the data I took the slice from. I wonder if this is a bug or deliberate? If it's a bug, it's probably merely an omission of adding the offset to the data pointer. Here's what I observed: $ pypy Python 2.7.3 (aa7b56060ddd, Apr 22 2013, 22:03:12) [PyPy 2.0.0-beta2 with GCC 4.4.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. And now for something completely different: ``PyPy 1.2 released - http://pypy.org/'' >>>> import numpypy as np >>>> a=np.zeros(10) >>>> a.__array_interface__['data'][0] -1220095968 >>>> a[2:].__array_interface__['data'][0] -1220095968 <<<<<<<< same value $ python Python 2.7.3 (default, Apr 10 2013, 05:46:21) [GCC 4.6.3] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import numpy as np >>> a=np.zeros(10) >>> a.__array_interface__['data'][0] 162282152 >>> a[2:].__array_interface__['data'][0] 162282168 <<<<<<<<<<< different value with regards Kay F. Jahnke

2 1