Raymond's proposed new dict layout
Hi all, I've been wondering whether the recipe that Raymond Hettinger posted would also solve PyPy's performance problems with making huge dictionaries: http://code.activestate.com/recipes/578375/ The proposed layout makes the pointer-storing part of the dictionary behave much more like a list. In particular, the write pattern is much more regular, so the card-marking techniques we use for lists should be applicable. Any thoughts? Cheers, Carl Friedrich
Hi Carl Friedrich, On Wed, Dec 12, 2012 at 2:03 PM, Carl Friedrich Bolz <cfbolz@gmx.de> wrote:
I've been wondering whether the recipe that Raymond Hettinger posted would also solve PyPy's performance problems with making huge dictionaries:
Yes, we've been wondering the same thing on IRC :-) Armin
On 12/12/2012 02:26 PM, Armin Rigo wrote:
Hi Carl Friedrich,
On Wed, Dec 12, 2012 at 2:03 PM, Carl Friedrich Bolz <cfbolz@gmx.de> wrote:
I've been wondering whether the recipe that Raymond Hettinger posted would also solve PyPy's performance problems with making huge dictionaries:
Yes, we've been wondering the same thing on IRC :-)
Ah, cool. Guess I should join the channel again :-). When was that? Couldn't find the logs. Carl Friedrich
Hi Carl Friedrich, On Wed, Dec 12, 2012 at 3:00 PM, Carl Friedrich Bolz <cfbolz@gmx.de> wrote:
Ah, cool. Guess I should join the channel again :-). When was that? Couldn't find the logs.
The 10th, 17:31 (http://www.tismer.com/pypy/irc-logs/pypy/pypy.2012-12-10.log). A bientôt, Armin.
On 12/12/2012 03:11 PM, Armin Rigo wrote:
Hi Carl Friedrich,
On Wed, Dec 12, 2012 at 3:00 PM, Carl Friedrich Bolz <cfbolz@gmx.de> wrote:
Ah, cool. Guess I should join the channel again :-). When was that? Couldn't find the logs.
The 10th, 17:31 (http://www.tismer.com/pypy/irc-logs/pypy/pypy.2012-12-10.log).
Thanks. I guess what would be needed is an implementation to be able to measure the differences. I don't think it possible to find out by arguing whether one is inherently better. Maybe over Christmas :-). Cheers, Carl Friedrich
participants (2)
-
Armin Rigo -
Carl Friedrich Bolz