[Python-Dev] PEP for new dictionary implementation

Mark Shannon mark at hotpy.org
Fri Feb 17 14:10:51 CET 2012


On 16/02/12 20:45, Antoine Pitrou wrote:
>
> On Wed, 08 Feb 2012 19:18:14 +0000
> Mark Shannon<mark at hotpy.org>  wrote:
>> Proposed PEP for new dictionary implementation, PEP 410?
>> is attached.
>>
>
> So, I'm running a few benchmarks using Twisted's test suite
> (see https://bitbucket.org/pitrou/t3k/wiki/Home).
>
> At the end of `python -i bin/trial twisted.internet.test`:
> ->  vanilla 3.3: RSS = 94 MB
> ->  new dict:    RSS = 91 MB
>
> At the end of `python -i bin/trial twisted.python.test`:
> ->  vanilla 3.3: RSS = 31.5 MB
> ->  new dict:    RSS = 30 MB
>
> At the end of `python -i bin/trial twisted.conch.test`:
> ->  vanilla 3.3: RSS = 68 MB
> ->  new dict:    RSS = 42 MB (!)
>
> At the end of `python -i bin/trial twisted.trial.test`:
> ->  vanilla 3.3: RSS = 32 MB
> ->  new dict:    RSS = 30 MB
>
> At the end of `python -i bin/trial twisted.test`:
> ->  vanilla 3.3: RSS = 62 MB
> ->  new dict:    RSS = 78 MB (!)

In theory, new-dict should never use more a few kbs more than vanilla.
That looks like a serious leak. I'll investigate as soon as I get a chance.
Which revision of new-dict are you using?

Cheers,
Mark.
>
> Runtimes were mostly similar in these test runs.
>
> Perspective broker benchmark (doc/core/benchmarks/tpclient.py and
> doc/core/benchmarks/tpserver.py):
> ->  vanilla 3.3: 422 MB/sec
> ->  new dict:    402 MB/sec
>
> Regards
>
> Antoine.
>
>
> _______________________________________________
> Python-Dev mailing list
> Python-Dev at python.org
> http://mail.python.org/mailman/listinfo/python-dev
> Unsubscribe: http://mail.python.org/mailman/options/python-dev/mark%40hotpy.org



More information about the Python-Dev mailing list