Oddity with large dictionary (several million entries)
Lothar Werzinger
lothar at tradescape.biz
Tue Apr 27 15:14:10 EDT 2010
Peter Otten wrote:
> Lothar Werzinger wrote:
>> Can anyone explain this oddity? Any insight is highly appreciated.
>
> When you are creating objects like there is no tomorrow Python's cyclic
> garbage collections often takes a significant amount of time. The first
> thing I'd try is therefore switching it off with
>
> import gc
> gc.disable()
>
> Peter
Wow, that really MAKES a difference! Thanks a lot!
$ ~/tmp/dicttest.py -t 0
Inserting into one map
Inserting 1000000 keys lasted 0:00:01 (960152 1/s)
len(map) 1000000
Inserting 1000000 keys lasted 0:00:01 (846416 1/s)
len(map) 2000000
Inserting 1000000 keys lasted 0:00:04 (235241 1/s)
len(map) 3000000
total 3000000
$ ~/tmp/dicttest.py -t 1
Inserting into three maps
Inserting 1000000 keys lasted 0:00:01 (973344 1/s)
len(map) 1000000
Inserting 1000000 keys lasted 0:00:00 (1011303 1/s)
len(map) 1000000
Inserting 1000000 keys lasted 0:00:00 (1021796 1/s)
len(map) 1000000
total 3000000
<~/beacon>
Thanks!
--
Lothar
More information about the Python-list
mailing list