memory consumption
Inada Naoki
songofacandy at gmail.com
Wed Mar 31 07:15:48 EDT 2021
> ********** Before first run:
> # arenas allocated total = 776
> # arenas reclaimed = 542
> # arenas highwater mark = 234
> # arenas allocated current = 234
> 234 arenas * 262144 bytes/arena = 61,341,696
> ********** After first run:
> # arenas allocated total = 47,669
> # arenas reclaimed = 47,316
> # arenas highwater mark = 10,114
> # arenas allocated current = 353
> 353 arenas * 262144 bytes/arena = 92,536,832
> ********** After second run:
> # arenas allocated total = 63,635
> # arenas reclaimed = 63,238
> # arenas highwater mark = 10,114
> # arenas allocated current = 397
> 397 arenas * 262144 bytes/arena = 104,071,168
OK, memory allocated by obmalloc is 61MB -> 92MB -> 104MB.
Memory usage increasing, but it is much smaller than 1GB. 90% memory
is allocated by malloc().
You should try jemalloc. Trying jemalloc is not hard. You don't need
to rebuild Python.
Google "<your platform> jemalloc LD_PRELOAD".
--
Inada Naoki <songofacandy at gmail.com>
More information about the Python-list
mailing list