[Numpy-discussion] Enum/Factor NEP (now with code)
Thouis (Ray) Jones
thouis at gmail.com
Thu Jun 14 07:57:41 EDT 2012
On Wed, Jun 13, 2012 at 8:54 PM, Wes McKinney <wesmckinn at gmail.com> wrote:
> Nathaniel: my experience (see blog posting above for a bit more) is
> that khash really crushes PyDict for two reasons: you can use it with
> primitive types and avoid boxing, and secondly you can preallocate.
> Its memory footprint with large hashtables is also a fraction of
> PyDict. The Python memory allocator is not problematic-- if you create
> millions of Python objects expect the RAM usage of the Python process
> to balloon absurdly.
The other big reason to consider allowing khash (or some other hash
implementation) within numpy is that you can use it without the GIL.
More information about the NumPy-Discussion