[Numpy-discussion] searchsorted() and memory cache

[Andrew Straw]

Charles R Harris wrote:
>
>
> On Wed, May 14, 2008 at 8:09 AM, Andrew Straw <strawman at astraw.com
> <mailto:strawman at astraw.com>> wrote:
>
>
>
>     Quite a difference (a factor of about 3000)! At this point, I haven't
>     delved into the dataset to see what makes it so pathological --
>     performance is nowhere near this bad for the binary search algorithm
>     with other sets of keys.
>
>
> It can't be that bad Andrew, something else is going on. And 191 MB
> isn's *that* big, I expect it should bit in memory with no problem.
I agree the performance difference seems beyond what one would expect
due to cache misses alone. I'm at a loss to propose other explanations,
though. Ideas?