[Numpy-discussion] searching binary data

Neal Becker ndbecker2 at gmail.com
Wed Sep 22 10:10:06 EDT 2010


A colleague of mine posed the following problem.  He wants to search large 
files of binary data for sequences.

I thought of using mmap (to avoid reading all data into memory at once) and 
then turning this into a numpy array (using buffer=).

But, how to then efficiently find a sequence? 

Note that I'm not committed to using numpy or mmap as part of the solution.




More information about the NumPy-Discussion mailing list