[Numpy-discussion] fast numpy.fromfile skipping data chunks

Francesc Alted francesc at continuum.io
Wed Mar 13 10:53:38 EDT 2013


On 3/13/13 2:45 PM, Andrea Cimatoribus wrote:
> Hi everybody, I hope this has not been discussed before, I couldn't find a solution elsewhere.
> I need to read some binary data, and I am using numpy.fromfile to do this. Since the files are huge, and would make me run out of memory, I need to read data skipping some records (I am reading data recorded at high frequency, so basically I want to read subsampling).
[clip]

You can do a fid.seek(offset) prior to np.fromfile() and the it will 
read from offset.  See the docstrings for `file.seek()` on how to use it.

-- 
Francesc Alted




More information about the NumPy-Discussion mailing list