[Numpy-discussion] fast numpy.fromfile skipping data chunks

Francesc Alted francesc at continuum.io
Wed Mar 13 11:04:31 EDT 2013

On 3/13/13 3:53 PM, Francesc Alted wrote:
> On 3/13/13 2:45 PM, Andrea Cimatoribus wrote:
>> Hi everybody, I hope this has not been discussed before, I couldn't 
>> find a solution elsewhere.
>> I need to read some binary data, and I am using numpy.fromfile to do 
>> this. Since the files are huge, and would make me run out of memory, 
>> I need to read data skipping some records (I am reading data recorded 
>> at high frequency, so basically I want to read subsampling).
> [clip]
> You can do a fid.seek(offset) prior to np.fromfile() and the it will 
> read from offset.  See the docstrings for `file.seek()` on how to use it.

Ups, you were already using file.seek().  Disregard, please.

Francesc Alted

More information about the NumPy-Discussion mailing list