[Numpy-discussion] fast numpy.fromfile skipping data chunks
francesc at continuum.io
Wed Mar 13 11:04:31 EDT 2013
On 3/13/13 3:53 PM, Francesc Alted wrote:
> On 3/13/13 2:45 PM, Andrea Cimatoribus wrote:
>> Hi everybody, I hope this has not been discussed before, I couldn't
>> find a solution elsewhere.
>> I need to read some binary data, and I am using numpy.fromfile to do
>> this. Since the files are huge, and would make me run out of memory,
>> I need to read data skipping some records (I am reading data recorded
>> at high frequency, so basically I want to read subsampling).
> You can do a fid.seek(offset) prior to np.fromfile() and the it will
> read from offset. See the docstrings for `file.seek()` on how to use it.
Ups, you were already using file.seek(). Disregard, please.
More information about the NumPy-Discussion