[Numpy-discussion] Accessing data in a large file

Simon Lyngby Kokkendorff silyko at gmail.com
Thu Jun 17 14:59:45 EDT 2010


Thanks for the references to these libraries - they seem to fix my problem!

Cheers,
Simon


On Thu, Jun 17, 2010 at 2:58 PM, davide <lasagnadavide at gmail.com> wrote:

> You may have a look to the nice python-h5py module, which gives an OO
> interface to the underlying hdf5 file format. I'm using it for storing
> large amounts (~10Gb) of experimental data. Very fast, very convenient.
>
> Ciao
>
> Davide
>
> On Thu, 2010-06-17 at 08:33 -0400, greg whittier wrote:
> > On Thu, Jun 17, 2010 at 4:21 AM, Simon Lyngby Kokkendorff
> > <silyko at gmail.com> wrote:
> > > memory errors. Is there a way to get numpy to do what I want, using an
> > > internal platform independent numpy-format like .npy, or do I have to
> wrap a
> > > custom file reader with something like ctypes?
> >
> > You might give http://www.pytables.org/ a try.
> > _______________________________________________
> > NumPy-Discussion mailing list
> > NumPy-Discussion at scipy.org
> > http://mail.scipy.org/mailman/listinfo/numpy-discussion
>
>
> _______________________________________________
> NumPy-Discussion mailing list
> NumPy-Discussion at scipy.org
> http://mail.scipy.org/mailman/listinfo/numpy-discussion
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/numpy-discussion/attachments/20100617/5b58ab2e/attachment.html>


More information about the NumPy-Discussion mailing list