Reading a large csv file

[Mag Gam]

Yes, the system has 64Gig of physical memory.


What I meant was, is it possible to load to a hdf5 dataformat
(basically NumPy array) without reading the entire file at first? I
would like to splay to disk beforehand so it would be a bit faster
instead of having 2 copies in memory.





On Tue, Jun 23, 2009 at 12:28 AM, Horace Blegg<tkjthingone at gmail.com> wrote:
> Do you even HAVE 14 gigs of memory? I can imagine that if the OS needs to
> start writing to the page file, things are going to slow down.
>
>
>
> --
> http://mail.python.org/mailman/listinfo/python-list
>
>