[Numpy-discussion] 2 i/o questions and an announcement

[Janko Hauser]

Rick White writes:
 > Pickling is fine if all you want to do is create data within Numeric
 > and save it.  But it's not useful either for reading data that already
 > exists in some format (the usual case) or for writing data in standard
 > formats so it can be exchanged with other people.

That's right. If you want to read binary formats, for which you know
the data layout the numpyio package from Travis Oliphant is very fast
and memory efficient, because it builds up the array during the
read/write so no copy of the data string needs to be in memory. I see
no other way to read other formats generally besides specific
wrappers, like the netcdf interface.

__Janko Hauser