[SciPy-User] recommendation for saving data

[Paul Anton Letnes]

I would recommend writing and reading hdf5 with h5py (though there are other python packages). I find h5py to be very convenient in python, and the hdf5 library + wrappers exist for C, C++, Fortran90, and Java (and probably more).

The hdf5 format is platform independent and processor architecture independent - that's one of their design goals.

http://alfven.org/wp/hdf5-for-python/
http://www.hdfgroup.org/HDF5/

Paul


On 31. juli 2011, at 14.48, Brian Blais wrote:

> Hello,
> 
> I was wondering if there are any recommendations for formats for saving scientific data.  I am running a simulation, which has many somewhat-indepedent parts which have their own internal state and parameters.  I've been using pickle (gzipped) to save the entire object (which contains subobjects, etc...), but it is getting too unwieldy and I think it is time to look for a more robust solution.  Ideally I'd like to have something where I can call a save method on the simulation object, and it will call the save methods on all the children, on down the line all saving into one file.  It'd also be nice if it were cross-platform, and I could depend on the files being readable into the future for a while.
> 
> Are there any good standards for this?  What do you use for saving scientific data?
> 
> 
> 		thank you,
> 
> 			Brian Blais
> 
> 
> 
> -- 
> Brian Blais
> bblais at bryant.edu
> http://web.bryant.edu/~bblais
> http://bblais.blogspot.com/
> 
> 
> 
> _______________________________________________
> SciPy-User mailing list
> SciPy-User at scipy.org
> http://mail.scipy.org/mailman/listinfo/scipy-user