Gael, Sounds very interesting! Would you mind sharing an example (with code if possible) of how you organize your experimental data in pytables. I have been thinking about how I might organize my data in pytables and would luv to hear how an experienced user does that. Given the speed differences it looks like pytables is going to be a better solution for my needs. Still curious however ... does no one on this list use (and like) sqlite? Could anyone suggest any other list where I might find users of python and sqlite (and numpy)? Thanks, Vincent On 7/20/07 1:16 AM, "Gael Varoquaux" <gael.varoquaux@normalesup.org> wrote:
On Thu, Jul 19, 2007 at 09:42:42PM -0500, Vincent Nijs wrote:
I'd luv to hear from people using sqlite, pytables, and cPickle about their experiences.
I was about to point you to this discussion: http://projects.scipy.org/pipermail/scipy-user/2007-April/011724.html
but I see that you participated in it.
I store data from each of my experimental run with pytables. What I like about it is the hierarchical organization of the data which allows me to save a complete description of the experiment, with strings, and extensible data structures. Another thing I like is that I can load this in Matlab (I can provide enhanced script for hdf5, if somebody wants them), and I think it is possible to read hdf5 in Origin. I don't use these software, but some colleagues do.
So I think the choices between pytables and cPickle boils down to whether you want to share the data with other software than Python or not.
Gaël _______________________________________________ Numpy-discussion mailing list Numpy-discussion@scipy.org http://projects.scipy.org/mailman/listinfo/numpy-discussion