[Numpy-discussion] Pickle, pytables, and sqlite - loading and saving recarray's

Vincent Nijs v-nijs at kellogg.northwestern.edu
Fri Jul 20 09:35:51 EDT 2007


Sounds very interesting! Would you mind sharing an example (with code if
possible) of how you organize your experimental data in pytables. I have
been thinking about how I might organize my data in pytables and would luv
to hear how an experienced user does that.

Given the speed differences it looks like pytables is going to be a better
solution for my needs.

Still curious however ... does no one on this list use (and like) sqlite?

Could anyone suggest any other list where I might find users of python and
sqlite (and numpy)?



On 7/20/07 1:16 AM, "Gael Varoquaux" <gael.varoquaux at normalesup.org> wrote:

> On Thu, Jul 19, 2007 at 09:42:42PM -0500, Vincent Nijs wrote:
>>    I'd luv to hear from people using sqlite, pytables, and cPickle about
>>    their experiences.
> I was about to point you to this discussion:
> http://projects.scipy.org/pipermail/scipy-user/2007-April/011724.html
> but I see that you participated in it.
> I store data from each of my experimental run with pytables. What I like
> about it is the hierarchical organization of the data which allows me to
> save a complete description of the experiment, with strings, and
> extensible data structures. Another thing I like is that I can load this
> in Matlab (I can provide enhanced script for hdf5, if somebody wants
> them), and I think it is possible to read hdf5 in Origin. I don't use
> these software, but some colleagues do.
> So I think the choices between pytables and cPickle boils down to whether
> you want to share the data with other software than Python or not.
> Gaël
> _______________________________________________
> Numpy-discussion mailing list
> Numpy-discussion at scipy.org
> http://projects.scipy.org/mailman/listinfo/numpy-discussion

More information about the NumPy-Discussion mailing list