[SciPy-User] Thinking in HDF5

[Maximilian Albert]

I agree with previous answers, h5py and pytables are good choices.

If you have the option of working a bit higher-level then definitely check
out 'odo' as well (which is part of the blaze ecosystem):


http://blaze.pydata.org/en/latest/csv.html#migrate-to-binary-storage-formats
   http://odo.readthedocs.org/en/latest/uri.html
   http://odo.readthedocs.org/en/latest/hdf5.html

I haven't used it in conjunction with HDF5 files yet, but used it to
convert CSV files to SQLite databases, and was totally blown away by how
easy it makes the conversion.

Cheers,
Max


2015-06-29 20:40 GMT+01:00 Jonathan Rocher <jonathanrocher at gmail.com>:

> Indeed h5py <http://www.h5py.org/> is a good library that is a direct
> wrapper of the C++ library and will expose most of the bells and whistles.
> I also recommend you take a look at pytables <http://www.pytables.org/>
> which is really nice to use, maybe a little more pythonic, and it
> integrates with numexpr <https://github.com/pydata/numexpr> for out of
> core computations.
>
> HTH,
> Jonathan
>
> On Mon, Jun 29, 2015 at 2:07 PM, Kevin Gullikson <
> kevin.gullikson at gmail.com> wrote:
>
>> Check out h5py <http://www.h5py.org/>. It should work for
>> reading/writing hdf5 files for you.
>>
>>
>> Kevin Gullikson
>> PhD Candidate
>> University of Texas Astronomy
>> RLM 15.310E
>>
>> On Mon, Jun 29, 2015 at 1:59 PM, nitin chandra <nitinchandra1 at gmail.com>
>> wrote:
>>
>>> Hello All,
>>>
>>> I have been on this for a long time and have done a lot of research /
>>> reading on this topic, HDF5.
>>>
>>> To use it for development of in-house software for design calculation
>>> of various alignments.
>>>
>>> A lot many time the basic alignment information is picked from a map /
>>> satellite imageries. Kilometre, ground level, geographic feature on
>>> the proposed route, etc. , in a csv file.
>>>
>>> Any where between 7-9 files are generated for each alignment.
>>>
>>> 1. How to read / write data into the HDF5 file ? What after creating
>>> root ?
>>>
>>> 2. In a regular situation, I have 2 input file with 3 column csv data,
>>> and 2 output files.
>>> How to do that within the same root ?
>>>
>>> Will be working in Python and c / c++.
>>>
>>> This is just the basic. If I can do this much, I can do the rest,
>>> hopefully :)
>>>
>>> Thanks to All
>>>
>>> Nitin
>>>
>>> PS :- Will post in boost-user list too.
>>> _______________________________________________
>>> SciPy-User mailing list
>>> SciPy-User at scipy.org
>>> http://mail.scipy.org/mailman/listinfo/scipy-user
>>>
>>
>>
>> _______________________________________________
>> SciPy-User mailing list
>> SciPy-User at scipy.org
>> http://mail.scipy.org/mailman/listinfo/scipy-user
>>
>>
>
>
> --
> Jonathan Rocher
> Austin TX, USA
> http://www.linkedin.com/in/jonathanrocher
> -------------------------------------------------------------
>
> _______________________________________________
> SciPy-User mailing list
> SciPy-User at scipy.org
> http://mail.scipy.org/mailman/listinfo/scipy-user
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20150630/a87766c3/attachment.html>