[Tutor] Trying to parse a HUGE(1gb) xml file in python

Eike Welk eike.welk at gmx.net
Tue Dec 21 11:51:34 CET 2010


On Tuesday 21.12.2010 10:12:55 David Hutto wrote:
> Then what other file medium would you suggest as the tagging means.

One of those formats, that are specially designed for large amounts of data, 
is HDF5. It is intended for numerical data, but you can store text as well. 
There are multiple Python libraries for it, the most feature rich is IMHO 
PyTables. 

http://www.pytables.org/moin


Eike.


More information about the Tutor mailing list