[Tutor] Trying to parse a HUGE(1gb) xml file in python
Stefan Behnel
stefan_ml at behnel.de
Tue Dec 21 11:22:36 CET 2010
Alan Gauld, 21.12.2010 10:46:
> You don't have to use it for data transfer - eg MS's use
> as a document storage format in Office - but frankly if
> you use XML to store large volumes of data you are mad,
> a database is a much more sensible option being far more
> space efficient and faster to work with.
Even "storing large volumes of data" in XML can be perfectly ok. It depends
on the use case. Database storage formats are not generally portable, for
example, but they provide fast online access. Totally different use cases.
Nothing's inherently wrong with storing large amounts of data in
(compressed) XML for medium to long term storage or data exchange, and
loading them back into a database to make the data quickly accessible for
heavy processing.
Stefan
More information about the Tutor
mailing list