10GB XML Blows out Memory, Suggestions?
tganss_at_t_dash_online_dot_de-remove-all-after-first-real-dash at yahoo.com
Thu Jun 8 09:56:35 CEST 2006
>>medium. Even a SQLite database table should do better, and you can ship it
>>around just like a file (just can't open it up like a text file).
> A table helps only if the data is tabular (i.e. a single relation),
> i.e. probably never (otherwise the sending side would have shipped
> something like CSV).
Perhaps the previous poster meant "database file", which for some
systems describes the "container" of the whole database. If the XML has
redundancies represented in "linked" data, data normalization can cut
down on the needed space.
my 0.02 EUR
More information about the Python-list