Pythonic infinite for loop?
no.email at nospam.invalid
Fri Apr 15 12:10:18 EDT 2011
Chris Angelico <rosuav at gmail.com> writes:
> This whole code is inside a loop that we took, in smoke testing, to a
> couple hundred million rows (I think), with the intention of having no
> limit at all. So this might only look at 60-100 headers, but it will
> be doing so in a tight loop.
If you're talking about data sets that large, you should rethink the
concept of using python dictionaries with a key for every row. Try
importing your CSV into an SQL database and working from there instead.
More information about the Python-list