Pythonic infinite for loop?

Paul Rubin at nospam.invalid
Fri Apr 15 12:10:18 EDT 2011

Chris Angelico <rosuav at> writes:
> This whole code is inside a loop that we took, in smoke testing, to a
> couple hundred million rows (I think), with the intention of having no
> limit at all. So this might only look at 60-100 headers, but it will
> be doing so in a tight loop.

If you're talking about data sets that large, you should rethink the
concept of using python dictionaries with a key for every row.  Try
importing your CSV into an SQL database and working from there instead.

More information about the Python-list mailing list