[Numpy-discussion] Possible roadmap addendum: building better text file readers

[Robert Kern]

On Thu, Feb 23, 2012 at 21:09, Gael Varoquaux
<gael.varoquaux at normalesup.org> wrote:
> On Thu, Feb 23, 2012 at 04:07:04PM -0500, Wes McKinney wrote:
>> In this last case for example, around 500 MB of RAM is taken up for an
>> array that should only be about 80-90MB. If you're a data scientist
>> working in Python, this is _not good_.
>
> But why, oh why, are people storing big data in CSV?

Because everyone can read it. It's not so much "storage" as "transmission".

-- 
Robert Kern