Making a file-like object for manipulating a large file

Lawrence D'Oliveiro ldo at geek-central.gen.new_zealand
Sun Aug 26 11:55:37 CEST 2007

In message <1187920825.457886.7880 at>, Sean Davis

> I have a VERY large file that I would
> like to load a line at a time, do some manipulations on it, and then
> make it available to as a file-like object for use as input to a
> database module (psycopg2) that wants a file-like object (with read
> and readlines methods).  I could write the manipulated file out to
> disk and then read it back in, but that seems wasteful.

If your consumer doesn't need to seek, how about having it read from a pipe?

More information about the Python-list mailing list