writing large files quickly

Grant Edwards grante at visi.com
Fri Jan 27 16:16:36 EST 2006

On 2006-01-27, rbt <rbt at athop1.ath.vt.edu> wrote:

> OK, I'm still trying to pick my jaw up off of the floor. One
> question...  how big of a file could this method create? 20GB,
> 30GB, limit depends on filesystem, etc?

Right.  Back in the day, the old libc and ext2 code had a 2GB
file size limit at one point (it used an signed 32 bit value
to keep track of file size/position).  That was back when 1GB
drive was something to brag about, so it wasn't a big deal for
most people.

I think everthing has large file support is enabled by default
now, so the limit is 2^63 for most "modern" filesystems --
that's the limit of the file size you can create using the
seek() trick.  The limit for actual on-disk bytes may not be
that large.

Here's a good link:


Grant Edwards                   grante             Yow!  I'm GLAD I
                                  at               remembered to XEROX all
                               visi.com            my UNDERSHIRTS!!

More information about the Python-list mailing list