Max files in unix folder from PIL process

David Pratt fairwinds at eastlink.ca
Mon Mar 28 20:39:05 EST 2005


Hi Jason.  Many thanks your reply.  This is good to know about ls - 
what did it do? Was it just slow or did the server or machine die? My 
images  will be going into the path of a web server.  This is 
unchartered territory for me and I don't know whether there will be 
speed and access problems or how the filesystem copes with this kind of 
volume.

I am definitely planning to split the images into directories by size 
and that will at least divide the number by a factor of the various 
sizes (but on the higher end this could still be between 150 - 175 
thousand images which is still a pretty big number.  I don't know if 
this will be a problem or not or there is really anything to worry 
about at all - but it is better to obtain advice from those that have 
been there, done that - or are at least a bit more familiar with 
pushing limits on Unix resources than to wonder whether it will work.

Regards,
David

On Monday, March 28, 2005, at 07:18 PM, Kane wrote:

> I ran into a similar situation with a massive directory of PIL
> generated images (around 10k).  No problems on the filesystem/Python
> side of things but other tools (most noteably 'ls') don't cope very
> well.    As it happens my data has natural groups so I broke the big
> dir into subdirs to sidestep the problem.
>
> -- 
> http://mail.python.org/mailman/listinfo/python-list
>



More information about the Python-list mailing list