Too many open files

Jeff jeffober at gmail.com
Mon Feb 4 14:06:40 CET 2008


Why don't you start around 50 threads at a time to do the file
writes?  Threads are effective for IO.  You open the source file,
start a queue, and start sending data sets to be written to the
queue.  Your source file processing can go on while the writes are
done in other threads.



More information about the Python-list mailing list