[Python-ideas] Speed up os.walk() 5x to 9x by using file attributes from FindFirst/NextFile() and readdir()

Ben Hoyt benhoyt at gmail.com
Wed Nov 14 11:08:57 CET 2012


> One thing to keep in mind with these kind of metrics is that I/O latency is
> a major factor. Solid state vs spinning disk vs network drive is going to
> make a *big* difference to the relative performance of the different
> mechanisms.

Yeah, you're right. The benchmarks I've been doing are only stable
after the first run, when I suppose everything is cached and you've
taken most of the I/O latency out of the picture. I guess this also
means the speed-up for the first run won't be nearly as significant.
But I'll do some further testing.

-Ben



More information about the Python-ideas mailing list