[Python-ideas] Speed up os.walk() 5x to 9x by using file attributes from FindFirst/NextFile() and readdir()
Ben Hoyt
benhoyt at gmail.com
Wed Nov 14 11:08:57 CET 2012
> One thing to keep in mind with these kind of metrics is that I/O latency is
> a major factor. Solid state vs spinning disk vs network drive is going to
> make a *big* difference to the relative performance of the different
> mechanisms.
Yeah, you're right. The benchmarks I've been doing are only stable
after the first run, when I suppose everything is cached and you've
taken most of the I/O latency out of the picture. I guess this also
means the speed-up for the first run won't be nearly as significant.
But I'll do some further testing.
-Ben
More information about the Python-ideas
mailing list