[Python-Dev] Python 3.0.1 (io-in-c)
solipsis at pitrou.net
Wed Jan 28 01:39:37 CET 2009
Daniel Stutzbach <daniel <at> stutzbachenterprises.com> writes:
> For the "10MB whole contents at once" test, we then have:
> (assuming the code does no pipelining of disk I/O with decoding)
> 10MB / 980MB/s to read from disk = 10 ms
> 10MB / 250MB/s to decode to utf8 = 40 ms
> 10MB / (10ms + 40ms) = 200 MB/s
> In practice, your results shows around 90 MB/s. That's at least vaguely in
> the same ballpark.
Yes, the remaining CPU time is spent in the IncrementalNewlineDecoder (which
does universal newline translation).
More information about the Python-Dev