Can XML-RPC performance be improved?

Fredrik Lundh fredrik at pythonware.com
Tue Mar 21 12:36:38 EST 2006


Sion Arrowsmith wrote:

> I've got an established client-server application here where there
> is now a need to shovel huge amounts of data (structured as lists of
> lists) between the two, and the performance bottleneck has become
> the amount of time spent parsing XML (it's taking 100% CPU on one or
> other end of the connection and accounting for well over 50% of the
> total call time, to the extent that it's having a greater impact on
> performance than user interaction). And this is using SGMLOP for
> parsing -- I dread to think what it would be like with a slower
> parser. Anyone (Fredrik?) got any good ideas for tackling this
> problem?

the cElementTree unmarshaller on this page

http://effbot.org/zone/element-iterparse.htm#incremental-decoding

is a bit faster than the one in xmlrpclib.  (to get more performance,
you probably need a library that allows you to register decoders on
the C level.)

</F>






More information about the Python-list mailing list