[Catalog-sig] PyPI XML-RPC multicall support

[ssteinerX@gmail.com]

On Dec 28, 2009, at 2:29 PM, Martin v. Löwis wrote:

> The PyPI XML-RPC server now supports multicalls, with a limit
> of 100 subcalls per multicall. So if you have an XML-RPC
> application that makes thousands of calls to PyPI in a short
> time, consider batching them. I was able to obtain a speedup
> of four in an application that tries to get all release data
> and urls.

Hey!  Don't know if anyone else cares, but I just added this to my little metadata mirror program to batch up all the releases for each package into one call and it made a huge difference.  I didn't bother to measure/time anything (it's already taking long enough!), but the improvement is noticeable as I watch the packages fly by.

Still trying to get one full set of data as my early attempts were, shall we say, not handling interruptions well...

BTW, could you look in the logs real quick and see if my program's User-Agent "pypimeta-mirror" is coming through properly on your end?

Thanks,

Steve

aka/ssteinerX
aka/Steve Steiner