[Catalog-sig] How about a dedicated web service mirror?

M.-A. Lemburg mal at egenix.com
Mon Apr 18 20:29:54 CEST 2011

Daniel Greenfeld wrote:
> Here is something that we all might find useful.
> When Python Packages launches it will be hitting the XMLRPC server
> over 10,000 times a day - at least once per listed package. Django
> Packages already hits PyPI about 3000 times a day. We'll be doing this
> in a distributed task queu but the fact remains that the server is
> going to be hit a decent amount.

Is that really necessary ?

PyPI has a mechanism to subscribe to recent changes only,
which should be enough for the needs of the sites you mention.

> Because of the relative ease of setting up the Packaginator tool these
> sites are building other people will also be using this same API. Or
> maybe they'll build their own system and do even more.
> So maybe dedicated mirrors that truncate the web UI and just provide
> the web service API?

Marc-Andre Lemburg

Professional Python Services directly from the Source  (#1, Apr 18 2011)
>>> Python/Zope Consulting and Support ...        http://www.egenix.com/
>>> mxODBC.Zope.Database.Adapter ...             http://zope.egenix.com/
>>> mxODBC, mxDateTime, mxTextTools ...        http://python.egenix.com/

::: Try our new mxODBC.Connect Python Database Interface for free ! ::::

   eGenix.com Software, Skills and Services GmbH  Pastor-Loeh-Str.48
    D-40764 Langenfeld, Germany. CEO Dipl.-Math. Marc-Andre Lemburg
           Registered at Amtsgericht Duesseldorf: HRB 46611

More information about the Catalog-SIG mailing list