Hi! The way indexing is currently implemented in devpi-web has some performance issues. One problem is the number of registered projects on PyPI which creates a huge initial commit for new devpi instances which can take hours to complete and currently causes reads from PyPI which can fail at any point and abort the indexing. The other problem is, that any change in a project, even just a new version number causes a full reindex of the project, including it's full documentation if it exists. For the first issue I have a proposal, for the second I still have no idea, but the impact might be reduced. Use the following ticket to give thumbs up/down or whatever reaction, but keep discussions in this mail for now. https://github.com/devpi/devpi/issues/566 Regards, Florian Schulze