[Distutils] Indexing modules in Python distributions

Jeremy Stanley fungi at yuggoth.org
Thu Feb 9 17:18:22 EST 2017

On 2017-02-08 18:14:38 +0000 (+0000), Thomas Kluyver wrote:
> What I'm proposing differs in that it would need to download files from
> PyPI - basically all of them, if we're thorough about it. I imagine
> that's going to involve a lot of data transfer. Do we know what order of
> magnitude we're talking about?

The crowd I run with uses https://pypi.org/project/bandersnatch/ to
maintain a full PyPI mirror for our project's distributed CI system,
and du says the current aggregate size is 488GiB. Also if you want
to initialize a full mirror this way, plan for it to take several
days to populate.
Jeremy Stanley

More information about the Distutils-SIG mailing list