[Distutils] on integrated docs in Warehouse and PyPI

[Nick Coghlan]

On 4 Jun 2016 6:54 am, "Donald Stufft" <donald at stufft.io> wrote:
>
>
>> On Jun 4, 2016, at 9:33 AM, Nathaniel Smith <njs at pobox.com> wrote:
>>
>> I think everyone would agree that having some nice doc hosting service
available as an option would be, well, nice. Everyone likes options. But
the current doc hosting is unpopular and feature poor, falls outside of the
PyPI core mission, and is redundant with other more popular services, at a
time when the PyPI developers are struggling to maintain core services.
>
>
>
> To add to what Nathaniel said here, there are a few problems with the
current situation:
>
> Documentation hosting largely worked “OK” when it was just writing files
out to disk, however we’ve since removed all use of the local disk (so that
we can scale past 1 machine) and we’re now storing things in S3. This makes
documentation hosting particularly expensive in terms of API calls because
we need to do expensive list key operations to discover which files exist
(versus package files where we have a database full of files).

Amazon do offer higher level alternatives like https://aws.amazon.com/efs/
for use cases like PyPI's docs hosting that assume they have access to a
normal filesystem.

Given the credential management benefits of integrated docs, it does seem
worthwhile to me for the PSF to invest in a lowest common denominator
static file hosting capability, even if we also use the PyPI project admin
pages to promote ReadTheDocs and the static site hosting offered by version
control hosting companies.

Regards,
Nick.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20160604/c223fe79/attachment.html>