[Distutils] Warehouse update: a week of testing, polish, & infrastructure

Sumana Harihareswara sh at changeset.nyc
Tue Feb 27 15:53:13 EST 2018

This week we're publicizing pypi.org to package maintainers and asking
them/you to test it, and to spread the word to other package maintainers
you know.[1][2]

And we're probably within two or three weeks of the big public beta,
given the existing open Warehouse issues in the next milestone,[3] the
new issues we'll open based on user testing this week, and the
infrastructure work in play. You can learn more in our weekly meeting

We've been doing lots of performance and memory consumption work as we
harden our infrastructure and codebase to make them production-ready,
lots of polish as we get more testers and get their feedback.Examples:

   * reduce columns pulled for main project view in admin[5]
   * Guard against all tuples in metadata upload[6]
   * Add table style to project description, clean up titles[7]
   * Add SQLAlchemy error fix to troubleshooting docs[8]
   * Update PyPI migration info in packaging guide[9]

And thanks to volunteers:

    * alex for "Don't install g++ from a PPA in travis"[10]
    * wasim for "Added help entry for File already exists error"[11]
    * HndrkMkt for "Redirect authenticated user from reset pw pages to

Our infrastructure work included more improvements to cabotage[13] --
see Ernest's demo[14]:

> It’s super rough… but here’s first light of an end to end deployment
on this thing I been building.  still plenty of work to do, but already
chock full of automated end-to-end TLS, secure storage of secrets with
Vault, a bucket of Kubernetes, enough docker to make your head spin...

And our infrastructure work included a restart of Nicole's user testing,
both with the broad publicity to package maintainers and with Nicole
leading folks through one-on-one exercises and data-gathering sessions.
More about Nicole's current design process is in her blog update.[15]

Some issue discussion this week that you might find relevant:

    * Which 3rd party services should we contact about the new pypi.org
    * APIs/feeds issues got a bit more sorted[17] -- and if there's
anything you need in our API docs[18] that isn't in there, please let us
    * What should we show as the default search result on
https://pypi.org/search/ ?[19]
    * What do new developers need in architecture documentation?[20]
    * Should we rename the "/legacy" URL?[21]

As usual, you can get an overview of Warehouse development at our GitHub
rollout board[22] And if you want to help out, this week, please do test
the site, come to our IRC livechat hours, and spread the word.

Thanks to Mozilla for their support for the PyPI & Warehouse work, and
thanks to the Python Software Foundation for coordinating it![23][24]

[3] https://github.com/pypa/warehouse/milestone/10
[4] https://wiki.python.org/psf/PackagingWG/2018-02-26-Warehouse
[5] https://github.com/pypa/warehouse/pull/3043
[6] https://github.com/pypa/warehouse/pull/3049
[7] https://github.com/pypa/warehouse/pull/3040
[8] https://github.com/pypa/warehouse/pull/3048
[9] https://github.com/pypa/python-packaging-user-guide/pull/439
[10] https://github.com/pypa/warehouse/pull/3037
[11] https://github.com/pypa/warehouse/pull/2997
[12] https://github.com/pypa/warehouse/pull/2988
[13] https://github.com/cabotage/cabotage-app
[14] https://twitter.com/EWDurbin/status/968315460101042176
[16] https://github.com/pypa/warehouse/issues/2935
[18] https://warehouse.readthedocs.io/api-reference/
[19] https://github.com/pypa/warehouse/issues/3062
[20] https://github.com/pypa/warehouse/issues/2794
[21] https://github.com/pypa/warehouse/issues/2285
[22] https://github.com/pypa/warehouse/projects/1

Sumana Harihareswara
Changeset Consulting

More information about the Distutils-SIG mailing list