Mailman 3 - devpi-dev

Fwd: [pypi-announce] upgrade to pip 20.2 -- plus changes coming in 20.3
by Sumana Harihareswara July 31, 2020

July 31, 2020

A new pip is out. Please see below, upgrade, and let us know if devpi users start to have trouble. In particular, we need your feedback on the beta of the new dependency resolver, because we want to make it the default in the October release. We have a low-traffic, announce-only list to announce major changes to pip/PyPI -- subscribe at https://mail.python.org/mailman3/lists/pypi-announce.python.org/ . best, Sumana Harihareswara, pip project manager -------- Forwarded Message -------- … [View More]Subject: [pypi-announce] upgrade to pip 20.2 -- plus changes coming in 20.3 Date: Thu, 30 Jul 2020 11:24:58 -0400 From: Sumana Harihareswara <sh(a)changeset.nyc> Reply-To: distutils-sig(a)python.org Organization: Changeset Consulting To: pypi-announce(a)python.org On behalf of the Python Packaging Authority, I am pleased to announce the release of pip 20.2. Please upgrade for speed improvements, bug fixes, and better logging. You can install it by running python -m pip install --upgrade pip. We make major releases each quarter, so this is the first new release since 20.1 in April. NOTICE: This release includes the beta of the next-generation dependency resolver. It is significantly stricter and more consistent when it receives incompatible instructions, and reduces support for certain kinds of constraints files, so some workarounds and workflows may break. Please test it with the `--use-feature=2020-resolver` flag. Please see our guide on how to test and migrate, and how to report issues <https://pip.pypa.io/en/latest/user_guide/#changes-to-the-pip-dependency-res…>. The new dependency resolver is *off by default* because it is *not yet ready for everyday use*. For release highlights and thank-yous, please see <https://blog.python.org/2020/07/upgrade-pip-20-2-changes-20-3.html> . The full changelog is at <https://pip.pypa.io/en/stable/news/>. Future: We plan to make pip's next quarterly release, 20.3, in October 2020. We are preparing to change the default dependency resolution behavior and make the new resolver the default in pip 20.3. -- Sumana Harihareswara project manager for pip, on contract with Python Software Foundation Changeset Consulting, https://changeset.nyc _______________________________________________ pypi-announce mailing list -- pypi-announce(a)python.org To unsubscribe send an email to pypi-announce-leave(a)python.org https://mail.python.org/mailman3/lists/pypi-announce.python.org/ -- Sumana Harihareswara Changeset Consulting https://changeset.nyc [View Less]

2 2

Announcement: pip 20.1b1 beta release
by Sumana Harihareswara April 21, 2020

April 21, 2020

On behalf of the PyPA, I am pleased to announce that a beta release of pip, pip 20.1b1, has been released. The highlights for this release are: * Significant speedups when building local directories, by changing behavior to perform in-place builds, instead of copying to temporary directories. * Significant speedups in `pip list --outdated`, by parallelizing network access. This is the first instance of parallel code within pip's codebase. * A new `pip cache` command, which makes it possible … [View More]

1 0

PEP 458: Secure transport independent download integrity for PyPI packages
by Sumana Harihareswara Feb. 12, 2020

Feb. 12, 2020

Hi, devpi folks! I figure you might want to take a look at the PyPI security PEP currently being discussed, since I could imagine devpi wanting to also add TUF metadata handling for packages, and in case there are interoperability concerns/questions. https://discuss.python.org/t/pep-458-surviving-a-compromise-of-pypi/2648/ The PEP authors are revising the proposed summary, title, etc., per https://github.com/secure-systems-lab/peps/blob/c13384a4fac6822626abb7e09ab… : > Attacks on software … [View More]

1 1

Clean the index after purging old versions
by Patrick Mézard Jan. 15, 2020

Jan. 15, 2020

Hello, I have a devpi server where we have recently deleted a lot of old package versions, using devpi-client. The data directory now looks like: 7.6 GiB [##########] /.indices 956.5 MiB [# ] .sqlite 461.4 MiB [ ] /+files Is this expected? Is there any command to run to rebuild/purge the index? Thanks, -- Patrick Mézard

2 2

Strange errors: "While handling ... project does not exist"
by Nicholas Williams Jan. 8, 2020

Jan. 8, 2020

We're starting to roll out our new Devpi installation to projects now that we've tested it extensively. We have one master and three mirrors. For the purposes of this email, the mirrors are load-balanced behind the domain name "devpi.example.com," and the master is available at " primary-devpi-server.example.com." We configured our Pipenv and Pip installations to use this index URL: https://devpi.example.com/org_name/stable/+simple/ That URL will use the mirrors. The "org_name/stable" index … [View More]

2 6

Need help with reverse proxy config and Devi-Web
by Nicholas Williams Dec. 19, 2019

Dec. 19, 2019

I'm having trouble with a reverse-proxy config and could use some assistance. We have the following setup: LOAD BALANCER Accepts requests via the official hostname and HTTPS (port 443) Forwards requests to Devpi Nginx server Sends headers X-Forwaded-Port, X-Forwarded-Host, X-Forwarded-Proto matching the official hostname, HTTPS, and 443. DEVPI NGINX SERVER Accepts requests via port 80 Serves requests for +f files directly (works perfectly) Forwards remaining requests to Devpi Python server … [View More]

2 2

devpi-client 5.1.0 and devpi-pr 1.0.0 released
by Florian Schulze Oct. 31, 2019

Oct. 31, 2019

Hi! I released devpi-client 5.1.0 and devpi-pr 1.0.0. For devpi-client keyring support for devpi push to external indexes like pypi.org was added and it has some bugfixes. https://pypi.org/project/devpi-client/ With devpi-pr a pull request workflow can be added to devpi-server and devpi-client. https://pypi.org/project/devpi-pr/ Regards, Florian Schulze

1 0

devpi-server 5.2.0 and devpi-web 4.0.0 released
by Florian Schulze Oct. 19, 2019

Oct. 19, 2019

Hi! I released devpi-server 5.2.0 and devpi-web 4.0.0. See the changelogs at: https://pypi.org/project/devpi-server/ https://pypi.org/project/devpi-web/ Regards, Florian Schulze

1 0

Upcoming releases
by Florian Schulze Oct. 2, 2019

Oct. 2, 2019

Hi! I uploaded development releases for testing: https://m.devpi.net/fschulze/dev/devpi-web/4.0.0.dev1 https://m.devpi.net/fschulze/dev/devpi-server/5.2.0.dev0 These releases are drop-in updates. For devpi-web you might have to run ``--recreate-search-index`` in case you want to go back to a previous version. Besides that there are no changes preventing a downgrade. But it's best to test devpi-web on a replica which can be rebuilt if necessary. Speaking of rebuilding replicas: With the ``… [View More]--replica-file-search-path`` option and the ``--hard-links`` option it is possible to vastly cut down the replication time when you already have the files on disk. Either create the new replica in a new folder, or rename the old server folder to create the new replica in the same place. Then run the new replica with ``--replica-file-search-path old_location/+files --hard-links`` and while replicating the new replica will look for existing files in the specified location and create hard links if it finds one and it's checksum matches. As the version number already indicates, devpi-web has the biggest changes, namely dropping Python 2.7 support, a different way to index projects and several changes to templates which might require updates in themes: 4.0.0.dev1 (2019-09-18) ======================= Deprecations and Removals ------------------------- - Dropped support for Python 2.7. Features -------- - project.pt: implement #319 - add link to latest version and summary of latest version to project view - doc.pt: implement #339: when viewing older documentation, show link to latest and stable documentation. - implement #346: add support for 'latest' and 'stable' versions for project version URLs - version.pt, style.css: implement #347 - show navigation link when newer version is available - The search indexing is now performed in a separate thread. Indexing prioritizes private indexes, then projects downloaded from mirrors and lastly never downloaded projects from mirrors. - On server start a refresh run for the search index is started automatically. In addition to that the indexing is done in smaller batches, which allows resuming of indexing the large pypi project lists. - In many cases re-indexing is now avoided. - version.pt, common.js: all list like metadata is now collapsed to ~3 lines instead of only classifiers. - The ``--recreate-search-index`` option now just removes the whole index. Upon server restart the index is rebuilt automatically in the background. - With devpi-server 5.1.1 or newer, indexing of mirrors will not trigger a refresh of the simple links for projects which have downloaded releases. This allows quicker indexing for new replicas and in case the search index is rebuilt using ``--recreate-search-index``. - root.pt: added new view for user Bug Fixes --------- - Pass query string on to documentation iframe, this fixes Sphinx search among other things. Other Changes ------------- - macros.pt, version.pt, style.css: moved separators to css. - The minimum supported version of devpi-server is now 5.1.0. - The interface of ``update_projects`` for search indexers has changed. The list of projects is now a list of ``ProjectIndexingInfo`` objects instead of ``dict``. To get the dictionary as before, call ``preprocess_project`` on the object. 5.2.0.dev0 (2019-09-18) ======================= Features -------- - Metrics for the sqlite storage cache are exposed in the JSON output of the +status view. Bug Fixes --------- - fix #545: provide proper error message when there is an exception during push to an external repository. - Fix possible race condition when writing files. - Fix possible assertion error if importing multiple changes in a replica fails in the middle and fetching a single change set is tried as fallback. - For plugins the ``offline`` attribute of mirror stage instances now works independently of the ``--offline-mode`` command line option. This only applies to ``_perstage`` methods. - Files created in a transaction are written directly to temporary files instead of being kept in memory until commit. - Unnecessary database writes where the final value didn't change are now prevented. Other Changes ------------- - The timeout when fetching the list of remote projects for a mirror index is set to a minimum of 30s by default and to 60s when running as replica. Other fetches of mirrors still use the timeout specified via ``--request-timeout``. [View Less]

1 1

mirror_whitelist inheritance
by Florian Schulze Oct. 1, 2019

Oct. 1, 2019

Hi! There currently is an issue about mirror_whitelist that needs input from anyone who uses it together with inheritance (more than just root/pypi in bases). https://github.com/devpi/devpi/issues/725 Regards, Florian Schulze

1 0