[Distutils] PyPI index workaround

[Steve Dower]

I'm also interested (for the same support in Visual Studio) though we're unaffected by this change.

A batch API to get info for many packages would be great. Currently we scrape simple and then post JSON queries for individual packages.

Cheers,
Steve

Top-posted from my Windows Phone

-----Original Message-----
From: "Михаил Голубев" <qsolo825 at gmail.com>
Sent: ‎7/‎13/‎2016 13:04
To: "Donald Stufft" <donald at stufft.io>
Cc: "distutils-sig at python.org" <distutils-sig at python.org>
Subject: Re: [Distutils] PyPI index workaround

I'm sorry, I should have posted my commentary here, not in the separate thread.
 
We have some issues with suggested "/simple" endpoint. Despite the need to scrap the web page, old endpoint allowed us to quickly find latest versions of the packages hosted on PyPI. We did a single request on IDE startup and showed outdated installed packages in the settings later. Index "/simple" however contains only package names and links to the dedicated pages with their artifacts (not for each of them, though). It means that now we have to make tons of individual requests to find the latest published version for each installed package. Isn't it going to load the service even worse?


So, yes, we're interested most in the latest version of a package. 


2016-07-13 21:57 GMT+03:00 Donald Stufft <donald at stufft.io>:



On Jul 13, 2016, at 2:43 PM, Dmitry Trofimov <dmitry.trofimov at jetbrains.com> wrote:


Hi,


to have information about available packages, PyCharm IDE currently parses
the PyPI index page (https://pypi.python.org/pypi?%3Aaction=index).
As it is going to be deprecated soon, we are looking for a workaround.


What we need is, making one request, to get the name and the version of all PyPI packages. Then we cache this information in the IDE (https://github.com/JetBrains/intellij-community/blob/7e16c042a19767d5f548c84f88cc5edd5f9d1721/python/src/com/jetbrains/python/packaging/PyPIPackageUtil.java).


By name and version, do you mean the latest version?


—
Donald Stufft








_______________________________________________
Distutils-SIG maillist  -  Distutils-SIG at python.org
https://mail.python.org/mailman/listinfo/distutils-sig







-- 

Best regards
Mikhail Golubev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20160713/ac100c80/attachment-0001.html>