[Twisted-Python] Twisted on PyPI
![](https://secure.gravatar.com/avatar/ebf132362b622423ed5baca2988911b8.jpg?s=120&d=mm&r=g)
Hey there! Recently there has been a lot of work around packaging in Python. On my end of things I've been trying to clean up PyPI. Recently I've deployed a change that ensures that all *new* package names on PyPI conform to a strict set of rules. These rules are: - Must begin and end with an ASCII alphanumeric - Must contain only ASCII letters, digits, underscores, hyphens, and periods Now we are left with about 235 total projects out of ~31k who do not conform to these guidelines. Out of those 235 projects Twisted is one of the major ones (Not Twisted itself, but Twisted Web, Twisted Core, etc). Now the plan that we've come up with is to migrate any name that the only invalid characters are internal whitespace by replacing the whitespace with a -. This would Make Twisted Web Twisted-Web. This reflects already what is required to install Twisted Web via pip or easy_install. So I'm emailing you all to warn you about this upcoming change since Twisted is one of the major projects affected and also to see if the Twisted developers would prefer a different rename than Twisted-Web. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
![](https://secure.gravatar.com/avatar/ebf132362b622423ed5baca2988911b8.jpg?s=120&d=mm&r=g)
On May 29, 2013, at 5:24 PM, Tom Prince <tom.prince@ualberta.net> wrote:
I'm not familiar with whose who in Twisted land sorry. Any of the maintainers listed on the website will be capable of removing them, or if it's desired to have me do it in batch I require someone official like Glyph or so who does have access to request it of me. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
![](https://secure.gravatar.com/avatar/607cfd4a5b41fe6c886c978128b9c03e.jpg?s=120&d=mm&r=g)
On 29 May, 09:24 pm, tom.prince@ualberta.net wrote:
What are we removing? All of the subprojects on PyPI? If so, the release process will need to be adjusted to avoid re-adding them. What makes them uninstallable? Wouldn't it make as much sense to just fix that? Is this only a PyPI interaction thing, or is there actually a problem with the packages being distributed? Jean-Paul
![](https://secure.gravatar.com/avatar/e81edff3af564b86f4c9d780a8023299.jpg?s=120&d=mm&r=g)
exarkun@twistedmatrix.com writes:
If so, the release process will need to be adjusted to avoid re-adding them. https://twistedmatrix.com/trac/wiki/ReleaseProcess?action=diff&version=164&old_version=163
It is just that pypi doesn't (didn't, now that they are deleted) have the necessary metadata to install them. My understanding was that we are moving in the direction of deemphasizing the split packages. Thus why they weren't installable from pypi, and are now removed from pypi. Tom
![](https://secure.gravatar.com/avatar/e1554622707bedd9202884900430b838.jpg?s=120&d=mm&r=g)
On May 30, 2013, at 5:43 AM, exarkun@twistedmatrix.com wrote:
Yes.
If so, the release process will need to be adjusted to avoid re-adding them.
Thomas has already done that: <http://twistedmatrix.com/trac/wiki/ReleaseProcess?action=diff&version=164&old_version=163>
What makes them uninstallable? Wouldn't it make as much sense to just fix that? Is this only a PyPI interaction thing, or is there actually a problem with the packages being distributed?
We never tested installing them in any fashion; we certainly never did any continuous integration on them. I don't think we ever fully figured out the 'namespace package' thing. Their distribution names won't satisfy a dependency on 'Twisted', and 'Twisted' won't satisfy a dependency on them, but they install the same files, so if another project attempted to use them as a minimal dependency, you would have gotten a broken mess. Given all this I can't remember why we bothered to put these on PyPI in the first place, and it makes sense to remove them. -glyph
![](https://secure.gravatar.com/avatar/e1554622707bedd9202884900430b838.jpg?s=120&d=mm&r=g)
On Jun 1, 2013, at 5:00 AM, exarkun@twistedmatrix.com wrote:
Well, someone seems to have done so now, though I don't see how to find out who or when from the PyPI user interface.
As I said in my message, it was Thomas; if that's ambiguous, I meant Thomas Hervé.
Also, Twisted Web2 was left alone (ie, it is still on PyPI) which strikes me as an odd decision.
Web2 didn't have the same issues (containing the same files as other distributions but with a different name) since it was always distributed separately. It might make sense to remove it, too, but if we do, it's for different reasons. If nothing depends on it, I say we should kill it. -glyph
![](https://secure.gravatar.com/avatar/ebf132362b622423ed5baca2988911b8.jpg?s=120&d=mm&r=g)
On Jun 2, 2013, at 10:19 PM, Glyph <glyph@twistedmatrix.com> wrote:
I'm going to duck out here and unsubscribe :) If Twisted needs any help getting anything fixed on PyPI feel free to contact me directly. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
![](https://secure.gravatar.com/avatar/607cfd4a5b41fe6c886c978128b9c03e.jpg?s=120&d=mm&r=g)
On 02:19 am, glyph@twistedmatrix.com wrote:
Sorry, I didn't see the message where you said that.
Removing it seems like the right thing to me. I have no idea if anything depends on it, but having it on PyPI only means that things could continue to depend on it - or even worse, new things might start depending on it. Jean-Paul
![](https://secure.gravatar.com/avatar/ebf132362b622423ed5baca2988911b8.jpg?s=120&d=mm&r=g)
On May 29, 2013, at 5:24 PM, Tom Prince <tom.prince@ualberta.net> wrote:
I'm not familiar with whose who in Twisted land sorry. Any of the maintainers listed on the website will be capable of removing them, or if it's desired to have me do it in batch I require someone official like Glyph or so who does have access to request it of me. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
![](https://secure.gravatar.com/avatar/607cfd4a5b41fe6c886c978128b9c03e.jpg?s=120&d=mm&r=g)
On 29 May, 09:24 pm, tom.prince@ualberta.net wrote:
What are we removing? All of the subprojects on PyPI? If so, the release process will need to be adjusted to avoid re-adding them. What makes them uninstallable? Wouldn't it make as much sense to just fix that? Is this only a PyPI interaction thing, or is there actually a problem with the packages being distributed? Jean-Paul
![](https://secure.gravatar.com/avatar/e81edff3af564b86f4c9d780a8023299.jpg?s=120&d=mm&r=g)
exarkun@twistedmatrix.com writes:
If so, the release process will need to be adjusted to avoid re-adding them. https://twistedmatrix.com/trac/wiki/ReleaseProcess?action=diff&version=164&old_version=163
It is just that pypi doesn't (didn't, now that they are deleted) have the necessary metadata to install them. My understanding was that we are moving in the direction of deemphasizing the split packages. Thus why they weren't installable from pypi, and are now removed from pypi. Tom
![](https://secure.gravatar.com/avatar/e1554622707bedd9202884900430b838.jpg?s=120&d=mm&r=g)
On May 30, 2013, at 5:43 AM, exarkun@twistedmatrix.com wrote:
Yes.
If so, the release process will need to be adjusted to avoid re-adding them.
Thomas has already done that: <http://twistedmatrix.com/trac/wiki/ReleaseProcess?action=diff&version=164&old_version=163>
What makes them uninstallable? Wouldn't it make as much sense to just fix that? Is this only a PyPI interaction thing, or is there actually a problem with the packages being distributed?
We never tested installing them in any fashion; we certainly never did any continuous integration on them. I don't think we ever fully figured out the 'namespace package' thing. Their distribution names won't satisfy a dependency on 'Twisted', and 'Twisted' won't satisfy a dependency on them, but they install the same files, so if another project attempted to use them as a minimal dependency, you would have gotten a broken mess. Given all this I can't remember why we bothered to put these on PyPI in the first place, and it makes sense to remove them. -glyph
![](https://secure.gravatar.com/avatar/e1554622707bedd9202884900430b838.jpg?s=120&d=mm&r=g)
On Jun 1, 2013, at 5:00 AM, exarkun@twistedmatrix.com wrote:
Well, someone seems to have done so now, though I don't see how to find out who or when from the PyPI user interface.
As I said in my message, it was Thomas; if that's ambiguous, I meant Thomas Hervé.
Also, Twisted Web2 was left alone (ie, it is still on PyPI) which strikes me as an odd decision.
Web2 didn't have the same issues (containing the same files as other distributions but with a different name) since it was always distributed separately. It might make sense to remove it, too, but if we do, it's for different reasons. If nothing depends on it, I say we should kill it. -glyph
![](https://secure.gravatar.com/avatar/ebf132362b622423ed5baca2988911b8.jpg?s=120&d=mm&r=g)
On Jun 2, 2013, at 10:19 PM, Glyph <glyph@twistedmatrix.com> wrote:
I'm going to duck out here and unsubscribe :) If Twisted needs any help getting anything fixed on PyPI feel free to contact me directly. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
![](https://secure.gravatar.com/avatar/607cfd4a5b41fe6c886c978128b9c03e.jpg?s=120&d=mm&r=g)
On 02:19 am, glyph@twistedmatrix.com wrote:
Sorry, I didn't see the message where you said that.
Removing it seems like the right thing to me. I have no idea if anything depends on it, but having it on PyPI only means that things could continue to depend on it - or even worse, new things might start depending on it. Jean-Paul
participants (5)
-
Donald Stufft
-
exarkun@twistedmatrix.com
-
Glyph
-
Mikhail Terekhov
-
Tom Prince