problems with sdist upload since CDN update

I got some random releasing (1 on 5 or 6 tries) problems since last pypi update. For example, with collective.ckeditor (3.6.10 tag on github), the sdist upload will randomly not upload the file without reporting any error on console: https://github.com/collective/collective.ckeditor/tree/3.6.10 -- Cordialement, KiOrKY GPG Key FingerPrint: 0x1A1194B7681112AF Pensez à l’environnement. N’imprimez ce courriel que si vous en avez vraiment besoin.

On May 30, 2013, at 11:08 AM, kiorky <kiorky@cryptelium.net> wrote:
I got some random releasing (1 on 5 or 6 tries) problems since last pypi update. For example, with collective.ckeditor (3.6.10 tag on github), the sdist upload will randomly not upload the file without reporting any error on console:
https://github.com/collective/collective.ckeditor/tree/3.6.10 -- Cordialement, KiOrKY GPG Key FingerPrint: 0x1A1194B7681112AF Pensez à l’environnement. N’imprimez ce courriel que si vous en avez vraiment besoin. _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Are you able to reproduce this still? Looking for something in the logs but I don't see anything. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

As i said, not reproducible, i did it too times this afternoon, but i cant reproduced it afterwhile. I didnt notice the upload problem at first but so no targz on pypi even of the 200 OK upload, i reupload, got it on pypi. So in the pypi admin, i did: - delete (EVIL TM) the sdist, reupload it, no problem. - Redelete, got problem (with 200 ok still). - Redelete, upload no problem sdist was there on pypi, and from then, i cant suceed in refalling it after that, even if i tried to for like 10 times. Useless to say that it was with the same local dist. I got troubles, that's no doubt; maybe network shadows at that time. So well, we will see if i can reproduce when time comes from a new release of my addons which will get again into problems. On 30/05/2013 18:13, Donald Stufft wrote:
On May 30, 2013, at 11:08 AM, kiorky <kiorky@cryptelium.net <mailto:kiorky@cryptelium.net>> wrote:
I got some random releasing (1 on 5 or 6 tries) problems since last pypi update. For example, with collective.ckeditor (3.6.10 tag on github), the sdist upload will randomly not upload the file without reporting any error on console:
https://github.com/collective/collective.ckeditor/tree/3.6.10 -- Cordialement, KiOrKY GPG Key FingerPrint: 0x1A1194B7681112AF Pensez à l’environnement. N’imprimez ce courriel que si vous en avez vraiment besoin. _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org <mailto:Distutils-SIG@python.org> http://mail.python.org/mailman/listinfo/distutils-sig
Are you able to reproduce this still? Looking for something in the logs but I don't see anything.
----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
-- Cordialement, KiOrKY GPG Key FingerPrint: 0x1A1194B7681112AF Pensez à l’environnement. N’imprimez ce courriel que si vous en avez vraiment besoin.

I'm also having trouble with uploading to pypi, it's not random, meaning it's happened every time so far. My last upload was about a week ago and seamless. Here is my best reconstruction of today: {{{ python setup.py sdist upload ...snip adding 'leo-4.11.devel-build-5802\leo.egg-info\PKG-INFO' adding 'leo-4.11.devel-build-5802\leo.egg-info\SOURCES.txt' adding 'leo-4.11.devel-build-5802\leo.egg-info\top_level.txt' removing 'leo-4.11.devel-build-5802' (and everything under it) running upload submitting d:/leo/dist\leo-4.11.devel-build-5802.zip to http://pypi.python.org/pypi upload failed (500): There's been a problem with your request python setup.py sdist upload :: same error python setup.py register :: was okay python setup.py sdist upload :: same error }}} I then went to https://pypi.python.org/pypi?%3Aaction=pkg_edit&name=leo and noticed that I had my role mysteriously expanded to include Owner as well as Maintainer. I used the web interface and removed the Owner role for myself, and then manually uploaded the sdist package, which succeeded. Went back to cmd shell and: {{{ B:\apps\leo\pypi-411>python setup.py bdist_wininst upload ...snip adding 'SCRIPTS\leoc-script.py' adding 'SCRIPTS\leoc.exe' adding 'SCRIPTS\leoc.exe.manifest' removing 'd:/leo/build' (and everything under it) running upload Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Server response (200): OK Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Upload failed (400): A file named "leo-4.11.devel-build-5802.win32.exe" already exists for leo-4.11.devel-build-5802. To fix problems with that file you should create a new release. }}} Note the double upload. Going back to the website https://pypi.python.org/pypi/leo there are now 2 packages listed: "leo 4.10-final", which corresponds to the sdist package, and "leo 4.11.devel-build-5802" corresponding the win32 .exe installer. The metadata for 4.10-final has the correct author and maintainer, but all the other metadata is old and hasn't been updated. The metadata for 4.11-devel is up to date for homepage through maintainer but has the wrong Author and is missing the long description. The journal entries for the 2 packages mirror each other except for the last line: {{{ Journal Action Date User Address create 2003-10-09 17:32 edreamleo 66.168.19.217 add Owner edreamleo 2003-10-09 17:32 edreamleo 66.168.19.217 new release 2012-03-29 13:53 edreamleo 68.185.171.138 add Maintainer maphew 2013-05-07 13:08 edreamleo 172.8.201.39 add Owner maphew 2013-05-22 23:21 maphew 199.247.128.35 update _pypi_hidden 2013-05-22 23:22 maphew 199.247.128.35 update _pypi_hidden 2013-05-31 16:52 maphew 199.27.75.22 remove Owner maphew 2013-05-31 16:53 maphew 199.27.75.22 update hosting_mode 2013-05-31 16:56 maphew 199.27.75.20 add source file leo-4.11.devel-build-5802.zip 2013-05-31 16:59 maphew 199.27.75.21 }}} {{{ add any file leo-4.11.devel-build-5802.win32.exe 2013-05-31 17:02 maphew 199.27.75.23 }}} Also curious is that all the ip addresses for today are wrong and variable. My external-to-world-ip should be 199.247.128.35 and static. cheers, -matt

On May 31, 2013, at 1:44 PM, Matt Wilkie <maphew@gmail.com> wrote:
I'm also having trouble with uploading to pypi, it's not random, meaning it's happened every time so far. My last upload was about a week ago and seamless.
Here is my best reconstruction of today:
{{{ python setup.py sdist upload
...snip adding 'leo-4.11.devel-build-5802\leo.egg-info\PKG-INFO' adding 'leo-4.11.devel-build-5802\leo.egg-info\SOURCES.txt' adding 'leo-4.11.devel-build-5802\leo.egg-info\top_level.txt' removing 'leo-4.11.devel-build-5802' (and everything under it) running upload submitting d:/leo/dist\leo-4.11.devel-build-5802.zip to http://pypi.python.org/pypi upload failed (500): There's been a problem with your request
python setup.py sdist upload :: same error
python setup.py register :: was okay
python setup.py sdist upload :: same error }}}
I then went to https://pypi.python.org/pypi?%3Aaction=pkg_edit&name=leo and noticed that I had my role mysteriously expanded to include Owner as well as Maintainer.
I used the web interface and removed the Owner role for myself, and then manually uploaded the sdist package, which succeeded.
Went back to cmd shell and:
{{{ B:\apps\leo\pypi-411>python setup.py bdist_wininst upload
...snip adding 'SCRIPTS\leoc-script.py' adding 'SCRIPTS\leoc.exe' adding 'SCRIPTS\leoc.exe.manifest' removing 'd:/leo/build' (and everything under it) running upload Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Server response (200): OK Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Upload failed (400): A file named "leo-4.11.devel-build-5802.win32.exe" already exists for leo-4.11.devel-build-5802. To fix problems with that file you should create a new release. }}}
Note the double upload.
Going back to the website https://pypi.python.org/pypi/leo there are now 2 packages listed: "leo 4.10-final", which corresponds to the sdist package, and "leo 4.11.devel-build-5802" corresponding the win32 .exe installer.
The metadata for 4.10-final has the correct author and maintainer, but all the other metadata is old and hasn't been updated.
The metadata for 4.11-devel is up to date for homepage through maintainer but has the wrong Author and is missing the long description.
The journal entries for the 2 packages mirror each other except for the last line: {{{ Journal Action Date User Address create 2003-10-09 17:32 edreamleo 66.168.19.217 add Owner edreamleo 2003-10-09 17:32 edreamleo 66.168.19.217 new release 2012-03-29 13:53 edreamleo 68.185.171.138 add Maintainer maphew 2013-05-07 13:08 edreamleo 172.8.201.39 add Owner maphew 2013-05-22 23:21 maphew 199.247.128.35 update _pypi_hidden 2013-05-22 23:22 maphew 199.247.128.35 update _pypi_hidden 2013-05-31 16:52 maphew 199.27.75.22 remove Owner maphew 2013-05-31 16:53 maphew 199.27.75.22 update hosting_mode 2013-05-31 16:56 maphew 199.27.75.20 add source file leo-4.11.devel-build-5802.zip 2013-05-31 16:59 maphew 199.27.75.21 }}}
{{{ add any file leo-4.11.devel-build-5802.win32.exe 2013-05-31 17:02 maphew 199.27.75.23 }}}
Also curious is that all the ip addresses for today are wrong and variable. My external-to-world-ip should be 199.247.128.35 and static.
cheers,
-matt _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
I see an exception here in Sentry, I'll investigate further in a bit. ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

On May 31, 2013, at 2:10 PM, Donald Stufft <donald@stufft.io> wrote:
On May 31, 2013, at 1:44 PM, Matt Wilkie <maphew@gmail.com> wrote:
I'm also having trouble with uploading to pypi, it's not random, meaning it's happened every time so far. My last upload was about a week ago and seamless.
Here is my best reconstruction of today:
{{{ python setup.py sdist upload
...snip adding 'leo-4.11.devel-build-5802\leo.egg-info\PKG-INFO' adding 'leo-4.11.devel-build-5802\leo.egg-info\SOURCES.txt' adding 'leo-4.11.devel-build-5802\leo.egg-info\top_level.txt' removing 'leo-4.11.devel-build-5802' (and everything under it) running upload submitting d:/leo/dist\leo-4.11.devel-build-5802.zip to http://pypi.python.org/pypi upload failed (500): There's been a problem with your request
python setup.py sdist upload :: same error
python setup.py register :: was okay
python setup.py sdist upload :: same error }}}
I then went to https://pypi.python.org/pypi?%3Aaction=pkg_edit&name=leo and noticed that I had my role mysteriously expanded to include Owner as well as Maintainer.
I used the web interface and removed the Owner role for myself, and then manually uploaded the sdist package, which succeeded.
Went back to cmd shell and:
{{{ B:\apps\leo\pypi-411>python setup.py bdist_wininst upload
...snip adding 'SCRIPTS\leoc-script.py' adding 'SCRIPTS\leoc.exe' adding 'SCRIPTS\leoc.exe.manifest' removing 'd:/leo/build' (and everything under it) running upload Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Server response (200): OK Submitting d:/leo/dist\leo-4.11.devel-build-5802.win32.exe to http://pypi.python.org/pypi Upload failed (400): A file named "leo-4.11.devel-build-5802.win32.exe" already exists for leo-4.11.devel-build-5802. To fix problems with that file you should create a new release. }}}
Note the double upload.
Going back to the website https://pypi.python.org/pypi/leo there are now 2 packages listed: "leo 4.10-final", which corresponds to the sdist package, and "leo 4.11.devel-build-5802" corresponding the win32 .exe installer.
The metadata for 4.10-final has the correct author and maintainer, but all the other metadata is old and hasn't been updated.
The metadata for 4.11-devel is up to date for homepage through maintainer but has the wrong Author and is missing the long description.
The journal entries for the 2 packages mirror each other except for the last line: {{{ Journal Action Date User Address create 2003-10-09 17:32 edreamleo 66.168.19.217 add Owner edreamleo 2003-10-09 17:32 edreamleo 66.168.19.217 new release 2012-03-29 13:53 edreamleo 68.185.171.138 add Maintainer maphew 2013-05-07 13:08 edreamleo 172.8.201.39 add Owner maphew 2013-05-22 23:21 maphew 199.247.128.35 update _pypi_hidden 2013-05-22 23:22 maphew 199.247.128.35 update _pypi_hidden 2013-05-31 16:52 maphew 199.27.75.22 remove Owner maphew 2013-05-31 16:53 maphew 199.27.75.22 update hosting_mode 2013-05-31 16:56 maphew 199.27.75.20 add source file leo-4.11.devel-build-5802.zip 2013-05-31 16:59 maphew 199.27.75.21 }}}
{{{ add any file leo-4.11.devel-build-5802.win32.exe 2013-05-31 17:02 maphew 199.27.75.23 }}}
Also curious is that all the ip addresses for today are wrong and variable. My external-to-world-ip should be 199.247.128.35 and static.
cheers,
-matt _______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
I see an exception here in Sentry, I'll investigate further in a bit.
----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
_______________________________________________ Distutils-SIG maillist - Distutils-SIG@python.org http://mail.python.org/mailman/listinfo/distutils-sig
Matt, is your code available online anywhere? ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

Matt, is your code available online anywhere?
yes: https://code.launchpad.net/leo-editor thanks for looking at this. -matt

sorry, here's the direct branch link : http://bazaar.launchpad.net/~leo-editor-team/leo-editor/trunk3/files and nightly snapshots: http://www.greygreen.org/leo/ -matt On Fri, May 31, 2013 at 11:30 PM, Matt Wilkie <maphew@gmail.com> wrote:
Matt, is your code available online anywhere?
yes: https://code.launchpad.net/leo-editor
thanks for looking at this.
-matt

On Jun 1, 2013, at 2:33 AM, Matt Wilkie <maphew@gmail.com> wrote:
sorry, here's the direct branch link : http://bazaar.launchpad.net/~leo-editor-team/leo-editor/trunk3/files
and nightly snapshots: http://www.greygreen.org/leo/
-matt
On Fri, May 31, 2013 at 11:30 PM, Matt Wilkie <maphew@gmail.com> wrote:
Matt, is your code available online anywhere?
yes: https://code.launchpad.net/leo-editor
thanks for looking at this.
-matt
As far as I can tell your issue is unrelated to the CDN. I don't know how to use Launchpad very well, but you hit a path in the code that, as far as I know, only gets hit when you don't have a long_description. This bit of code attempts to extract a long_description from a README file. It explicitly checks for certain extensions and TXT (instead of txt) is not one of them. However it returns a singular None when the calling code expects a 2 item tuple to be returned. I'm guessing that you didn't have a long_description when it wasn't working, and your README file was named README.TXT, and between when it wasn't working and when it was you added a long_description. Is my guess correct? The bit of code in question is https://bitbucket.org/pypa/pypi/src/0fd0fd89b791bc2641382f81dcc677ae4742abf7... ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA

Hi Donald,
I'm guessing that you didn't have a long_description when it wasn't working, and your README file was named README.TXT, and between when it wasn't working and when it was you added a long_description.
Thanks for investigating this. There is supposed to be a long description, but it could be that it is not generated as expected or is not working in some way. I'm not a very good programmer yet :) Ahh, I think I've got it. Setup.py generates long_description from README.TXT if present, or from a hard coded boiler plate if not. In preparation for a new release coming up soon, another team member deleted all content in the Readme, since it was outdated and misleading. So I presume PyPi saw the empty long_description and bailed. -matt
participants (3)
-
Donald Stufft
-
kiorky
-
Matt Wilkie