From doug.hellmann at gmail.com Tue Jan 1 23:48:03 2013
From: doug.hellmann at gmail.com (Doug Hellmann)
Date: Tue, 1 Jan 2013 17:48:03 -0500
Subject: [Catalog-sig] setting up a "full" mirror
In-Reply-To: <BCE351A5AE2F41EEA5EDD48222AE11C9@gmail.com>
References: <976B18CD-4B80-494D-AE40-3C5E62329D51@gmail.com>
<BCE351A5AE2F41EEA5EDD48222AE11C9@gmail.com>
Message-ID: <BCD58623-A0F9-4A57-9716-4D814216B64B@gmail.com>
Thanks, Donald, that gives us an idea of what we would be getting into.
Doug
On Dec 27, 2012, at 3:51 PM, Donald Stufft wrote:
> When I started Crate.io in February 2012 a full mirror was 27GB, When I did a fresh sync the other day it was 38GB.
> On Thursday, December 27, 2012 at 3:43 PM, Doug Hellmann wrote:
>
>> DreamHost is considering setting up a mirror of PyPI. Before we commit to doing so, we would like to find out how much space is currently required and how fast that space requirement has been growing over the past few months.
>>
>> Are those stats available easily?
>>
>> Doug
>>
>> _______________________________________________
>> Catalog-SIG mailing list
>> Catalog-SIG at python.org
>> http://mail.python.org/mailman/listinfo/catalog-sig
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130101/af604e5c/attachment.html>
From tschouns at gmail.com Sat Jan 5 12:53:15 2013
From: tschouns at gmail.com (Jonas Baumann)
Date: Sat, 5 Jan 2013 12:53:15 +0100
Subject: [Catalog-sig] Pypi mirrors are inconsistent
Message-ID: <D4BC8290-9B73-4C17-8F00-F35F551114CA@gmail.com>
Hey there,
Last month the pypi mirrors got inconsistent regarding the dists of the package plone.testing.
On the mirrors a and e there is a plone.testing==4.0.7,
but on the mirrors b, c, d, f and g this version is missing.
See:
http://a.pypi.python.org/simple/plone.testing/
http://b.pypi.python.org/simple/plone.testing/
http://c.pypi.python.org/simple/plone.testing/
http://d.pypi.python.org/simple/plone.testing/
http://e.pypi.python.org/simple/plone.testing/
http://f.pypi.python.org/simple/plone.testing/
http://g.pypi.python.org/simple/plone.testing/
https://pypi.crate.io/simple/plone.testing/
http://www.pypi-mirrors.org/ says the mirrors are mostly fresh and seems not to be able to detect such inconsistencies.
How could that happen?
How can it be fixed?
Cheers,
Jonas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130105/ece075dd/attachment.html>
From lists at zopyx.com Sat Jan 5 14:30:56 2013
From: lists at zopyx.com (Andreas Jung)
Date: Sat, 05 Jan 2013 14:30:56 +0100
Subject: [Catalog-sig] Pypi mirrors are inconsistent
In-Reply-To: <D4BC8290-9B73-4C17-8F00-F35F551114CA@gmail.com>
References: <D4BC8290-9B73-4C17-8F00-F35F551114CA@gmail.com>
Message-ID: <50E82B10.3040802@zopyx.com>
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
I assume that the pep381client implementation might need something
like "mix-missing packages" option.
- -aj
Jonas Baumann wrote:
> Hey there,
>
> Last month the pypi mirrors got inconsistent regarding the dists of
> the package plone.testing.
>
> On the mirrors a and e there is a plone.testing==4.0.7, but on the
> mirrors b, c, d, f and g this version is missing.
>
> See: http://a.pypi.python.org/simple/plone.testing/
> http://b.pypi.python.org/simple/plone.testing/
> http://c.pypi.python.org/simple/plone.testing/
> http://d.pypi.python.org/simple/plone.testing/
> http://e.pypi.python.org/simple/plone.testing/
> http://f.pypi.python.org/simple/plone.testing/
> http://g.pypi.python.org/simple/plone.testing/
> https://pypi.crate.io/simple/plone.testing/
>
> http://www.pypi-mirrors.org/ says the mirrors are mostly fresh and
> seems not to be able to detect such inconsistencies.
>
> How could that happen? How can it be fixed?
>
> Cheers, Jonas
>
> _______________________________________________ Catalog-SIG mailing
> list Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
- --
ZOPYX Limited | Python | Zope | Plone | MongoDB
Hundskapfklinge 33 | Consulting & Development
D-72074 T?bingen | Electronic Publishing Solutions
www.zopyx.com | Scalable Web Solutions
- --------------------------------------------------
Produce & Publish - www.produce-and-publish.com
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iQGUBAEBAgAGBQJQ6CsQAAoJEADcfz7u4AZjVrgLv34X5CYsyaDK7Q65yT4VBVIE
NP9EELgEFU/QqZo/vEHyDH3XldVVN6eO6RvuHC8kZbTFbRiidHXRSQKg+zRuw38/
2juAaSSRYazJS+UvhFVqHh0LClK/Re84AtzuwQHZcqLRZGD81bwWnTuhGTZgx2Rk
/f1GeMqUUbkNpYilCL9eQjw/qL/Wo1l7jhyD9oNJDRVjjseL4tJFsvgdcsJ/RNWv
VwAOaspq5ITkkff+NHDma7nlCgTNI5nEs4sFjvmzLBrBpK8Rj+wWDQzLYp7v6YuF
EOmE3CxL/l67A0kRIPOEnZqwVDUv+Da3zEdDiqDd7kWmQfIHLL6DCSJOEwykz7bC
J18uqYHBev+0MO/IQEdDoIFCHOpslHNnnAoZBIZJRcAgljFMxx7wreTGKLZ3rUXH
QgOtmgibKilMKGtVw4NHX+Qg2JcM/ApgEy2j63JckNxI6rhhmS5uZibs7pcqWttl
N+4XhuZB1n+1Hk8v5isvr5omHnVI4H4=
=JQak
-----END PGP SIGNATURE-----
-------------- next part --------------
A non-text attachment was scrubbed...
Name: lists.vcf
Type: text/x-vcard
Size: 353 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130105/f7a91b77/attachment.vcf>
From holger.krekel at gmail.com Mon Jan 7 13:07:37 2013
From: holger.krekel at gmail.com (Holger Krekel)
Date: Mon, 7 Jan 2013 13:07:37 +0100
Subject: [Catalog-sig] fresh pep381run pypi-mirroring fails since >1 week
Message-ID: <CAPJJ-p+D1tbMTnt4xNk-wwomyJJfrWtyV3Q3k7=j7KYXyiNPhw@mail.gmail.com>
Hi all,
During the last 7 days i tried running "pep381run" with a fresh directory
on two different hosts. They both failed while trying to copy
"azb_nester-1.2.0.tar.gz", see here for the traceback:
http://bpaste.net/show/SoMoyjdJEIGvm99dH6gG/ It seems that azb_nester does
not have any files anymore on pypi.python.org, they probably got deleted.
Is that a bug in the pep381run software or in the pep381 mirroring protocol
or ...?
best,
holger
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130107/92dfc821/attachment.html>
From tarek at ziade.org Mon Jan 7 14:42:27 2013
From: tarek at ziade.org (=?ISO-8859-1?Q?Tarek_Ziad=E9?=)
Date: Mon, 07 Jan 2013 14:42:27 +0100
Subject: [Catalog-sig] fresh pep381run pypi-mirroring fails since >1 week
In-Reply-To: <CAPJJ-p+D1tbMTnt4xNk-wwomyJJfrWtyV3Q3k7=j7KYXyiNPhw@mail.gmail.com>
References: <CAPJJ-p+D1tbMTnt4xNk-wwomyJJfrWtyV3Q3k7=j7KYXyiNPhw@mail.gmail.com>
Message-ID: <50EAD0C3.6020800@ziade.org>
On 1/7/13 1:07 PM, Holger Krekel wrote:
> Hi all,
>
> During the last 7 days i tried running "pep381run" with a fresh
> directory on two different hosts. They both failed while trying to
> copy "azb_nester-1.2.0.tar.gz", see here for the traceback:
> http://bpaste.net/show/SoMoyjdJEIGvm99dH6gG/ It seems that azb_nester
> does not have any files anymore on pypi.python.org
> <http://pypi.python.org>, they probably got deleted.
>
> Is that a bug in the pep381run software or in the pep381 mirroring
> protocol or ...?
>
> best,
> holger
This is not a fix, but maybe try with my version:
https://bitbucket.org/tarek/pep381client
I ran into a lot of issues on the first run, and that fork tries to make
sure the mirroring continues until the end
>
>
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
--
Tarek Ziad? ? http://ziade.org ? @tarek_ziade
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130107/1a1353ca/attachment.html>
From kencochrane at gmail.com Tue Jan 15 14:42:48 2013
From: kencochrane at gmail.com (ken cochrane)
Date: Tue, 15 Jan 2013 08:42:48 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
Message-ID: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape
right now. We only have one mirror (f.pypi.python.org) that isn't more then
8 hours out of date.
We have one server e.pypi.python.org I can't even connect to anymore, and
I'm not sure if is even online. Anyone know why?
c.pypi.python.org and d.pypi.python.org are both over 1 day old
g.pypi.python.org is over 11 days old
b.pypi.python.org is about 8 hours old at this point, I looked at the logs
on this server and it looks like it is getting stuck trying to download
packages for QSTK. Hopefully it resolves itself.
Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz
> Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz
Even pypi.crate.io is over 4 hours out of date, and that one is usually
pretty reliable.
I'm guessing there was something that was recently added to pypi, that
broke the mirror replication, and each of these servers needs to be looked
at to make sure they can get back in sync.
If I don't see any improvements in these mirrors by the end of the day,
I'll start emailing the owners individually.
Ken
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/b7b10f41/attachment.html>
From donald.stufft at gmail.com Tue Jan 15 16:04:51 2013
From: donald.stufft at gmail.com (Donald Stufft)
Date: Tue, 15 Jan 2013 10:04:51 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
Message-ID: <F2442A4565B14385AAF3C67CE870BD05@gmail.com>
On Tuesday, January 15, 2013 at 8:42 AM, ken cochrane wrote:
>
> Even pypi.crate.io (http://pypi.crate.io/) is over 4 hours out of date, and that one is usually pretty reliable.
>
Fixed. Crate's issue will be unrelated to the issue(s) seen by the other mirrors.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/2275cea3/attachment.html>
From lists at zopyx.com Tue Jan 15 18:04:11 2013
From: lists at zopyx.com (Andreas Jung)
Date: Tue, 15 Jan 2013 18:04:11 +0100
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
Message-ID: <50F58C0B.2030807@zopyx.com>
ken cochrane wrote:
>
> c.pypi.python.org <http://c.pypi.python.org/> and d.pypi.python.org
> <http://d.pypi.python.org/> are both over 1 day old
Up & running again - pep381client was hanging for unknown reasons.
Does it make sense to limit the max. execution time of pep381client.
-aj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: lists.vcf
Type: text/x-vcard
Size: 367 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/f089e1d9/attachment.vcf>
From kencochrane at gmail.com Tue Jan 15 18:13:02 2013
From: kencochrane at gmail.com (ken cochrane)
Date: Tue, 15 Jan 2013 12:13:02 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <50F58C0B.2030807@zopyx.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<50F58C0B.2030807@zopyx.com>
Message-ID: <CACBKDnjBwORpzdPjb5QyUkZeeRLFYddT7p3m9BRjF7FVmY6Yww@mail.gmail.com>
Thank you, Andreas and Donald.
Ken
On Tue, Jan 15, 2013 at 12:04 PM, Andreas Jung <lists at zopyx.com> wrote:
>
>
> ken cochrane wrote:
>
> >
> > c.pypi.python.org <http://c.pypi.python.org/> and d.pypi.python.org
> > <http://d.pypi.python.org/> are both over 1 day old
>
> Up & running again - pep381client was hanging for unknown reasons.
>
> Does it make sense to limit the max. execution time of pep381client.
>
> -aj
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/dd664e87/attachment.html>
From ralph.bean at gmail.com Tue Jan 15 18:50:45 2013
From: ralph.bean at gmail.com (Ralph Bean)
Date: Tue, 15 Jan 2013 12:50:45 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <50F58C0B.2030807@zopyx.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<50F58C0B.2030807@zopyx.com>
Message-ID: <20130115175045.GB2257@radek>
On Tue, Jan 15, 2013 at 06:04:11PM +0100, Andreas Jung wrote:
> ken cochrane wrote:
>
> >
> > c.pypi.python.org <http://c.pypi.python.org/> and d.pypi.python.org
> > <http://d.pypi.python.org/> are both over 1 day old
>
> Up & running again - pep381client was hanging for unknown reasons.
g.pypi.python.org is syncing again now too (not finished yet). It had
been hanging since January 4th.
> Does it make sense to limit the max. execution time of pep381client.
That would be helpful.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 490 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/9b9ad90e/attachment.pgp>
From happyaron.xu at gmail.com Wed Jan 16 04:03:00 2013
From: happyaron.xu at gmail.com (Aron Xu)
Date: Wed, 16 Jan 2013 11:03:00 +0800
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
Message-ID: <CAMr=8w71KkLB3SMWMfE6aVQGbib4GRntk=qZoa9FLOeTxuGuUQ@mail.gmail.com>
On Tue, Jan 15, 2013 at 9:42 PM, ken cochrane <kencochrane at gmail.com> wrote:
> According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape
> right now. We only have one mirror (f.pypi.python.org) that isn't more then
> 8 hours out of date.
>
> We have one server e.pypi.python.org I can't even connect to anymore, and
> I'm not sure if is even online. Anyone know why?
e.pypi.python.org is experiencing some problem with its uplink switch
and will hopefully be fixed today. Sorry for the inconvenience.
--
Regards,
Aron Xu
From kencochrane at gmail.com Wed Jan 16 04:18:06 2013
From: kencochrane at gmail.com (ken cochrane)
Date: Tue, 15 Jan 2013 22:18:06 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CAMr=8w71KkLB3SMWMfE6aVQGbib4GRntk=qZoa9FLOeTxuGuUQ@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<CAMr=8w71KkLB3SMWMfE6aVQGbib4GRntk=qZoa9FLOeTxuGuUQ@mail.gmail.com>
Message-ID: <CACBKDnhv6ST8K9aWWjA77KPdjzjMv3PYHOP4WC9YVc+ROk1qMw@mail.gmail.com>
Aron,
Thanks for the update, and good luck with the switch fix.
Ken
On Tue, Jan 15, 2013 at 10:03 PM, Aron Xu <happyaron.xu at gmail.com> wrote:
> On Tue, Jan 15, 2013 at 9:42 PM, ken cochrane <kencochrane at gmail.com>
> wrote:
> > According to http://www.pypi-mirrors.org the pypi mirrors are in bad
> shape
> > right now. We only have one mirror (f.pypi.python.org) that isn't more
> then
> > 8 hours out of date.
> >
> > We have one server e.pypi.python.org I can't even connect to anymore,
> and
> > I'm not sure if is even online. Anyone know why?
>
> e.pypi.python.org is experiencing some problem with its uplink switch
> and will hopefully be fixed today. Sorry for the inconvenience.
>
>
>
> --
> Regards,
> Aron Xu
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130115/e1021da0/attachment.html>
From jannis at leidel.info Wed Jan 16 10:43:37 2013
From: jannis at leidel.info (Jannis Leidel)
Date: Wed, 16 Jan 2013 10:43:37 +0100
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
Message-ID: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
On 15.01.2013, at 14:42, ken cochrane <kencochrane at gmail.com> wrote:
> According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org) that isn't more then 8 hours out of date.
>
> We have one server e.pypi.python.org I can't even connect to anymore, and I'm not sure if is even online. Anyone know why?
>
> c.pypi.python.org and d.pypi.python.org are both over 1 day old
>
> g.pypi.python.org is over 11 days old
>
> b.pypi.python.org is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself.
>
> Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz
> Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz
>
>
> Even pypi.crate.io is over 4 hours out of date, and that one is usually pretty reliable.
>
> I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync.
>
> If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually.
Sigh.
The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x?
I've now started a manual sync and hope to see d being up-to-date soonish.
Jannis
From donald.stufft at gmail.com Wed Jan 16 16:41:00 2013
From: donald.stufft at gmail.com (Donald Stufft)
Date: Wed, 16 Jan 2013 10:41:00 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
Message-ID: <19C11217545F4CB893B52B62113F71A1@gmail.com>
On Wednesday, January 16, 2013 at 4:43 AM, Jannis Leidel wrote:
> The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x?
>
>
Should be able to use the timeout command.
timeout -k HARD_LIMIT SOFT_LIMIT /path/pep381client/pep381run -q /var/pypi
I haven't actually tested this but It should work, IIRC it'll send a SIGTERM after
SOFT_LIMIT and a SIGQUIT after HARD_LIMIT.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130116/ab850816/attachment.html>
From happyaron.xu at gmail.com Thu Jan 17 01:33:46 2013
From: happyaron.xu at gmail.com (Aron Xu)
Date: Thu, 17 Jan 2013 08:33:46 +0800
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
Message-ID: <CAMr=8w6-XE617pN-moiWuUpBLGsCQG23qRKijBzfbQwOKEuOwA@mail.gmail.com>
On Wed, Jan 16, 2013 at 5:43 PM, Jannis Leidel <jannis at leidel.info> wrote:
>
> On 15.01.2013, at 14:42, ken cochrane <kencochrane at gmail.com> wrote:
>
>> According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org) that isn't more then 8 hours out of date.
>>
>> We have one server e.pypi.python.org I can't even connect to anymore, and I'm not sure if is even online. Anyone know why?
>>
>> c.pypi.python.org and d.pypi.python.org are both over 1 day old
>>
>> g.pypi.python.org is over 11 days old
>>
>> b.pypi.python.org is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself.
>>
>> Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz
>> Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz
>>
>>
>> Even pypi.crate.io is over 4 hours out of date, and that one is usually pretty reliable.
>>
>> I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync.
>>
>> If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually.
>
> Sigh.
>
> The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x?
>
> I've now started a manual sync and hope to see d being up-to-date soonish.
>
Why not just use something based on rsync? I see no problem syncing
Debian mirrors for years, which have lots of small files and update
frequently. The script of Debian ftpsync cannot be used directly for
pypi, but it's an example that worth considering:
http://ftp.debian.org/debian/project/ftpsync/ftpsync-current.tar.gz
--
Regards,
Aron Xu
From happyaron.xu at gmail.com Thu Jan 17 01:36:31 2013
From: happyaron.xu at gmail.com (Aron Xu)
Date: Thu, 17 Jan 2013 08:36:31 +0800
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CACBKDnhv6ST8K9aWWjA77KPdjzjMv3PYHOP4WC9YVc+ROk1qMw@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<CAMr=8w71KkLB3SMWMfE6aVQGbib4GRntk=qZoa9FLOeTxuGuUQ@mail.gmail.com>
<CACBKDnhv6ST8K9aWWjA77KPdjzjMv3PYHOP4WC9YVc+ROk1qMw@mail.gmail.com>
Message-ID: <CAMr=8w6h+mA1cB+2yejs_iUExebPS5+ziYNAKea43LVH8r+9OA@mail.gmail.com>
On Wed, Jan 16, 2013 at 11:18 AM, ken cochrane <kencochrane at gmail.com> wrote:
> Aron,
>
> Thanks for the update, and good luck with the switch fix.
>
> Ken
>
e is back - the connection is ok, and the mirror is fresh, but we
cannot guarantee the link speed right now. We'll have to wait for more
time for some changes in our IDC network.
--
Regards,
Aron Xu
From donald.stufft at gmail.com Thu Jan 17 01:40:27 2013
From: donald.stufft at gmail.com (Donald Stufft)
Date: Wed, 16 Jan 2013 19:40:27 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <CAMr=8w6-XE617pN-moiWuUpBLGsCQG23qRKijBzfbQwOKEuOwA@mail.gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
<CAMr=8w6-XE617pN-moiWuUpBLGsCQG23qRKijBzfbQwOKEuOwA@mail.gmail.com>
Message-ID: <B9AC5CA85DCD491AB834D67332A226A3@gmail.com>
PyPI could use rsync for mirroring. You can setup anonymous rsync.
It would require PyPI the software to write it's simple API files out
to disk and then expose that via RSync. Neither of those are
terribly hard and would improve the mirroring infrastructure IMO.
On Wednesday, January 16, 2013 at 7:33 PM, Aron Xu wrote:
> On Wed, Jan 16, 2013 at 5:43 PM, Jannis Leidel <jannis at leidel.info (mailto:jannis at leidel.info)> wrote:
> >
> > On 15.01.2013, at 14:42, ken cochrane <kencochrane at gmail.com (mailto:kencochrane at gmail.com)> wrote:
> >
> > > According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org (http://f.pypi.python.org)) that isn't more then 8 hours out of date.
> > >
> > > We have one server e.pypi.python.org (http://e.pypi.python.org) I can't even connect to anymore, and I'm not sure if is even online. Anyone know why?
> > >
> > > c.pypi.python.org (http://c.pypi.python.org) and d.pypi.python.org (http://d.pypi.python.org) are both over 1 day old
> > >
> > > g.pypi.python.org (http://g.pypi.python.org) is over 11 days old
> > >
> > > b.pypi.python.org (http://b.pypi.python.org) is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself.
> > >
> > > Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz
> > > Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz
> > >
> > >
> > > Even pypi.crate.io (http://pypi.crate.io) is over 4 hours out of date, and that one is usually pretty reliable.
> > >
> > > I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync.
> > >
> > > If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually.
> >
> > Sigh.
> >
> > The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x?
> >
> > I've now started a manual sync and hope to see d being up-to-date soonish.
>
> Why not just use something based on rsync? I see no problem syncing
> Debian mirrors for years, which have lots of small files and update
> frequently. The script of Debian ftpsync cannot be used directly for
> pypi, but it's an example that worth considering:
>
> http://ftp.debian.org/debian/project/ftpsync/ftpsync-current.tar.gz
>
>
>
> --
> Regards,
> Aron Xu
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org (mailto:Catalog-SIG at python.org)
> http://mail.python.org/mailman/listinfo/catalog-sig
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130116/39871f04/attachment.html>
From richard at python.org Wed Jan 23 04:41:26 2013
From: richard at python.org (Richard Jones)
Date: Wed, 23 Jan 2013 14:41:26 +1100
Subject: [Catalog-sig] Traceback when removing SSH key
In-Reply-To: <CAJA7-OekT8wyUkco1FWE21+mvtznHw4HR7KXCUUnAoMgvK9qTw@mail.gmail.com>
References: <CAPkN8xK9D881WobCOrjT0b4wAY4T4e-qx2GM70_SuQBZnZf5QA@mail.gmail.com>
<CAJA7-OekT8wyUkco1FWE21+mvtznHw4HR7KXCUUnAoMgvK9qTw@mail.gmail.com>
Message-ID: <CAHrZfZDOZaq7eu+e2ByrYz=7cBBW3z8=_pMwEZTA6YdFvhdaeQ@mail.gmail.com>
Sorry for the long delay but this is now fixed.
Richard
On 7 November 2012 01:14, Pior Bastida <pior at mtlpy.org> wrote:
> The same when I tried to import my ssh key.
>
>
> On Sat, Nov 3, 2012 at 11:26 AM, anatoly techtonik <techtonik at gmail.com>
> wrote:
>>
>> I thought you'd be interested to know
>>
>> Error processing form
>>
>> Key processing failed. Please contact the administrator. Detail: Traceback
>> (most recent call last):
>> File "/data/pypi/sshkeys_update.py", line 4, in <module>
>> c = config.Config("config.ini")
>> File "/data/pypi/config.py", line 10, in __init__
>> self.database_name = c.get('database', 'name')
>> File "/usr/lib/python2.7/ConfigParser.py", line 607, in get
>> raise NoSectionError(section)
>> ConfigParser.NoSectionError: No section: 'database'
>>
>> Please, CC.
>> --
>> anatoly t.
>>
>> _______________________________________________
>> Catalog-SIG mailing list
>> Catalog-SIG at python.org
>> http://mail.python.org/mailman/listinfo/catalog-sig
>>
>
>
>
> --
> Pior Bastida
> pior at mtlpy.org
> Org Montr?al-Python
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>
From noah at coderanger.net Wed Jan 23 09:23:10 2013
From: noah at coderanger.net (Noah Kantrowitz)
Date: Wed, 23 Jan 2013 00:23:10 -0800
Subject: [Catalog-sig] PyPI (and others) speed degraded
Message-ID: <5BE2A39F-D64D-4FDB-AE38-433163A21969@coderanger.net>
Hitting both lists because I am fading and need to sleep before an early flight. Can someone with appropriate access post something to Twitter et al that PyPI speeds will be degraded for the moment and that we are investigating? Other PyPI mirrors should be unaffected so now would be a good time to use one if you have PyPI in your deployment path until we get this sorted out in the morning. Thanks to Antoine for the initial report! OSU is now aware there is problem (we think it is a friendly DoS elsewhere on their network, read: someone is doing a full copy of one of their distro mirrors) and should be handled shortly, just probably won't be fully cleaned up until morning PST.
--Noah
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 203 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130123/cda7602a/attachment.pgp>
From ct at gocept.com Wed Jan 23 22:18:10 2013
From: ct at gocept.com (Christian Theune)
Date: Wed, 23 Jan 2013 22:18:10 +0100
Subject: [Catalog-sig] Pypi mirrors are inconsistent
References: <D4BC8290-9B73-4C17-8F00-F35F551114CA@gmail.com>
Message-ID: <kdpk2f$tis$1@ger.gmane.org>
On 2013-01-05 11:53:15 +0000, Jonas Baumann said:
> Hey there,
>
> Last month?the pypi mirrors got inconsistent regarding the dists of the
> package plone.testing.
>
> On the mirrors a and e there is a plone.testing==4.0.7,
> but on the mirrors b, c, d, f and g?this version is missing.
Right. I saw that one reported for my mirror (f) which triggered me
reinitialising the whole thing after looking around for a bit ? which
turns me to the other posts I'll send in a minute ?
From ct at gocept.com Wed Jan 23 22:48:05 2013
From: ct at gocept.com (Christian Theune)
Date: Wed, 23 Jan 2013 22:48:05 +0100
Subject: [Catalog-sig] Mirror page
References: <50864EA0.8010505@ziade.org>
Message-ID: <kdplqi$g36$1@ger.gmane.org>
On 2012-10-23 08:00:32 +0000, Tarek Ziad? said:
> Hey
>
> Looking at http://pypi.python.org/mirrors
>
> and Looking at http://www.pypi-mirrors.org/
>
> I find the later much more appealing :)
>
> If the Ken agrees and think it's a good idea, I'd like to propose to
> have a big link to http://www.pypi-mirrors.org/ on
> http://pypi.python.org/mirrors
> and also on the index page.
+1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks
like from somewhere "neutral". :)
From ct at gocept.com Wed Jan 23 22:52:32 2013
From: ct at gocept.com (Christian Theune)
Date: Wed, 23 Jan 2013 22:52:32 +0100
Subject: [Catalog-sig] pypi mirrors in bad shape
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
<19C11217545F4CB893B52B62113F71A1@gmail.com>
Message-ID: <kdpm2t$k2v$1@ger.gmane.org>
On 2013-01-16 15:41:00 +0000, Donald Stufft said:
> On Wednesday, January 16, 2013 at 4:43 AM, Jannis Leidel wrote:
> The mirror script was hanging on d, too. Since I've had to fix the
> mirror every other month now I wonder if the pep381client is up to the
> task. Does anyone have recommendations for fixing the situation? Is
> there an easy way to monitor the client and kill it if it runs longer
> than x?
> Should be able to use the timeout command.
>
> timeout -k HARD_LIMIT SOFT_LIMIT /path/pep381client/pep381run -q /var/pypi
I used to run this with "timeout 5m pep381run" but it seems that the
client really didn't like getting a SIGTERM.
Looking at the code there seems to be something special going on
regarding handling KeyboardInterrupt so I switched to using "timeout -2
5m ?".
Still, I saw a weird problem and I'm suspicious that the client really
doesn't always manage to write a consistent status file when being
terminated.
For some reason I'm reinitializing my whole mirror after only a day.
I think I'm happy running Tarek's branch on the f mirror for now, but
I'm not super sure about that ?
My proposal would be to sit down at PyCon to dig a bit more into the
code to make it more robust. My feeling is that the current client
tries way to hard on a very low-level API (httplib) for a lot of
mechanics. I'd be happy to refactor and provide tests, I think.
Also, a script to determine internal consistency and consistency
compared to PyPI would be nice. Then again, the rsync idea might not be
that far off regarding the amount of work and the problems we're
dealing with ?
Christian
From donald.stufft at gmail.com Wed Jan 23 22:59:28 2013
From: donald.stufft at gmail.com (Donald Stufft)
Date: Wed, 23 Jan 2013 16:59:28 -0500
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <kdpm2t$k2v$1@ger.gmane.org>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
<19C11217545F4CB893B52B62113F71A1@gmail.com>
<kdpm2t$k2v$1@ger.gmane.org>
Message-ID: <C6AE9AA355F94878A92BF178FC7D7590@gmail.com>
On Wednesday, January 23, 2013 at 4:52 PM, Christian Theune wrote:
>
> My proposal would be to sit down at PyCon to dig a bit more into the
> code to make it more robust. My feeling is that the current client
> tries way to hard on a very low-level API (httplib) for a lot of
> mechanics. I'd be happy to refactor and provide tests, I think.
>
> Also, a script to determine internal consistency and consistency
> compared to PyPI would be nice. Then again, the rsync idea might not be
> that far off regarding the amount of work and the problems we're
> dealing with ?
>
Crate.io uses it's own mirroring code that seems to handle things
a bit better than pep381client does (infact I originally wrote it because
of that). However it creates a full mirror with metadata and all and is
currently being refactored to be a ton simpler.
I still think for the "dumb" mirrors that setting up PyPI mirroring
protocol to work via rsync is the right direction to go in. Rsync
has way more manhours invested into it and a lot more testing
for what pep381client essentially boils down to which is "keep
these files and those files in sync".
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130123/22ca9d87/attachment.html>
From kencochrane at gmail.com Wed Jan 23 23:25:39 2013
From: kencochrane at gmail.com (Ken Cochrane)
Date: Wed, 23 Jan 2013 17:25:39 -0500
Subject: [Catalog-sig] Mirror page
In-Reply-To: <kdplqi$g36$1@ger.gmane.org>
References: <50864EA0.8010505@ziade.org> <kdplqi$g36$1@ger.gmane.org>
Message-ID: <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com>
I'm fine with a link to pypi-mirrors.org from the pypi site. If we find it useful, lets make it easier to find.
If you would like anything to change about it, let me know. It is also open source and I accept pull requests :)
Ken
Sent from my iPhone
On Jan 23, 2013, at 4:48 PM, Christian Theune <ct at gocept.com> wrote:
> On 2012-10-23 08:00:32 +0000, Tarek Ziad? said:
>
>> Hey
>> Looking at http://pypi.python.org/mirrors
>> and Looking at http://www.pypi-mirrors.org/
>> I find the later much more appealing :)
>> If the Ken agrees and think it's a good idea, I'd like to propose to
>> have a big link to http://www.pypi-mirrors.org/ on
>> http://pypi.python.org/mirrors
>> and also on the index page.
>
> +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks like from somewhere "neutral". :)
>
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
From richard at python.org Thu Jan 24 00:31:58 2013
From: richard at python.org (Richard Jones)
Date: Thu, 24 Jan 2013 10:31:58 +1100
Subject: [Catalog-sig] Mirror page
In-Reply-To: <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com>
References: <50864EA0.8010505@ziade.org> <kdplqi$g36$1@ger.gmane.org>
<27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com>
Message-ID: <CAHrZfZDqnC8Dzk9_dD93sxVruxR-1Hyco+fnAsBniS93=+5iMw@mail.gmail.com>
Great, thanks. Link added!
(and thanks for the great page!)
Richard
On 24 January 2013 09:25, Ken Cochrane <kencochrane at gmail.com> wrote:
> I'm fine with a link to pypi-mirrors.org from the pypi site. If we find it useful, lets make it easier to find.
>
> If you would like anything to change about it, let me know. It is also open source and I accept pull requests :)
>
> Ken
>
> Sent from my iPhone
>
> On Jan 23, 2013, at 4:48 PM, Christian Theune <ct at gocept.com> wrote:
>
>> On 2012-10-23 08:00:32 +0000, Tarek Ziad? said:
>>
>>> Hey
>>> Looking at http://pypi.python.org/mirrors
>>> and Looking at http://www.pypi-mirrors.org/
>>> I find the later much more appealing :)
>>> If the Ken agrees and think it's a good idea, I'd like to propose to
>>> have a big link to http://www.pypi-mirrors.org/ on
>>> http://pypi.python.org/mirrors
>>> and also on the index page.
>>
>> +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks like from somewhere "neutral". :)
>>
>>
>> _______________________________________________
>> Catalog-SIG mailing list
>> Catalog-SIG at python.org
>> http://mail.python.org/mailman/listinfo/catalog-sig
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>
From kencochrane at gmail.com Thu Jan 24 00:32:56 2013
From: kencochrane at gmail.com (ken cochrane)
Date: Wed, 23 Jan 2013 18:32:56 -0500
Subject: [Catalog-sig] Mirror page
In-Reply-To: <CAHrZfZDqnC8Dzk9_dD93sxVruxR-1Hyco+fnAsBniS93=+5iMw@mail.gmail.com>
References: <50864EA0.8010505@ziade.org> <kdplqi$g36$1@ger.gmane.org>
<27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com>
<CAHrZfZDqnC8Dzk9_dD93sxVruxR-1Hyco+fnAsBniS93=+5iMw@mail.gmail.com>
Message-ID: <CACBKDngUeS9_hKOHiXT0NcrY5Ua4bSob2RVXOOvrWVTyQzQmag@mail.gmail.com>
Sweet! Thanks.
Ken
On Wed, Jan 23, 2013 at 6:31 PM, Richard Jones <richard at python.org> wrote:
> Great, thanks. Link added!
>
> (and thanks for the great page!)
>
>
> Richard
>
>
> On 24 January 2013 09:25, Ken Cochrane <kencochrane at gmail.com> wrote:
> > I'm fine with a link to pypi-mirrors.org from the pypi site. If we find
> it useful, lets make it easier to find.
> >
> > If you would like anything to change about it, let me know. It is also
> open source and I accept pull requests :)
> >
> > Ken
> >
> > Sent from my iPhone
> >
> > On Jan 23, 2013, at 4:48 PM, Christian Theune <ct at gocept.com> wrote:
> >
> >> On 2012-10-23 08:00:32 +0000, Tarek Ziad? said:
> >>
> >>> Hey
> >>> Looking at http://pypi.python.org/mirrors
> >>> and Looking at http://www.pypi-mirrors.org/
> >>> I find the later much more appealing :)
> >>> If the Ken agrees and think it's a good idea, I'd like to propose to
> >>> have a big link to http://www.pypi-mirrors.org/ on
> >>> http://pypi.python.org/mirrors
> >>> and also on the index page.
> >>
> >> +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks
> like from somewhere "neutral". :)
> >>
> >>
> >> _______________________________________________
> >> Catalog-SIG mailing list
> >> Catalog-SIG at python.org
> >> http://mail.python.org/mailman/listinfo/catalog-sig
> > _______________________________________________
> > Catalog-SIG mailing list
> > Catalog-SIG at python.org
> > http://mail.python.org/mailman/listinfo/catalog-sig
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130123/563d733f/attachment.html>
From jannis at leidel.info Thu Jan 24 15:28:18 2013
From: jannis at leidel.info (Jannis Leidel)
Date: Thu, 24 Jan 2013 15:28:18 +0100
Subject: [Catalog-sig] pypi mirrors in bad shape
In-Reply-To: <C6AE9AA355F94878A92BF178FC7D7590@gmail.com>
References: <CACBKDng1VgSCNiMa3832aqichw8b4MtEYj6LJ4XbWyvambr_ZQ@mail.gmail.com>
<49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info>
<19C11217545F4CB893B52B62113F71A1@gmail.com>
<kdpm2t$k2v$1@ger.gmane.org>
<C6AE9AA355F94878A92BF178FC7D7590@gmail.com>
Message-ID: <CAGBHygkOwR7Y5CJjvEaiiSR3jfQHzJAgKeAQPZ1Urw=bt=3vCg@mail.gmail.com>
On Wed, Jan 23, 2013 at 10:59 PM, Donald Stufft <donald.stufft at gmail.com>wrote:
> On Wednesday, January 23, 2013 at 4:52 PM, Christian Theune wrote:
>
>
> My proposal would be to sit down at PyCon to dig a bit more into the
> code to make it more robust. My feeling is that the current client
> tries way to hard on a very low-level API (httplib) for a lot of
> mechanics. I'd be happy to refactor and provide tests, I think.
>
> Also, a script to determine internal consistency and consistency
> compared to PyPI would be nice. Then again, the rsync idea might not be
> that far off regarding the amount of work and the problems we're
> dealing with ?
>
> Crate.io uses it's own mirroring code that seems to handle things
> a bit better than pep381client does (infact I originally wrote it because
> of that). However it creates a full mirror with metadata and all and is
> currently being refactored to be a ton simpler.
>
> I still think for the "dumb" mirrors that setting up PyPI mirroring
> protocol to work via rsync is the right direction to go in. Rsync
> has way more manhours invested into it and a lot more testing
> for what pep381client essentially boils down to which is "keep
> these files and those files in sync".
>
Agreed.
But till that rsync API is set up, does anyone know what changed on PyPI
(or wherever) recently so that the mirrors so often go AWOL?
Jannis
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130124/00286db8/attachment.html>
From chris at simplistix.co.uk Sat Jan 26 10:33:00 2013
From: chris at simplistix.co.uk (Chris Withers)
Date: Sat, 26 Jan 2013 09:33:00 +0000
Subject: [Catalog-sig] test pypi server?
Message-ID: <5103A2CC.4090600@simplistix.co.uk>
Hi All,
I remember mention of a test PyPI server that had been set up.
Where can I find it?
I'm doing some automated release testing...
Chris
--
Simplistix - Content Management, Batch Processing & Python Consulting
- http://www.simplistix.co.uk
From holger.krekel at gmail.com Sat Jan 26 11:00:14 2013
From: holger.krekel at gmail.com (Holger Krekel)
Date: Sat, 26 Jan 2013 11:00:14 +0100
Subject: [Catalog-sig] test pypi server?
In-Reply-To: <5103A2CC.4090600@simplistix.co.uk>
References: <5103A2CC.4090600@simplistix.co.uk>
Message-ID: <CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
Hey Chris,
according to http://pypi.python.org there should be a test pypi server at
http://testpypi.python.org/pypi but at the moment it gives 502 Bad Gateway.
cheers,
holger
On Sat, Jan 26, 2013 at 10:33 AM, Chris Withers <chris at simplistix.co.uk>wrote:
> Hi All,
>
> I remember mention of a test PyPI server that had been set up.
> Where can I find it?
>
> I'm doing some automated release testing...
>
> Chris
>
> --
> Simplistix - Content Management, Batch Processing & Python Consulting
> - http://www.simplistix.co.uk
> ______________________________**_________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/**mailman/listinfo/catalog-sig<http://mail.python.org/mailman/listinfo/catalog-sig>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130126/c96c259f/attachment.html>
From chris at simplistix.co.uk Sat Jan 26 12:10:06 2013
From: chris at simplistix.co.uk (Chris Withers)
Date: Sat, 26 Jan 2013 11:10:06 +0000
Subject: [Catalog-sig] test pypi server?
In-Reply-To: <CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
References: <5103A2CC.4090600@simplistix.co.uk>
<CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
Message-ID: <5103B98E.4020508@simplistix.co.uk>
Hi Holger,
On 26/01/2013 10:00, Holger Krekel wrote:
> according to http://pypi.python.org there should be a test pypi server
> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad
> Gateway.
Indeed :-(
Anyone know when it will be fixed?
Chris
--
Simplistix - Content Management, Batch Processing & Python Consulting
- http://www.simplistix.co.uk
From richard at python.org Sat Jan 26 12:43:37 2013
From: richard at python.org (Richard Jones)
Date: Sat, 26 Jan 2013 22:43:37 +1100
Subject: [Catalog-sig] test pypi server?
In-Reply-To: <5103B98E.4020508@simplistix.co.uk>
References: <5103A2CC.4090600@simplistix.co.uk>
<CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
<5103B98E.4020508@simplistix.co.uk>
Message-ID: <CAHrZfZD4S=Eb7fpxDSsBkOU3Uuq15ZkS4huXaMNfzk=Or4ESAg@mail.gmail.com>
On 26 January 2013 22:10, Chris Withers <chris at simplistix.co.uk> wrote:
> On 26/01/2013 10:00, Holger Krekel wrote:
>> according to http://pypi.python.org there should be a test pypi server
>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad
>> Gateway.
>
>
> Indeed :-(
>
> Anyone know when it will be fixed?
It looks like it's working now. I'm not sure why it occasionally goes
into 502 hell.
Richard
From aclark at aclark.net Sat Jan 26 14:30:55 2013
From: aclark at aclark.net (Alex Clark)
Date: Sat, 26 Jan 2013 08:30:55 -0500
Subject: [Catalog-sig] test pypi server?
References: <5103A2CC.4090600@simplistix.co.uk>
<CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
<5103B98E.4020508@simplistix.co.uk>
<CAHrZfZD4S=Eb7fpxDSsBkOU3Uuq15ZkS4huXaMNfzk=Or4ESAg@mail.gmail.com>
Message-ID: <ke0lqc$g51$1@ger.gmane.org>
On 2013-01-26 11:43:37 +0000, Richard Jones said:
> On 26 January 2013 22:10, Chris Withers <chris at simplistix.co.uk> wrote:
>> On 26/01/2013 10:00, Holger Krekel wrote:
>>> according to http://pypi.python.org there should be a test pypi server
>>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad
>>> Gateway.
>>
>>
>> Indeed :-(
>>
>> Anyone know when it will be fixed?
>
> It looks like it's working now. I'm not sure why it occasionally goes
> into 502 hell.
There is also:
- http://index.pythonpackages.com
for your test releasing pleasure. No credentials required :-)
>
>
> Richard
--
Alex Clark ? https://www.gittip.com/aclark4life/
From chris at simplistix.co.uk Mon Jan 28 08:10:27 2013
From: chris at simplistix.co.uk (Chris Withers)
Date: Mon, 28 Jan 2013 07:10:27 +0000
Subject: [Catalog-sig] test pypi server?
In-Reply-To: <CAHrZfZD4S=Eb7fpxDSsBkOU3Uuq15ZkS4huXaMNfzk=Or4ESAg@mail.gmail.com>
References: <5103A2CC.4090600@simplistix.co.uk>
<CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
<5103B98E.4020508@simplistix.co.uk>
<CAHrZfZD4S=Eb7fpxDSsBkOU3Uuq15ZkS4huXaMNfzk=Or4ESAg@mail.gmail.com>
Message-ID: <51062463.2010500@simplistix.co.uk>
On 26/01/2013 11:43, Richard Jones wrote:
> On 26 January 2013 22:10, Chris Withers<chris at simplistix.co.uk> wrote:
>> On 26/01/2013 10:00, Holger Krekel wrote:
>>> according to http://pypi.python.org there should be a test pypi server
>>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad
>>> Gateway.
>>
>>
>> Indeed :-(
>>
>> Anyone know when it will be fixed?
>
> It looks like it's working now. I'm not sure why it occasionally goes
> into 502 hell.
When I checked shortly after you sent this, it was back to 502s on most,
but not all, requests...
Any ideas?
Chris
--
Simplistix - Content Management, Batch Processing & Python Consulting
- http://www.simplistix.co.uk
From noah at coderanger.net Mon Jan 28 10:05:25 2013
From: noah at coderanger.net (Noah Kantrowitz)
Date: Mon, 28 Jan 2013 01:05:25 -0800
Subject: [Catalog-sig] test pypi server?
In-Reply-To: <51062463.2010500@simplistix.co.uk>
References: <5103A2CC.4090600@simplistix.co.uk>
<CAPJJ-pLvK7aW+Cf4Bg4-KxE7_2OkoOKMX+ZmoLJdGZOO6mr6Rg@mail.gmail.com>
<5103B98E.4020508@simplistix.co.uk>
<CAHrZfZD4S=Eb7fpxDSsBkOU3Uuq15ZkS4huXaMNfzk=Or4ESAg@mail.gmail.com>
<51062463.2010500@simplistix.co.uk>
Message-ID: <F4749F10-3217-4F7E-97DF-2A7C0498E54F@coderanger.net>
On Jan 27, 2013, at 11:10 PM, Chris Withers wrote:
> On 26/01/2013 11:43, Richard Jones wrote:
>> On 26 January 2013 22:10, Chris Withers<chris at simplistix.co.uk> wrote:
>>> On 26/01/2013 10:00, Holger Krekel wrote:
>>>> according to http://pypi.python.org there should be a test pypi server
>>>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad
>>>> Gateway.
>>>
>>>
>>> Indeed :-(
>>>
>>> Anyone know when it will be fixed?
>>
>> It looks like it's working now. I'm not sure why it occasionally goes
>> into 502 hell.
>
> When I checked shortly after you sent this, it was back to 502s on most, but not all, requests...
>
> Any ideas?
Just for the hell of it (though it is going to annihilate all my overall reports) I added testpypi to our monitoring, no point in making it alert at this point though. Someone let me know when this is sorted and I'll make it email places.
--Noah
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 203 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130128/783f888a/attachment.pgp>
From noah at coderanger.net Thu Jan 31 19:11:54 2013
From: noah at coderanger.net (Noah Kantrowitz)
Date: Thu, 31 Jan 2013 10:11:54 -0800
Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage
In-Reply-To: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com>
References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com>
Message-ID: <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net>
Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias.
--Noah
On Jan 31, 2013, at 9:00 AM, Steve Holden wrote:
> Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-)
>
> Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this.
>
> S
>
> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
> --
> Python classes (and much more) through the web http://oreillyschool.com/
> Conferences and technical event management at http://theopenbastion.com/
>
> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>
>
> ________________________________________________
> Infrastructure mailing list
> Infrastructure at python.org
> http://mail.python.org/mailman/listinfo/infrastructure
> Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 203 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130131/5e026b7f/attachment.pgp>
From steve at holdenweb.com Thu Jan 31 19:25:48 2013
From: steve at holdenweb.com (Steve Holden)
Date: Thu, 31 Jan 2013 10:25:48 -0800
Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage
In-Reply-To: <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net>
References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com>
<3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net>
Message-ID: <AD61AE6B-3755-413A-B3C3-B2B0EEB625DC@holdenweb.com>
I think we may have reached that stage.
S
On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote:
> Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias.
>
> --Noah
>
> On Jan 31, 2013, at 9:00 AM, Steve Holden wrote:
>
>> Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-)
>>
>> Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this.
>>
>> S
>>
>> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
>> --
>> Python classes (and much more) through the web http://oreillyschool.com/
>> Conferences and technical event management at http://theopenbastion.com/
>>
>> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
>> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>>
>>
>> ________________________________________________
>> Infrastructure mailing list
>> Infrastructure at python.org
>> http://mail.python.org/mailman/listinfo/infrastructure
>> Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net
>
Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
--
Python classes (and much more) through the web http://oreillyschool.com/
Conferences and technical event management at http://theopenbastion.com/
Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130131/b10b12ef/attachment.html>
From kencochrane at gmail.com Thu Jan 31 19:36:21 2013
From: kencochrane at gmail.com (ken cochrane)
Date: Thu, 31 Jan 2013 13:36:21 -0500
Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage
In-Reply-To: <AD61AE6B-3755-413A-B3C3-B2B0EEB625DC@holdenweb.com>
References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com>
<3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net>
<AD61AE6B-3755-413A-B3C3-B2B0EEB625DC@holdenweb.com>
Message-ID: <CACBKDniYxsyuJbdpu7=_ZQiAJKQCRE3hckQrQqaQscQinphRUg@mail.gmail.com>
FYI d.pypi.python.org is run by Jannis Leidel, the person who sent the
tweet. so he knows about the issues.
Ken
On Thu, Jan 31, 2013 at 1:25 PM, Steve Holden <steve at holdenweb.com> wrote:
> I think we may have reached that stage.
>
> S
>
> On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote:
>
> Alas this, and all other PyPI mirrors, are run independently so not much
> we can do except encourage people to check the mirror status page at
> pypi-mirrors.org. The catalog-sig team I think has contact info for each
> mirror, so thats another option to try and reach out, and as a last resort
> we could revoke the DNS alias.
>
> --Noah
>
> On Jan 31, 2013, at 9:00 AM, Steve Holden wrote:
>
> Is this known about? Being worked on? Someone else's problem? According to
> http://bit.ly/WAG99u we've had a (mirror?) host down for four days with
> no action. Shouldn't there be regular automated functionality checks on
> this? Isn't it wonderful being a volunteer? ;-)
>
>
> Is there anything we can do abut this situation, or is the host not under
> our control? Don't want to make trouble as you are probably busy enough
> already, so not copying the board on this.
>
>
> S
>
>
> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
>
> --
>
> Python classes (and much more) through the web http://oreillyschool.com/
>
> Conferences and technical event management at http://theopenbastion.com/
>
>
> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
>
> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>
>
>
> ________________________________________________
>
> Infrastructure mailing list
>
> Infrastructure at python.org
>
> http://mail.python.org/mailman/listinfo/infrastructure
>
> Unsubscribe:
> http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net
>
>
>
> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
> --
> Python classes (and much more) through the web http://oreillyschool.com/
> Conferences and technical event management at http://theopenbastion.com/
>
> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>
>
>
>
>
>
>
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130131/4d17da2d/attachment-0001.html>
From steve at holdenweb.com Thu Jan 31 20:32:55 2013
From: steve at holdenweb.com (Steve Holden)
Date: Thu, 31 Jan 2013 11:32:55 -0800
Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage
In-Reply-To: <CACBKDniYxsyuJbdpu7=_ZQiAJKQCRE3hckQrQqaQscQinphRUg@mail.gmail.com>
References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com>
<3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net>
<AD61AE6B-3755-413A-B3C3-B2B0EEB625DC@holdenweb.com>
<CACBKDniYxsyuJbdpu7=_ZQiAJKQCRE3hckQrQqaQscQinphRUg@mail.gmail.com>
Message-ID: <BC57E2B7-392F-4DD0-A64D-601D2254D4D2@holdenweb.com>
Thanks Ken. I sent Jannis a DM asking him if he knew who it was, but have had no response yet :)
regards
Steve
On Jan 31, 2013, at 10:36 AM, ken cochrane wrote:
> FYI d.pypi.python.org is run by Jannis Leidel, the person who sent the tweet. so he knows about the issues.
>
> Ken
>
>
> On Thu, Jan 31, 2013 at 1:25 PM, Steve Holden <steve at holdenweb.com> wrote:
> I think we may have reached that stage.
>
> S
>
> On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote:
>
>> Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias.
>>
>> --Noah
>>
>> On Jan 31, 2013, at 9:00 AM, Steve Holden wrote:
>>
>>> Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-)
>>>
>>> Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this.
>>>
>>> S
>>>
>>> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
>>> --
>>> Python classes (and much more) through the web http://oreillyschool.com/
>>> Conferences and technical event management at http://theopenbastion.com/
>>>
>>> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
>>> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>>>
>>>
>>> ________________________________________________
>>> Infrastructure mailing list
>>> Infrastructure at python.org
>>> http://mail.python.org/mailman/listinfo/infrastructure
>>> Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net
>>
>
> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
> --
> Python classes (and much more) through the web http://oreillyschool.com/
> Conferences and technical event management at http://theopenbastion.com/
>
> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
>
>
>
>
>
>
>
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>
>
Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb
--
Python classes (and much more) through the web http://oreillyschool.com/
Conferences and technical event management at http://theopenbastion.com/
Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/
Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/catalog-sig/attachments/20130131/c693f412/attachment.html>