Scipy.org is down + question about "topical software"
Dear all, First of all, scipy.org appears to be down and has been for some time today. Yesterday, when it was still up, I registered an account and tried adding a link to the topical software section but got the error "too many links". Does anybody know how/if I can fix this? kind regards, Michael
scipy.org. is back up. I don't know about the "too many links" problem. That might be a limitation of the wiki software. Warren On Tue, Aug 7, 2012 at 8:49 AM, Michael Clerx <cell@michaelclerx.com> wrote:
Dear all,
First of all, scipy.org appears to be down and has been for some time today.
Yesterday, when it was still up, I registered an account and tried adding a link to the topical software section but got the error "too many links". Does anybody know how/if I can fix this?
kind regards, Michael
_______________________________________________ SciPy-Dev mailing list SciPy-Dev@scipy.org http://mail.scipy.org/mailman/listinfo/scipy-dev
On 7 August 2012 15:49, Michael Clerx <cell@michaelclerx.com> wrote:
First of all, scipy.org appears to be down and has been for some time today.
Yesterday, when it was still up, I registered an account and tried adding a link to the topical software section but got the error "too many links". Does anybody know how/if I can fix this?
One fix might be to kill all the dead links (there are plenty, see http://validator.w3.org/checklink?uri=http%3A%2F%2Fscipy.org%2FTopical_Software&hide_type=all&depth=&check=Check). I wasted 30 minutes starting to do this a few days ago, but lost my changes to an internal server error. I'll have another go sometime, but not this week. The other (better) alternative is to split the sections into several pages and prune dead links at the same time. This sort of clean-up would be appreciated and would help with migrating the site away from the wiki.. Cheers, Scott
On 08/08/2012 08:55 AM, Scott Sinclair wrote:
On 7 August 2012 15:49, Michael Clerx <cell@michaelclerx.com> wrote:
First of all, scipy.org appears to be down and has been for some time today.
Yesterday, when it was still up, I registered an account and tried adding a link to the topical software section but got the error "too many links". Does anybody know how/if I can fix this? One fix might be to kill all the dead links (there are plenty, see http://validator.w3.org/checklink?uri=http%3A%2F%2Fscipy.org%2FTopical_Software&hide_type=all&depth=&check=Check).
I wasted 30 minutes starting to do this a few days ago, but lost my changes to an internal server error. I'll have another go sometime, but not this week.
The other (better) alternative is to split the sections into several pages and prune dead links at the same time.
This sort of clean-up would be appreciated and would help with migrating the site away from the wiki..
Cheers, Scott _______________________________________________ SciPy-Dev mailing list SciPy-Dev@scipy.org http://mail.scipy.org/mailman/listinfo/scipy-dev
I've just tried to make a start with such a split, but I think the problem isn't simply an upper bound on the number of links; I think it's to do with permissions. As it stands, I'm unable to save the page without adding any new links. Similarly, no option to create new pages is presented. kind regards, Michael
Am 08.08.2012 08:55, schrieb Scott Sinclair:
On 7 August 2012 15:49, Michael Clerx <cell@michaelclerx.com> wrote:
First of all, scipy.org appears to be down and has been for some time today.
Yesterday, when it was still up, I registered an account and tried adding a link to the topical software section but got the error "too many links". Does anybody know how/if I can fix this?
One fix might be to kill all the dead links (there are plenty, see http://validator.w3.org/checklink?uri=http%3A%2F%2Fscipy.org%2FTopical_Software&hide_type=all&depth=&check=Check).
I also get the "too many links" error. However, I doubt it's related to the page's contents, and therefore I don't think reducing the number of hyperlinks on the page will make the error go away. The stack trace my browser shows me says that the "too many links" is raised by a call to os.mkdir, so it must be a problem of the webserver's filesystem. Can the admins check how many files are in the directory /home/scipy/wiki/data/pages/? I suspect it's more than the file systems limitation (2^15 in case of ext2/3, IIRC). Maybe Moinmoin doesn't clean orphaned Backups from that directory automatically, and a cronjob could help? Cheers, A.
Hello, On Wed, Aug 8, 2012 at 4:09 AM, Andreas Hilboll <lists@hilboll.de> wrote:
I also get the "too many links" error. However, I doubt it's related to the page's contents, and therefore I don't think reducing the number of hyperlinks on the page will make the error go away.
The stack trace my browser shows me says that the "too many links" is raised by a call to os.mkdir, so it must be a problem of the webserver's filesystem.
Can the admins check how many files are in the directory /home/scipy/wiki/data/pages/? I suspect it's more than the file systems limitation (2^15 in case of ext2/3, IIRC).
Maybe Moinmoin doesn't clean orphaned Backups from that directory automatically, and a cronjob could help?
You are right, there are a LOT of files in there, mostly spam. Here is a sampling: drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indigo(2d)airlines(2d)office(2d)in(2d)chennai(2d)188 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1)xxoo(2ce5b0b1e58ebbe788b1)97(2e)com(2b)www(2e)360jqsplts(2e)cn(2b)97(e5b0b1e58ebbe788b1e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e79a84e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn(e889b2)97(e788b12c)97(e788b1e7bd91e7ab99) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 7(e788b1e69c80e696b0e7bd91e59d802c)97(e788b1e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e79a84e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 knocked drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e7be8ee5a5b3e8a3b8e4bd93)www(2e)360jqsplts(2e)cn(e5a5b3e4b88be983a8e8a3b8e4bd93e585a8e8baabe785a7e59bbe) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 Ningbo(2b)Tourism drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e6bf80e68385e783ade8889e)www(2e)360jqsplts(2e)cn(e6bf80e68385e4baa4e58f8b2ce6bf80e68385e78987) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 dgjingheng(2b)screw drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 cement(2b)mixer drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 wow(2b)gold(2d2d)aggressor(2b)Ottawa drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 (e89b8be9a5bce8a5bfe696bd) drwxrwx--- 3 scipy scipy 4096 Jul 15 2009 fluid(2d)restriction(2d)airlines(2d)62(2f)MoinEditorBackup I don't know much about MoinMoin - can I delete all directories with the word "Backup" ending them? Thanks, Ognen
Hello,
On Wed, Aug 8, 2012 at 4:09 AM, Andreas Hilboll <lists@hilboll.de> wrote:
I also get the "too many links" error. However, I doubt it's related to the page's contents, and therefore I don't think reducing the number of hyperlinks on the page will make the error go away.
The stack trace my browser shows me says that the "too many links" is raised by a call to os.mkdir, so it must be a problem of the webserver's filesystem.
Can the admins check how many files are in the directory /home/scipy/wiki/data/pages/? I suspect it's more than the file systems limitation (2^15 in case of ext2/3, IIRC).
Maybe Moinmoin doesn't clean orphaned Backups from that directory automatically, and a cronjob could help?
You are right, there are a LOT of files in there, mostly spam. Here is a sampling:
drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indigo(2d)airlines(2d)office(2d)in(2d)chennai(2d)188 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1)xxoo(2ce5b0b1e58ebbe788b1)97(2e)com(2b)www(2e)360jqsplts(2e)cn(2b)97(e5b0b1e58ebbe788b1e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e79a84e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn(e889b2)97(e788b12c)97(e788b1e7bd91e7ab99) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 7(e788b1e69c80e696b0e7bd91e59d802c)97(e788b1e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e79a84e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 knocked drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e7be8ee5a5b3e8a3b8e4bd93)www(2e)360jqsplts(2e)cn(e5a5b3e4b88be983a8e8a3b8e4bd93e585a8e8baabe785a7e59bbe) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 Ningbo(2b)Tourism drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e6bf80e68385e783ade8889e)www(2e)360jqsplts(2e)cn(e6bf80e68385e4baa4e58f8b2ce6bf80e68385e78987) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 dgjingheng(2b)screw drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 cement(2b)mixer drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 wow(2b)gold(2d2d)aggressor(2b)Ottawa drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 (e89b8be9a5bce8a5bfe696bd) drwxrwx--- 3 scipy scipy 4096 Jul 15 2009 fluid(2d)restriction(2d)airlines(2d)62(2f)MoinEditorBackup
I don't know much about MoinMoin - can I delete all directories with the word "Backup" ending them?
I don't really knot MoinMoin either. I would however assume that it's save to remove all files with ``MoinEditorBackup`` in their names, which are older than, asy, a day. How many would those be? If it's a significant amount, you should consider deleting those directories (maybe after adding them to a TAR backup). Cheers, A.
On Wed, Aug 8, 2012 at 10:14 AM, Andreas Hilboll <lists@hilboll.de> wrote:
Hello,
On Wed, Aug 8, 2012 at 4:09 AM, Andreas Hilboll <lists@hilboll.de> wrote:
I also get the "too many links" error. However, I doubt it's related to the page's contents, and therefore I don't think reducing the number of hyperlinks on the page will make the error go away.
The stack trace my browser shows me says that the "too many links" is raised by a call to os.mkdir, so it must be a problem of the webserver's filesystem.
Can the admins check how many files are in the directory /home/scipy/wiki/data/pages/? I suspect it's more than the file systems limitation (2^15 in case of ext2/3, IIRC).
Maybe Moinmoin doesn't clean orphaned Backups from that directory automatically, and a cronjob could help?
You are right, there are a LOT of files in there, mostly spam. Here is a sampling:
drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 kingfisher(2d)red(2d)airline(2d)website(2d)161 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indigo(2d)airlines(2d)office(2d)in(2d)chennai(2d)188 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 japan(2d)airlines(2d)ticket(2d)confirmation(2d)11 drwxrwx--- 3 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18(2f)MoinEditorBackup drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 indian(2d)airlines(2d)economy(2d)fares(2d)18 drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1)xxoo(2ce5b0b1e58ebbe788b1)97(2e)com(2b)www(2e)360jqsplts(2e)cn(2b)97(e5b0b1e58ebbe788b1e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e79a84e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn(e889b2)97(e788b12c)97(e788b1e7bd91e7ab99) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 97(e788b1e69c80e696b0e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 7(e788b1e69c80e696b0e7bd91e59d802c)97(e788b1e7bd91e59d80)www(2e)360jqsplts(2e)cn97(e788b1e79a84e69c80e696b0e7bd91e59d80) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 knocked drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e7be8ee5a5b3e8a3b8e4bd93)www(2e)360jqsplts(2e)cn(e5a5b3e4b88be983a8e8a3b8e4bd93e585a8e8baabe785a7e59bbe) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 Ningbo(2b)Tourism drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 (e6bf80e68385e783ade8889e)www(2e)360jqsplts(2e)cn(e6bf80e68385e4baa4e58f8b2ce6bf80e68385e78987) drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 dgjingheng(2b)screw drwxrwx--- 2 scipy scipy 4096 Jul 16 2009 cement(2b)mixer drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 wow(2b)gold(2d2d)aggressor(2b)Ottawa drwxrwx--- 2 scipy scipy 4096 Jul 15 2009 (e89b8be9a5bce8a5bfe696bd) drwxrwx--- 3 scipy scipy 4096 Jul 15 2009 fluid(2d)restriction(2d)airlines(2d)62(2f)MoinEditorBackup
I don't know much about MoinMoin - can I delete all directories with the word "Backup" ending them?
I don't really knot MoinMoin either. I would however assume that it's save to remove all files with ``MoinEditorBackup`` in their names, which are older than, asy, a day. How many would those be? If it's a significant amount, you should consider deleting those directories (maybe after adding them to a TAR backup).
I am just tarring everything up now and will proceed to delete everything that is older than August. Ognen
On Wed, Aug 8, 2012 at 10:21 AM, Ognen Duzlevski <ognen@enthought.com> wrote:
I am just tarring everything up now and will proceed to delete everything that is older than August. Ognen
OK - I have deleted the obvious suspects but there are many more. I will try and figure out a way to do this better. Ognen
On Wed, Aug 8, 2012 at 4:33 PM, Ognen Duzlevski <ognen@enthought.com> wrote:
On Wed, Aug 8, 2012 at 10:21 AM, Ognen Duzlevski <ognen@enthought.com> wrote:
I am just tarring everything up now and will proceed to delete everything that is older than August. Ognen
OK - I have deleted the obvious suspects but there are many more. I will try and figure out a way to do this better.
Every page directory that doesn't have a file named "current" in it is considered deleted. It's likely that many of the spam pages have been deleted through the web interface, but still exist on disk. http://moinmo.in/MoinDev/Storage -- Robert Kern
Robert, On Wed, Aug 8, 2012 at 10:43 AM, Robert Kern <robert.kern@gmail.com> wrote:
Every page directory that doesn't have a file named "current" in it is considered deleted. It's likely that many of the spam pages have been deleted through the web interface, but still exist on disk.
Thanks, that helps, somewhat. There are a bunch of spam pages that have the current file in them so I still have to figure out some way to whack what is to be whacked and keep what is to be kept without spending a week on it ;) Ognen
On Wed, Aug 8, 2012 at 12:36 PM, Ognen Duzlevski <ognen@enthought.com> wrote:
Thanks, that helps, somewhat. There are a bunch of spam pages that have the current file in them so I still have to figure out some way to whack what is to be whacked and keep what is to be kept without spending a week on it ;)
There are 22832 subdirectories in the /home/scipy/wiki/data/pages directory. Anyone has any experience fighting MoinMoin spam? :) Ognen
On Wed, Aug 8, 2012 at 11:33 AM, Ognen Duzlevski <ognen@enthought.com> wrote:
On Wed, Aug 8, 2012 at 10:21 AM, Ognen Duzlevski <ognen@enthought.com> wrote:
I am just tarring everything up now and will proceed to delete everything that is older than August. Ognen
OK - I have deleted the obvious suspects but there are many more. I will try and figure out a way to do this better. Ognen
Hi, I just tried to edit http://www.scipy.org/Topical_Software and encountered the "Too many links" error. Is it possible for someone to delete old entries again? Maybe a solution could be to have a cronjob that deletes "MoinEditorBackup" entries that are older than a few days. Best, Martin
participants (7)
-
Andreas Hilboll -
Martin Luessi -
Michael Clerx -
Ognen Duzlevski -
Robert Kern -
Scott Sinclair -
Warren Weckesser