[Catalog-sig] PyPI outage
lac at openend.se
Sat Aug 4 08:59:29 CEST 2007
In a message of Thu, 02 Aug 2007 22:38:54 +0200, =?ISO-8859-15?Q?=22Martin_v=2
>Can anybody suggest a more reliable way to prevent crawlers
>from hitting the wiki so hard?
I assume that this particular spider isn't named. But in case I
am wrong: http://www.fleiner.com/bots/#banning has an example of
how to ban the inktomi spider named Slurp.
More information about the Catalog-SIG