[Catalog-sig] PyPI outage

Laura Creighton lac at openend.se
Sat Aug 4 08:59:29 CEST 2007


In a message of Thu, 02 Aug 2007 22:38:54 +0200, =?ISO-8859-15?Q?=22Martin_v=2
E_L=F6wis=22?= writes:
>Can anybody suggest a more reliable way to prevent crawlers
>from hitting the wiki so hard?
>
>Regards,
>Martin

I assume that this particular spider isn't named.  But in case I
am wrong: http://www.fleiner.com/bots/#banning  has an example of
how to ban the inktomi spider named Slurp.

Laura



More information about the Catalog-SIG mailing list