[Catalog-sig] PyPI outage
Laura Creighton
lac at openend.se
Sat Aug 4 08:59:29 CEST 2007
In a message of Thu, 02 Aug 2007 22:38:54 +0200, =?ISO-8859-15?Q?=22Martin_v=2
E_L=F6wis=22?= writes:
>Can anybody suggest a more reliable way to prevent crawlers
>from hitting the wiki so hard?
>
>Regards,
>Martin
I assume that this particular spider isn't named. But in case I
am wrong: http://www.fleiner.com/bots/#banning has an example of
how to ban the inktomi spider named Slurp.
Laura
More information about the Catalog-SIG
mailing list