[Catalog-sig] PyPI outage

Laura Creighton lac at openend.se
Sat Aug 4 08:59:29 CEST 2007

In a message of Thu, 02 Aug 2007 22:38:54 +0200, =?ISO-8859-15?Q?=22Martin_v=2
E_L=F6wis=22?= writes:
>Can anybody suggest a more reliable way to prevent crawlers
>from hitting the wiki so hard?

I assume that this particular spider isn't named.  But in case I
am wrong: http://www.fleiner.com/bots/#banning  has an example of
how to ban the inktomi spider named Slurp.


More information about the Catalog-SIG mailing list