[Moin-user] Spider problem

[Juergen Hermann]

Hi!

Another way to solve the spider problem is to simply reject any non-std 
pages to spider User-Agents. So please put the UserAgents of your 
favourite spiders on

http://twistedmatrix.com/users/jh.twistd/moin/moin.cgi/WebSpiders

so I can set up a default config list for them.

To get at the U-A fields, simply check your event log.


Ciao, Jürgen