Feature Requests item #1070016, was opened at 2004-11-20 14:20 Message generated for change (Comment added) made by shub You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=350103&aid=1070016...

Category: None Group: None Status: Open Resolution: None Priority: 5 Submitted By: Peer Heinlein (pheinlein) Assigned to: Nobody/Anonymous (nobody) Summary: Better way to manage google & co

Initial Comment: It`s possible to disallow google to index a public web-archive of a mailinglist by a robots.txt.

But it would be much nicer if a admin could change this behavior in the MM-admin-config-interface.

If a flag like "robots_allow_index" is set to NO, pipermail should add a HTML-Header

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

to each html-page generated by pipermail.

----------------------------------------------------------------------

Comment By: Brad Knowles (shub) Date: 2004-11-25 15:16

Message: Logged In: YES user_id=18417

Actually, on another project I'm working on, we've found that robots.txt doesn't seem to stop Google. They index the page anyway.

It would definitely be nice if we could find other ways to stop them from doing that.

----------------------------------------------------------------------

You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=350103&aid=1070016...