[Doc-SIG] docs.python.org, .txt and search engines

jason kirtland jason.kirtland at gmail.com
Fri Dec 12 16:59:24 CET 2008

The reST sources on http://docs.python.org/ are getting indexed in
Google and ":mod:`whatnot`" is showing up in search results.  That's
been more distracting than valuable to me in my searches.  Maybe add a
robots.txt exclusion for /_sources and the other _sources directories
on docs.python.org?

  User-agent: *
  Disallow: /_sources/
  Disallow: /3.0/_sources/


More information about the Doc-SIG mailing list