[Doc-SIG] docs.python.org, .txt and search engines
jason kirtland
jason.kirtland at gmail.com
Fri Dec 12 16:59:24 CET 2008
The reST sources on http://docs.python.org/ are getting indexed in
Google and ":mod:`whatnot`" is showing up in search results. That's
been more distracting than valuable to me in my searches. Maybe add a
robots.txt exclusion for /_sources and the other _sources directories
on docs.python.org?
User-agent: *
Disallow: /_sources/
Disallow: /3.0/_sources/
Cheers,
Jason
More information about the Doc-SIG
mailing list