trouble getting google through urllib
Will McGugan
will at willNOmcguganSPAM.com
Tue Dec 19 03:13:34 EST 2006
Dr. Locke Z2A wrote:
> Does anyone know how I would get the bot to have permission to get the
> url? When I put the url in on firefox it works fine. I noticed that in
> the output html that google gave me it replaced some of the characters
> in the url with different stuff like the "&" and "%7C", so I'm
> thinking thats the problem, does anyone know how I would make it keep
> the url as I intended it to be?
>
Google doesnt like Python scripts. You will need to pretend to be a
browser by setting the user-agent string in the HTTP header.
Will McGugan
--
blog: http://www.willmcgugan.com
More information about the Python-list
mailing list