http error 301 for urlopen
nagle at animats.com
Mon Nov 8 07:28:10 CET 2010
On 11/7/2010 5:51 PM, D'Arcy J.M. Cain wrote:
> On Sun, 7 Nov 2010 19:30:23 -0600
> Wenhuan Yu<yuwenhuan at gmail.com> wrote:
>> I tried to open a link with urlopen:
>> import urllib2
>> alink = "
>> f = urllib2.urlopen(alink)
>> print f.read()
>> and got the followinig error:
>> urllib2.HTTPError: HTTP Error 301: The HTTP server returned a redirect error
>> that would lead to an infinite loop.
>> The last 30x error message was:
>> Moved Permanently
>> I can open the link in browser. Any way to get solve this? Thanks.
> I checked with my tools and was told that it redirects more than five
> times. Maybe it's not infinite but too many for urlopen. Or, maybe
> the browser just ignores the extra redirects and the part of the page
> with the redirects isn't critical for viewing it. I think that you are
> going to have to investigate the HTML manually and follow all the
> individual links to find the problem. You may have to put in a bug
> request with the New York Times. Good luck with that.
It's the New York Times' paywall. They're trying to set a cookie,
and will redirect the URL until you store and return the cookie.
More information about the Python-list