http error 301 for urlopen

Hans-Peter Jansen hpj at urpla.net
Wed Nov 10 11:03:03 EST 2010


On Tuesday 09 November 2010, 03:10:24 Lawrence D'Oliveiro wrote:
> In message <4cd7987e$0$1674$742ec2ed at news.sonic.net>, John Nagle 
wrote:
> >    It's the New York Times' paywall.  They're trying to set a
> > cookie, and will redirect the URL until you store and return the
> > cookie.
>
> And if they find out you’re acessing them from a script, they’ll
> probably try to find a way to block that as well.

..which could be alleviated by carefully crafting the requests ;-)

Luckily, unpleasant related ground work was already done by others, 
e.g.: http://bugs.python.org/issue2275

Pete




More information about the Python-list mailing list