download pages using a cookies.txt file

[Jabba Laci]

Hi,

Thanks, I could put together the pieces and here is my solution:

(1) get_cookies_in_cookiejar function to extract cookies and put them
in a cookiejar:
https://github.com/jabbalaci/jabbapylib/blob/master/jabbapylib/web/export_firefox_cookies.py

(2) download page using urllib2 and passing the cookiejar:
https://github.com/jabbalaci/jabbapylib/blob/master/jabbapylib/web/web.py
See the bottom with get_page_with_cookies_using_cookiejar(url).

Laszlo


On Mon, Sep 5, 2011 at 22:19, Chris Rebert <clp2 at rebertia.com> wrote:
> On Mon, Sep 5, 2011 at 6:36 PM, Jabba Laci <jabba.laci at gmail.com> wrote:
>> Hi,
>>
>> I would like to download a page that requires authentication with
>> cookies. I've already figured out how to do it with wget (blog post
>> here: http://bit.ly/pp25LP). In short:
>> (1) extract cookies from Firefox's cookies.sqlite and store them in a text file
>> (2) wget --cookies=on --load-cookies=cookies.txt
>> --keep-session-cookies "http://..."
>>
>> My question is: how to do it from Python?
>
> http://docs.python.org/library/cookielib.html#cookielib.MozillaCookieJar
>
> Cheers,
> Chris
>