urllib and persistence
cartermark46 at ukmail.com
Sun Mar 23 11:05:15 CET 2003
I have been using python to download and process files from the
using the urllib to great effect:
f = urllib.urlopen(url)
txt = f.read()
I now find that I want to download files from a site that requires a
user ID and password -
which I have. The problem is, though, that when I use urllib to
the URL I'm interested in, the page that is returned to me is the
If I were using Internet Explorer, then I could login, and view the
was interested in. So, it is apparent that the connection between
and the server site has some kind of
"persistence" to it.
What I need to do, therefore, is understand what is going on, in order
around the login problem.
Actually, I'm not insistent that the downloads are done in python.
really need is a way of logging in, and then performing a bulk
from a list of URLs that I have (which could be stored in a text file,
More information about the Python-list