Urllib's urlopen and urlretrieve
hermanmu at gmail.com
Thu Feb 21 13:59:26 CET 2013
Are you just trying to get the html? If so, you can use this code-
*# fetch the and download a webpage, nameing it test.html*
I recommend using the requests library, as it's easier to use and more
*# retrive the webpage
r = requests.get("http://www.web2py.com/")*
*# write the content to test_request.html
with open("test_requests.html", "wb") as code:
If you want to get up to speed quickly on internet programming, I have a
course I am developing. It's on kickstarter - http://kck.st/VQj8hq. The
first section of the book dives into web fundamentals and internet
On Thu, Feb 21, 2013 at 4:12 AM, <qoresucks at gmail.com> wrote:
> I only just started Python and given that I know nothing about network
> programming or internet programming of any kind really, I thought it would
> be interesting to try write something that could create an archive of a
> website for myself. With this I started trying to use the urllib library,
> however I am having a problem understanding why certain things wont work
> with the urllib.urlretrieve and urllib.urlopen then reading.
> Why is it that when using urllib.urlopen then reading or
> urllib.urlretrieve, does it only give me parts of the sites, loosing the
> formatting, images, etc...? How can I get around this?
> Lastly, while its a bit off topic, I lack a good understanding of network
> programming as a whole. From making programs communicate or to simply
> extract data from URL's, I don't know where to even begin, which has lead
> me to learning python to better understand it hopefully then carry it over
> to other languages I know. Can anyone give me some advice on where to begin
> learning this information? Even if its in another language.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the Python-list