For one of our casino websites we're trying the BeautifulSoup module which can handle HTML and XML. It should provide a simple method for searching, navigating and modifying the parse tree. However? Can we store and push this right away?
The example below prints all links on a webpage:
from BeautifulSoup import BeautifulSoup import urllib2 import re
html_page = urllib2.urlopen("https://www.online-casino-spielautomaten.de") soup = BeautifulSoup(html_page) for link in soup.findAll('a', attrs={'href': re.compile("^http://%22)%7D): print link.get('href')
It downloads the raw html code with the line:
html_page = urllib2.urlopen("https://www.online-casino-spielautomaten.de")
A BeautifulSoup object is created and we use this object to find all links:
soup = BeautifulSoup(html_page) for link in soup.findAll('a', attrs={'href': re.compile("^http://%22)%7D): print link.get('href')