An issue on CodePlex - <a href="http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=651" title="http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=651" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=651</a> - was raised on my behalf to do with performance using BeautifulSoup (a forgiving HTML parser).
<br><br>Here's a simple test which does the parsing and the "prettifying" - the process where BeautifulSoup rewrites the HTML in an attempt to make it well-formed.<br><br>The benchmark processes 2 different urls, loads them into BeautifulSoup and then reads out the "pretty" (or better-formed) html. I can't use urllib because it's apparently not been implemented (see
<span style="font-size: 11pt; color: rgb(31, 73, 125);"><a href="http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=1368" title="http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=1368" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">
http://www.codeplex.com/WorkItem/View.aspx?ProjectName=IronPython&WorkItemId=1368</a></span>) so what I've done is two scripts.<br><br>makeFiles.py script, which should be run in CPython, reads the urls and writes them to files.
<br>test.py is the actual benchmark, and the other one is the actual benchmark. The code for both is at the end of this message<br><br>These are the results I'm getting:<br><br>CPython 2.4<br>------------------<br>ran test_getHtml in
0.00 seconds<br>ran test_load in 0.28 seconds<br>ran test_prettify in 0.05 seconds<br>ran benchmark in 0.33 seconds<br><br>IronPython 1.0 RC1<br>----------------------------<br>ran test_getHtml in 0.04
seconds<br>ran test_load in 2.49 seconds<br>ran test_prettify in 0.24 seconds<br>ran benchmark in 2.77 seconds<br><br>So you can see that IronPython is significantly slower than CPython on BeautifulSoup parsing.
<br>#---- makeFiles.py<br>import urllib<br><br>def test_getHtml(url):<br> f = urllib.urlopen(url)<br> html = f.read()<br> f.close()<br> <br> return html<br><br>def saveFile(fName, data):<br> f = open(fName, "w")
<br> f.write(data)<br> f.close()<br> return<br><br>urls = ["<a href="http://news.bbc.co.uk/2/hi/middle_east/5213602.stm">http://news.bbc.co.uk/2/hi/middle_east/5213602.stm</a>", "<a href="http://www.cnn.com/2006/US/07/25/highway.shootings.ap/index.html">
http://www.cnn.com/2006/US/07/25/highway.shootings.ap/index.html</a>"]<br>files = ["c:\\bbc.html", "c:\\cnn.html"]<br><br>i = 0<br>for url in urls:<br> fName = files[i]<br> i += 1<br> data = test_getHtml(url)
<br> saveFile(fName, data)<br> <br><br><br>#test.py<br>#-----------------------------------------------------------------------------------------------------------------<br>#| Code Start<br>#-----------------------------------------------------------------------------------------------------------------
<br>import sys<br>sys.path.append("C:\\Python24\\Lib")<br><br>from BeautifulSoup import BeautifulSoup<br>import time<br><br>def test_getFile(fileName):<br> f = open(fileName, "r")<br> html = f.read
()<br> f.close()<br> <br> return html<br><br>def test_load(html):<br> s = BeautifulSoup(html)<br> return s<br><br>def test_prettify(s):<br> t = s.prettify()<br> return t<br><br>files = ["c:\\bbc.html", "c:\\cnn.html"]
<br>testCount = 2<br><br>benchmarkStart = time.clock()<br>time_getHtml = 0<br>time_load = 0<br>time_prettify = 0<br><br>for i in range(testCount):<br><br> for file in files:<br> fName = files[i]<br> testStart =
time.clock()<br> html = test_getFile(fName)<br> testEnd = time.clock()<br> time_getHtml += testEnd - testStart<br> <br> testStart = time.clock()<br> s = test_load(html)<br> testEnd =
time.clock()<br> time_load += testEnd - testStart<br><br> testStart = time.clock()<br> t = test_prettify(s)<br> testEnd = time.clock()<br> time_prettify += testEnd - testStart<br>
<br>benchmarkEnd = time.clock()<br><br>print 'ran test_getHtml in \t%.2f seconds' % (time_getHtml)<br>print 'ran test_load in \t%.2f seconds' % (time_load)<br>print 'ran test_prettify in \t%.2f seconds' % (time_prettify)<br>
<br>print 'ran benchmark in \t%.2f seconds' % (benchmarkEnd - benchmarkStart)<br>#-----------------------------------------------------------------------------------------------------------------<br>#| Code End<br>#-----------------------------------------------------------------------------------------------------------------
<br><br>