Mailman 3 July 2008 - lxml - The Python XML Toolkit

[lxml-dev] Premature end of data in tag - but it looks well formed
by Mike MacCana July 1, 2008

July 1, 2008

Hi gents, Firstly, thanks for lxml. It's by far the nicest tool for someone who needs to do xpath in python without being an XML god. I'm a first time user of lxml attempting to etree.parse a document. My code (below) works fine on some sample text, but libxml complains about the real data with: etree.XMLSyntaxError: line 196: Premature end of data in tag html line 5 The data is below. Line 5 seems OK to me, but I'm new to XML coding so maybe I'm missing something. __________________________________ 1 2 3 <?xml version="1.0" encoding="iso-8859-1"?> 4 <!DOCTYPE html PUBLIC"-//W3C//DTD XHTML 1.0 Transitional//EN""http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> 5 <html xmlns="http://www.w3.org/1999/xhtml"> __________________________________ Any ideas? The full code is below. Cheers, Mike #!/usr/bin/env python import urllib, sys, lxml, StringIO from lxml import etree from StringIO import StringIO # Use http://www.someproxy.com:3128 for http proxying proxies = {'http': 'http://xpvm:3128'} url='http://peoplesearch.in.telstra.com.au:8094/peoplesearch/userdetail.aspx?Bas…' filehandle = urllib.urlopen(url, proxies=proxies) print filehandle ## Real html html=filehandle.read() ## Test html #html="<foo><bar><baz>underpants</baz></bar></foo>" print "--------------------------------" print html print '==========================' f = StringIO(html) tree = etree.parse(f) ## Real xpath r = tree.xpath('/html/body/div[4]/form/div[3]/div/div/div/div/table/tbody/tr[6]/td') ## Test xpath #r = tree.xpath('/foo/bar/baz') print 'length:' print len(r) print 'tag:' print r[0].tag print 'contents:' print r[0].text ________________________________________________ Mike MacCana Technical Specialist Australia Linux and Virtualisation Services IBM Global Services Level 14, 60 City Rd Southgate Vic 3000 Phone: +61-3-8656-2138 Fax: +61-3-8656-2423 Email: mmaccana(a)au1.ibm.com

2 3

[lxml-dev] objectify.deannotate: call to etree.cleanup_namespaces in 2.1beta
by Holger Joukl July 1, 2008

July 1, 2008

Hi, I have a usecase where I need to deannotate an objectified tree and then manually set py:pytype or xsi:type attributes. However, this seems to be getting difficult with 2.1beta as deannotate wipes out all nsmap information with its call to cleanup_namespaces(), and I cannot set a namespaced attribute through <elt>.set(...) Maybe I'm missing something and there's a convenient way to do this? If not, could we make the call to cleanup_namespaces optional (defaults to True) in deannotate()? Holger -- GMX startet ShortView.de. Hier findest Du Leute mit Deinen Interessen! Jetzt dabei sein: http://www.shortview.de/?mc=sv_ext_mf@gmx

3 4

[lxml-dev] Segmentation fault in lxml.html after pickling
by Marcel Hellkamp July 1, 2008

July 1, 2008

This script crashes with a segmentation fault :/ Using Python-2.5.2, libxslt-1.1.9, libxml2-2.6.32, lxml-2.1beta2, linux-i686 #!/usr/bin/python # coding=utf-8 import cPickle import lxml, lxml.html html = '''<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "DTD/xhtml1-strict.dtd"> <?xml version="1.0" encoding="UTF-8"?> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <title>Test Page</title> </head> <body> Test Page </body> </html>''' tree = lxml.html.fromstring(html) cf = open('test.pcl', 'w') cPickle.dump(tree, cf, -1) cf.close() cf = open('test.pcl', 'r') pickled_tree = cPickle.load(cf) cf.close() print 'This works fine...' lxml.html.tostring(tree) print 'This crashes...' lxml.html.tostring(pickled_tree)

4 6