Mailman 3 May 2010 - lxml - The Python XML Toolkit

[lxml-dev] Unable to build lxml
by Russ Johnson May 25, 2010

May 25, 2010

I'm attempting to built lxml 2.2.6 for Python 2.7b2 on Windows XP using static linking, but the build fails with the following error: > python setup.py install --static Building lxml version 2.2.6. NOTE: Trying to build without Cython, pre-generated 'src/lxml/lxml.etree.c' need s to be available. ERROR: 'xslt-config' is not recognized as an internal or external command, operable program or batch file. ** make sure the development packages of libxml2 and libxslt are installed ** Using build configuration of libxslt Building against libxml2/libxslt in one of the following directories: ..\iconv-1.9.2.win32\lib ..\libxml2-2.7.6.win32\lib ..\libxslt-1.1.26.win32\lib ..\zlib-1.2.3.win32\lib running build running build_py running build_ext building 'lxml.etree' extension error: Unable to find vcvarsall.bat I gathered from http://codespeak.net/lxml/build.html#static-linking-on-windows that I need development packages, but I'm at a loss where to find them. Any suggestions? Russ

1 0

[lxml-dev] Accessing text of an element when using itemparse
by Alex Bernier May 25, 2010

May 25, 2010

Hello, When using itemparse, during 'start' event, is the text of an element accessible ? Or text can only be accessed during 'end' event ? from sys import stdout from lxml.etree import iterparse if __name__ == '__main__': context = iterparse("in.xml",events=('start','end')) for event, element in context: if event=='start' and (type(element.text) is unicode or type(element.text) is str): stdout.write(element.text.encode('utf-8')) I get different results with this code and the same one replacing "if event=='start'" by "if event=='end'" : is it normal ? Best regards, Alex Bernier

2 1

[lxml-dev] Confused as to use a class or a function: Writing XML files using lxml and Python
by Lashkara Singh May 24, 2010

May 24, 2010

Hi. I need to write XML files using lxml and Python. However, I can't figure out whether to use a class to do this or a function. The point being, this is the first time I am developing a proper software and deciding where and why to use a class still seems mysterious. I will illustrate my point. For example, consider the following function based code I wrote for adding a subelement to a etree root. from lxml import etree > > root = etree.Element('document') > > def createSubElement(text, tagText = ""): > etree.SubElement(root, text) > # How do I do this: element.text = tagText > > createSubElement('firstChild') > createSubElement('SecondChild') > As expected, the output of this is: <document> > <firstChild/> > <SecondChild/> > </document> > However as you can notice the comment, I have no idea how to do set the text variable using this approach. Is using a class the only way to solve this? And if yes, can you give me some pointers on how to achieve this?

2 1

[lxml-dev] Building Python2.6 Windows eggs
by Laurence Rowe May 23, 2010

May 23, 2010

I've been unable to build lxml under windows using mingw, having followed the instructions from: * http://plone.org/documentation/kb/using-buildout-on-windows * http://codespeak.net/lxml/build.html#static-linking-on-windows The full error message is attached, but this seems to be the same undefined refernece problems people have run into before (e.g. http://osdir.com/ml/python.lxml.devel/2007-07/msg00039.html). Any idea what I'm doing wrong? Or do I need visual studio? It would be great if someone could build a python 2.6 Windows egg and upload it to pypi! Laurence

2 1

[lxml-dev] Can't get lxml to work with Python 3 (installation with errors, importing works, usage doesn't)
by codethief May 21, 2010

May 21, 2010

> Hmmm, looks like these two files are not used in the test suite. > > Anyway, unless you really want to use them, you'll be fine with all the > rest. So, are those two files actually part of the test suite or do they belong to the library and just aren't tested in the test suite for Python 3? Either way, this is a bug which should be reported, isn't it? > That's because you are passing a byte string as path. Might be a bug in Py3, > don't know. Passing a unicode string instead will help. >> Does this maybe have something to do with essentially parsing a byte >> stream? > > Unless "self.rfile" *is* the byte stream - no. XML is a sequence of bytes > anyway. In case you mixed up the interface and self.rfile actually contains > the data instead of a filename, wrap it in a BytesIO instance. Path? Filename? Doesn't iterparse expect a file-like object to read() from? See http://codespeak.net/lxml/tutorial.html#event-driven-parsing. self.rfile is such a file-like object with read access to the bytes coming in through the socket (as described here: http://docs.python.org/release/3.1.1/library/socketserver.html). Anyway, xml.etree does its thing perfectly here and takes the bytes stream representing ASCII characters (as of now, will be UTF-8 later on) without complaining (but we need proper namespace support so it's not an option). As lxml promises to be 99% compatible to xml.etree, something must be wrong here. Should I file a bug report? -- Simon Hirscher http://simonhirscher.de

2 1

[lxml-dev] Using XMLSchema to validate a document with multiple namespace pairs in schemaLocation attribute
by Aron Bierbaum May 21, 2010

May 21, 2010

We have been trying to use the XMLSchema validation capabilities in order to validate the result that we get from a WMS server. We are having problems because the document that we are trying to validate lists multiple schemas in the schemaLocation attribute. Is there currently a way to accomplish this with lxml/libxml2? I have attached an example of what we are attempting. lxml: 2.2.2 libxml2: 2.7.3 Thank you, Aron

1 0

[lxml-dev] Can't get lxml to work with Python 3 (installation with errors, importing works, usage doesn't)
by codethief May 20, 2010

May 20, 2010

Hey developers :) we're already excited about using lxml in our project, though can't quite get it to work. First of all: We (me and another guy) are both running Ubuntu 10.04 x64 and Python 3. It began when easy_installing the package: -- $ sudo easy_install3 lxml Searching for lxml Reading http://pypi.python.org/simple/lxml/ Reading http://codespeak.net/lxml Best match: lxml 2.2.6 Downloading http://codespeak.net/lxml/lxml-2.2.6.tgz Processing lxml-2.2.6.tgz Running lxml-2.2.6/setup.py -q bdist_egg --dist-dir /tmp/easy_install-X0lzwT/lxml-2.2.6/egg-dist-tmp-Sv2xWe Building lxml version 2.2.6. NOTE: Trying to build without Cython, pre-generated 'src/lxml/lxml.etree.c' needs to be available. Using build configuration of libxslt 1.1.26 Building against libxml2/libxslt in the following directory: /usr/lib File "build/bdist.linux-x86_64/egg/lxml/html/_diffcommand.py", line 37 print 'Error: you must give two files' ^ SyntaxError: invalid syntax File "build/bdist.linux-x86_64/egg/lxml/html/_html5builder.py", line 80 root = html.fromstring(u''.join(buf)) ^ SyntaxError: invalid syntax File "/usr/local/lib/python3.1/dist-packages/lxml-2.2.6-py3.1-linux-x86_64.egg/lxml/html/_diffcommand.py", line 37 print 'Error: you must give two files' ^ SyntaxError: invalid syntax File "/usr/local/lib/python3.1/dist-packages/lxml-2.2.6-py3.1-linux-x86_64.egg/lxml/html/_html5builder.py", line 80 root = html.fromstring(u''.join(buf)) ^ SyntaxError: invalid syntax Adding lxml 2.2.6 to easy-install.pth file Installed /usr/local/lib/python3.1/dist-packages/lxml-2.2.6-py3.1-linux-x86_64.egg Processing dependencies for lxml Finished processing dependencies for lxml -- It looks like python (v3?) is complaining about v2 features? Anyway, importing works (at least, it seems so): $ python3 >>> from lxml import etree >>> However, we can't get our code to work: -- import socketserver from lxml import etree #from xml.etree import ElementTree as etree import settings class CloudiaServer(socketserver.ThreadingMixIn, socketserver.TCPServer): pass class RequestHandler(socketserver.StreamRequestHandler): def handle(self): for event, element in etree.iterparse(self.rfile): if event != 'end': continue print(element.tag) print(str(element.attrib)) print(element.text) element.clean() if __name__ == '__main__': server = CloudiaServer((settings.host, settings.port), RequestHandler) server.serve_forever() -- As soon as our client connects and sends b'<foo bar="quux">text</foo>', the server process outputs: -- Exception happened during processing of request from ('127.0.0.1', 39620) Traceback (most recent call last): File "/usr/lib/python3.1/socketserver.py", line 558, in process_request_thread self.finish_request(request, client_address) File "/usr/lib/python3.1/socketserver.py", line 320, in finish_request self.RequestHandlerClass(request, client_address, self) File "/usr/lib/python3.1/socketserver.py", line 614, in __init__ self.handle() File "/home/codethief/projekte/cloudia/server/src/server.py", line 13, in handle for event, element in etree.iterparse(self.rfile): File "iterparse.pxi", line 378, in lxml.etree.iterparse.__init__ (src/lxml/lxml.etree.c:85769) File "apihelpers.pxi", line 1503, in lxml.etree._getFilenameForFile (src/lxml/lxml.etree.c:22366) File "/usr/lib/python3.1/posixpath.py", line 363, in abspath if not isabs(path): File "/usr/lib/python3.1/posixpath.py", line 61, in isabs return s.startswith(sep) AttributeError: 'int' object has no attribute 'startswith' -- Does this maybe have something to do with essentially parsing a byte stream? -- Simon Hirscher http://simonhirscher.de

2 2

[lxml-dev] How to get a header from xml file
by Sosnovskiy Alexander May 19, 2010

May 19, 2010

Library is perfect , but I have a small problem. Can someone give me an advice of how to get href = ...... - path to xsl file from the following xml-file : <?xml version="1.0" encoding="utf-8" ?> <?xml-stylesheet href="../xsl/index.xsl" type="text/xsl" ?> <root> </root> Thanks in advance :)

3 2

[lxml-dev] Fwd: How to get a header from xml file
by Chuck Bearden May 19, 2010

May 19, 2010

Sorry, I should have replied to the list as well for future readers. ---------- Forwarded message ---------- From: Chuck Bearden <cfbearden(a)gmail.com> Date: Wed, May 19, 2010 at 10:50 AM Subject: Re: [lxml-dev] How to get a header from xml file To: Sosnovskiy Alexander <alecs.box(a)gmail.com> On Wed, May 19, 2010 at 6:45 AM, Sosnovskiy Alexander <alecs.box(a)gmail.com> wrote: > Library is perfect , but I have a small problem. > Can someone give me an advice of how to get href = ...... - path to xsl > file from the following xml-file : > > <?xml version="1.0" encoding="utf-8" ?> > <?xml-stylesheet href="../xsl/index.xsl" type="text/xsl" ?> > <root> > </root> > > Thanks in advance :) Here are two approaches: >>> from StringIO import StringIO >>> from lxml import etree >>> parser = etree.XMLParser(remove_pis=False) >>> xString = """<?xml version="1.0" encoding="utf-8" ?> ... <?xml-stylesheet href="../xsl/index.xsl" type="text/xsl" ?> ... <root> ... </root> ... """ >>> xTree = etree.parse(StringIO(xString), parser) # The ElementTree way >>> xTree.getroot().getprevious() <?xml-stylesheet href="../xsl/index.xsl" type="text/xsl" ?> >>> # The XPath way >>> xTree.xpath('/processing-instruction()') [<?xml-stylesheet href="../xsl/index.xsl" type="text/xsl" ?>] >>> procInstruction = xTree.xpath('/processing-instruction()')[0] >>> procInstruction.text 'href="../xsl/index.xsl" type="text/xsl" ' XML and related technologies don't define an API for access to the innards of a PI, so you'll have to use text processing tools to parse the pseudo attribute/value pairs. Best wishes, Chuck

1 0

[lxml-dev] lxml install problem
by xyz May 19, 2010

May 19, 2010

Hello, I use CentOS 5.2 without root access and therefore I installed Python in my home folder. Unfortunately, I was not able to get lxml running in the following way: ------ ftp://xmlsoft.org/libxml/ cd ~/temp/libxml2-2.7.7 $ configure --prefix=/home/mit/bin/libxml2 $ make $ make install $ cd /home/mit/programs/python/lib/python2.6/site-packages $ ln -s /home/mit/bin/libxml2/lib/python2.6/site-packages/* . ---------- ftp://xmlsoft.org/libxslt/ $ ./configure --prefix=/home/mit/bin/libxslt --with-libxml-prefix=/home/mit/bin/libxml2 $ make $ make install $ cd /home/mit/programs/python/lib/python2.6/site-packages $ ln -s /home/mit/bin/libxslt/lib/python2.6/site-packages/* . --------- $ cd ~/temp/lxml-2.2.6/ $ python setup.py install --with-xml2-config=/home/mit/bin/libxml2/bin/xml2-config --with-xslt-config=/home/mit/bin/libxslt/bin/xslt-config -------- I got errors by testing the lxml in the following: $python Python 2.6.4 (r264:75706, Jan 28 2010, 14:19:59) [GCC 4.1.2 20071124 (Red Hat 4.1.2-42)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> from lxml import etree Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: symbol xmlSchematronSetValidStructuredErrors, version LIBXML2_2.6.32 not defined in file libxml2.so.2 with link time reference >>> I also tried this: $ldd /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxslt.so.1: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: /usr/lib64/libxml2.so.2: no version information available (required by /home/mit/programs/python/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so) libxslt.so.1 => /usr/lib64/libxslt.so.1 (0x00002b6c90034000) libexslt.so.0 => /usr/lib64/libexslt.so.0 (0x00002b6c90269000) libxml2.so.2 => /usr/lib64/libxml2.so.2 (0x00002b6c9047b000) libz.so.1 => /usr/lib64/libz.so.1 (0x00002b6c907b9000) libm.so.6 => /lib64/libm.so.6 (0x00002b6c909cd000) libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b6c90c50000) libc.so.6 => /lib64/libc.so.6 (0x00002b6c90e6b000) libgcrypt.so.11 => /usr/lib64/libgcrypt.so.11 (0x00002b6c911bf000) libgpg-error.so.0 => /usr/lib64/libgpg-error.so.0 (0x00002b6c9140b000) libdl.so.2 => /lib64/libdl.so.2 (0x00002b6c9160f000) /lib64/ld-linux-x86-64.so.2 (0x0000003501c00000) libnsl.so.1 => /lib64/libnsl.so.1 (0x00002b6c91813000) What did I wrong? Thank you in advance. Best regards,

2 8