Mailman 3 May 2005 - lxml - The Python XML Toolkit

[lxml-dev] Feature request / patch: Copy a node
by Florian Wagner 01 Jul '05

01 Jul '05

I do have to make copies of nodes in an application I'm writing, so I've tried making a patch for lxml to allow me to do that. The patch is attached, but since I don't have experience with Pyrex and libxml2 there could well be something wrong with it. It seems to work, though. Also I don't know if creating a new document / _ElementTree for the new nodes is the right thing to do, but I suppose it should be... Regards Florian Index: src/lxml/etree.pyx =================================================================== --- src/lxml/etree.pyx (revision 12556) +++ src/lxml/etree.pyx (working copy) @@ -370,7 +370,21 @@ c_node = c_node.next else: raise ValueError, "Matching element could not be found" + + def copy(self, recursive = True): + # 1 = copy recursive; 2 = don't copy recursive + recursive = int(not recursive) + 1 + + cdef xmlNode* c_node + cdef xmlDoc* c_doc + c_doc = theParser.newDoc() + etree = _elementTreeFactory(c_doc) + c_node = tree.xmlDocCopyNode(self._c_node, c_doc, recursive) + tree.xmlDocSetRootElement(c_doc, c_node) + + return _elementFactory(etree, c_node) + # PROPERTIES property tag: def __get__(self):

2 3

[lxml-dev] Validating xml files against a DTD
by Jeff_Gayle＠sil.org 15 Jun '05

15 Jun '05

I have a dumb question. This is my first experience with libxml2 and lxml and I was wonder how to validate an xml file given a DTD either on the internet or in a catalog (whatever that is). I have read the api.txt file and it has a nice example on how to do this with a RelaxNG file but it does not show an example of how to validate against a DTD. Is it enough to have the declaration in the top of xml file and the parser will automatically validated it? If that is the case, I would think you would want to turn the validation off in certain cases. I briefly looked at the etree.c file but given that I've not done any wrapping of 'C' code, it's kind of hard to figure out the api. ...jeff

3 2

[lxml-dev] 0.6 on Tiger
by Florent Guillaume 02 Jun '05

02 Jun '05

Just a success report: lxml 0.6 compiles (and tests) OK on Tiger (Mac OS X 10.4.1), using the stock versions of libxml2 and libxslt: $ otool -L /usr/local/lib/python2.3/site-packages/lxml/etree.so /usr/local/lib/python2.3/site-packages/lxml/etree.so: /usr/lib/libxml2.2.dylib (compatibility version 9.0.0, current version 9.16.0) /usr/lib/libxslt.1.dylib (compatibility version 3.0.0, current version 3.11.0) /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 88.0.0) $ xsltproc --version Using libxml 20616, libxslt 10111 and libexslt 809 xsltproc was compiled against libxml 20616, libxslt 10111 and libexslt 809 libxslt 10111 was compiled against libxml 20616 libexslt 809 was compiled against libxml 20616 Note that libxslt is 1.1.11, not the recommended 1.1.12 in INSTALL.txt. Should I expect problems ? Florent -- Florent Guillaume, Nuxeo (Paris, France) CTO, Director of R&D +33 1 40 33 71 59 http://nuxeo.com fg(a)nuxeo.com

2 1

[Fwd: Re: [lxml-dev] ElementTree.write implementation]
by Emil Kroymann 27 May '05

27 May '05

This should have been CCd to the list.

2 3

[lxml-dev] ElementTree.write implementation
by Emil Kroymann 26 May '05

26 May '05

Hello, I just discovered lxml last week and I must say it definitely fills a gap as I am pretty fed up with the complexity of the libxml2 Python bindings. I think I will lxml for my xml work. I played around a bit with the ElementTree.write method. I think it contains a bug: It does not respect the encoding parameter given. Output is always us-ascii encoded. Charakters missing from us-ascii are replaced by unicode charakter entities. I looked up the implementation of ElementTree.write in the lxml source and I think I found the problem. It is that, the xmlDocDumpMemory function is used to serialize the tree. This function does not do any encoding conversion. The output of this function is then encoded using the Python-library encoding functions. But this has no effect, as the output of xmlDocDumpMemory is in us-ascii encoding. I think a solution to this would be to use a libxml2 xmlOutputBuffer and the xmlSaveToEnc function to implement the ElementTree.write function. I am willing to supply a patch to this, if there are no concerns which I didn't think of. Thanks a lot, Emil

2 3

[lxml-dev] Building 0.6 on Windows
by Fredrik Lundh 26 May '05

26 May '05

I just tried building the 0.6 release on Windows, using the Win32 libxml distribution from: http://www.zlatkovic.com/libxml.en.html Fixing the setup file was pretty trivial, the behaviour when Pyrex wasn't installed was a bit surprising (but easy to fix), but I've now stumbled upon a more annoying problem -- the output from Pyrex doesn't include any "include" statements for libxml and libxslt, so building doesn't work that well. cd lxml-0.6/src/lxml/ grep -n include *.c NUL etree.c:3:#include "Python.h" etree.c:4:#include "structmember.h" etree.c:14272:#include "compile.h" etree.c:14273:#include "frameobject.h" etree.c:14274:#include "traceback.h" Has anyone seen this before? Are there any more includes in the sources on a successful build? Should the C sources perhaps be included in the source distribution, so you can build without Pyrex if you don't plan to hack on the code? </F>

2 2

[lxml-dev] XInclude support
by Martijn Faassen 23 May '05

23 May '05

Hi there, I've enabled simple XInclude support. If you call the new .xinclude() method on a document, it will proceed with XInclude processing. If people are interested to test this, let me know how it works out. Regards, Martijn

3 5

[lxml-dev] lxml - undefined symbol: xmlDictFree
by Krishna M 19 May '05

19 May '05

Hi all, I have installed lxml properly but there is some problem when I try to import etree from lxml module; importing lxml in python prompt works. Below is the full traceback. File "/home/kmuthyala/zope276/instances/myzope/Products/Railroad/service.py", line 15, in ? import rrxml File "/home/kmuthyala/zope276/instances/myzope/Products/Railroad/rrxml.py", line 4, in ? from lxml import etree ImportError: /home/kmuthyala/python24/lib/python2.4/site-packages/lxml/etree.so: undefined symbol: xmlDictFree Any hints regarding this will be greatly appreciated. Thanks in advance --Krishna

2 5

Re: [lxml-dev] lxml - undefined symbol: xmlDictFree
by Krishna M 19 May '05

19 May '05

Sorry for the duplicate mail. Martijn Faassen wrote: > Krishna M wrote: > >> Martijn Faassen wrote: > > > >> >> This is the output >> >> [~/]$ xsltproc --version >> Using libxml 20504, libxslt 10027 and libexslt 718 >> xsltproc was compiled against libxml 20504, libxslt 10027 and >> libexslt 718 >> libxslt 10027 was compiled against libxml 20504 >> libexslt 718 was compiled against libxml 20504 > > > > This is a very old version, going back to february 2003. This may well > explain why things don't work. Please upgrade to a more recent > version, such as version 2.6.16 and libxslt 1.1.12. Sorry I could not notice the errors I am getting while installing lxml. Though I am getting errors, it has copied lxml module into python-> site-packages. When I try to reinstall the same I could notice this error. Is this error because of older version of lixml and libxslt? Note : I have installed Pyregx-0.9.3 which is required for lxml. Following is the error. [root@Node25 lxml]# python24 setup.py install running install running build running build_py running build_ext building 'lxml.etree' extension gcc -pthread -fno-strict-aliasing -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -fPIC -I/usr/local/include/libxml2/libxml -I/usr/local/include/libxml2 -I/include -I/home/kmuthyala/python24/include/python2.4 -c src/lxml/etree.c -o build/temp.linux-i686-2.4/src/lxml/etree.o -w In file included from /usr/local/include/libxml2/libxml/xmlIO.h:21, from src/lxml/etree.c:11: /usr/local/include/libxml2/libxml/parser.h:46: parse error before "xmlParserInputBufferPtr" /usr/local/include/libxml2/libxml/parser.h:57: `free' redeclared as different kind of symbol /usr/include/stdlib.h:569: previous declaration of `free' /usr/local/include/libxml2/libxml/parser.h:61: parse error before '}' token /usr/local/include/libxml2/libxml/parser.h:472: parse error before "xmlParserInputBufferPtr" /usr/local/include/libxml2/libxml/parser.h:541: parse error before "xmlInputReadCallback" /usr/local/include/libxml2/libxml/parser.h:547: parse error before "xmlParserInputBufferPtr" In file included from src/lxml/etree.c:12: /usr/local/include/libxml2/libxml/xmlstring.h:29: redefinition of `xmlChar' /usr/local/include/libxml2/libxml/tree.h:80: `xmlChar' previously declared here /usr/local/include/libxml2/libxml/xmlstring.h:41: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:42: parse error before "xmlStrdup" /usr/local/include/libxml2/libxml/xmlstring.h:42: conflicting types for `xmlStrdup' /usr/local/include/libxml2/libxml/parser.h:382: previous declaration of `xmlStrdup' /usr/local/include/libxml2/libxml/xmlstring.h:43: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:44: parse error before "xmlStrndup" /usr/local/include/libxml2/libxml/xmlstring.h:45: conflicting types for `xmlStrndup' /usr/local/include/libxml2/libxml/parser.h:384: previous declaration of `xmlStrndup' /usr/local/include/libxml2/libxml/xmlstring.h:46: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:47: parse error before "xmlCharStrndup" /usr/local/include/libxml2/libxml/xmlstring.h:48: conflicting types for `xmlCharStrndup' /usr/local/include/libxml2/libxml/parser.h:386: previous declaration of `xmlCharStrndup' /usr/local/include/libxml2/libxml/xmlstring.h:49: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:50: parse error before "xmlCharStrdup" /usr/local/include/libxml2/libxml/xmlstring.h:50: conflicting types for `xmlCharStrdup' /usr/local/include/libxml2/libxml/parser.h:387: previous declaration of `xmlCharStrdup' /usr/local/include/libxml2/libxml/xmlstring.h:51: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:52: parse error before "xmlStrsub" /usr/local/include/libxml2/libxml/xmlstring.h:54: conflicting types for `xmlStrsub' /usr/local/include/libxml2/libxml/parser.h:390: previous declaration of `xmlStrsub' /usr/local/include/libxml2/libxml/xmlstring.h:55: syntax error before "const" /usr/local/include/libxml2/libxml/xmlstring.h:56: parse error before "xmlStrchr" /usr/local/include/libxml2/libxml/xmlstring.h:57: conflicting types for `xmlStrchr' /usr/local/include/libxml2/libxml/parser.h:392: previous declaration of `xmlStrchr' /usr/local/include/libxml2/libxml/xmlstring.h:58: syntax error before "const" /usr/local/include/libxml2/libxml/xmlstring.h:59: parse error before "xmlStrstr" /usr/local/include/libxml2/libxml/xmlstring.h:60: conflicting types for `xmlStrstr' /usr/local/include/libxml2/libxml/parser.h:394: previous declaration of `xmlStrstr' /usr/local/include/libxml2/libxml/xmlstring.h:61: syntax error before "const" /usr/local/include/libxml2/libxml/xmlstring.h:62: parse error before "xmlStrcasestr" /usr/local/include/libxml2/libxml/xmlstring.h:63: conflicting types for `xmlStrcasestr' /usr/local/include/libxml2/libxml/parser.h:396: previous declaration of `xmlStrcasestr' /usr/local/include/libxml2/libxml/xmlstring.h:64: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:67: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:71: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:74: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:78: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:81: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:85: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:87: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:88: parse error before "xmlStrcat" /usr/local/include/libxml2/libxml/xmlstring.h:89: conflicting types for `xmlStrcat' /usr/local/include/libxml2/libxml/parser.h:411: previous declaration of `xmlStrcat' /usr/local/include/libxml2/libxml/xmlstring.h:90: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:91: parse error before "xmlStrncat" /usr/local/include/libxml2/libxml/xmlstring.h:93: conflicting types for `xmlStrncat' /usr/local/include/libxml2/libxml/parser.h:414: previous declaration of `xmlStrncat' /usr/local/include/libxml2/libxml/xmlstring.h:94: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:95: parse error before "xmlStrncatNew" /usr/local/include/libxml2/libxml/xmlstring.h:98: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:103: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:109: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:112: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:114: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:117: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:118: parse error before "xmlUTF8Strndup" /usr/local/include/libxml2/libxml/xmlstring.h:119: conflicting types for `xmlUTF8Strndup' /usr/local/include/libxml2/libxml/encoding.h:207: previous declaration of `xmlUTF8Strndup' /usr/local/include/libxml2/libxml/xmlstring.h:120: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:121: parse error before "xmlUTF8Strpos" /usr/local/include/libxml2/libxml/xmlstring.h:122: conflicting types for `xmlUTF8Strpos' /usr/local/include/libxml2/libxml/encoding.h:209: previous declaration of `xmlUTF8Strpos' /usr/local/include/libxml2/libxml/xmlstring.h:123: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:126: syntax error before "xmlChar" /usr/local/include/libxml2/libxml/xmlstring.h:127: parse error before "xmlUTF8Strsub" /usr/local/include/libxml2/libxml/xmlstring.h:129: conflicting types for `xmlUTF8Strsub' /usr/local/include/libxml2/libxml/encoding.h:214: previous declaration of `xmlUTF8Strsub' /usr/local/include/libxml2/libxml/xmlstring.h:130: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:132: syntax error before "int" /usr/local/include/libxml2/libxml/xmlstring.h:134: syntax error before "int" src/lxml/etree.c:196: parse error before "xmlRelaxNG" src/lxml/etree.c:204: parse error before "xmlDict" src/lxml/etree.c:206: parse error before '}' token src/lxml/etree.c:288: parse error before "xmlError" src/lxml/etree.c: In function `__pyx_f_5etree_ElementTree': src/lxml/etree.c:5060: dereferencing pointer to incomplete type src/lxml/etree.c:5067: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_XML': src/lxml/etree.c:5144: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_parse': src/lxml/etree.c:5354: dereferencing pointer to incomplete type src/lxml/etree.c:5393: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_14XPathEvaluator___init__': src/lxml/etree.c:5498: structure has no member named `userData' src/lxml/etree.c: In function `__pyx_f_5etree__xpathCallback': src/lxml/etree.c:6960: structure has no member named `userData' src/lxml/etree.c:7062: `XML_XPATH_EXPR_ERROR' undeclared (first use in this function) src/lxml/etree.c:7062: (Each undeclared identifier is reported only once src/lxml/etree.c:7062: for each function it appears in.) src/lxml/etree.c:7062: `XML_XPATH_EXPRESSION_OK' undeclared (first use in this function) src/lxml/etree.c: In function `__pyx_f_5etree_7RelaxNG___init__': src/lxml/etree.c:7310: `__pyx_v_parser_ctxt' undeclared (first use in this function) src/lxml/etree.c:7394: dereferencing pointer to incomplete type src/lxml/etree.c:7397: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_7RelaxNG___dealloc__': src/lxml/etree.c:7436: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_7RelaxNG_validate': src/lxml/etree.c:7453: `__pyx_v_valid_ctxt' undeclared (first use in this function) src/lxml/etree.c:7465: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser___init__': src/lxml/etree.c:7512: dereferencing pointer to incomplete type src/lxml/etree.c:7515: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser___dealloc__': src/lxml/etree.c:7533: dereferencing pointer to incomplete type src/lxml/etree.c:7537: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser_parseDoc': src/lxml/etree.c:7559: dereferencing pointer to incomplete type src/lxml/etree.c:7566: dereferencing pointer to incomplete type src/lxml/etree.c:7573: dereferencing pointer to incomplete type src/lxml/etree.c:7617: dereferencing pointer to incomplete type src/lxml/etree.c:7632: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser_parseDocFromFile': src/lxml/etree.c:7651: dereferencing pointer to incomplete type src/lxml/etree.c:7654: dereferencing pointer to incomplete type src/lxml/etree.c:7660: dereferencing pointer to incomplete type src/lxml/etree.c:7673: structure has no member named `lastError' src/lxml/etree.c:7673: `XML_FROM_IO' undeclared (first use in this function) src/lxml/etree.c:7722: dereferencing pointer to incomplete type src/lxml/etree.c:7739: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser__initParse': src/lxml/etree.c:7745: dereferencing pointer to incomplete type src/lxml/etree.c:7748: dereferencing pointer to incomplete type src/lxml/etree.c:7755: dereferencing pointer to incomplete type src/lxml/etree.c:7764: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser__prepareParse': src/lxml/etree.c:7769: dereferencing pointer to incomplete type src/lxml/etree.c:7772: dereferencing pointer to incomplete type src/lxml/etree.c:7774: structure has no member named `dict' src/lxml/etree.c:7779: structure has no member named `dict' src/lxml/etree.c:7782: structure has no member named `dict' src/lxml/etree.c:7782: dereferencing pointer to incomplete type src/lxml/etree.c:7785: structure has no member named `dict' src/lxml/etree.c:7794: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser__finalizeParse': src/lxml/etree.c:7799: dereferencing pointer to incomplete type src/lxml/etree.c:7802: dereferencing pointer to incomplete type src/lxml/etree.c:7806: dereferencing pointer to incomplete type src/lxml/etree.c:7806: structure has no member named `dict' src/lxml/etree.c:7809: dereferencing pointer to incomplete type src/lxml/etree.c:7818: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree_6Parser_newDoc': src/lxml/etree.c:7827: dereferencing pointer to incomplete type src/lxml/etree.c:7833: structure has no member named `dict' src/lxml/etree.c:7837: structure has no member named `dict' src/lxml/etree.c:7843: dereferencing pointer to incomplete type src/lxml/etree.c:7847: structure has no member named `dict' src/lxml/etree.c:7847: dereferencing pointer to incomplete type src/lxml/etree.c:7850: dereferencing pointer to incomplete type src/lxml/etree.c:7856: dereferencing pointer to incomplete type src/lxml/etree.c:7860: dereferencing pointer to incomplete type src/lxml/etree.c:7860: structure has no member named `dict' src/lxml/etree.c:7863: dereferencing pointer to incomplete type src/lxml/etree.c:7876: dereferencing pointer to incomplete type src/lxml/etree.c: In function `__pyx_f_5etree__getParseOptions': src/lxml/etree.c:8424: `XML_PARSE_NOENT' undeclared (first use in this function) src/lxml/etree.c:8424: `XML_PARSE_NOCDATA' undeclared (first use in this function) src/lxml/etree.c:8424: `XML_PARSE_NOWARNING' undeclared (first use in this function) src/lxml/etree.c:8424: `XML_PARSE_NOERROR' undeclared (first use in this function) src/lxml/etree.c: At top level: src/lxml/etree.c:8761: parse error before "xmlError" src/lxml/etree.c:8767: parse error before string constant src/lxml/etree.c:8767: conflicting types for `__Pyx_WriteUnraisable' src/lxml/etree.c:38: previous declaration of `__Pyx_WriteUnraisable' src/lxml/etree.c:8768: parse error before ':' token src/lxml/etree.c: In function `__pyx_f_5etree__shutUpLibxmlErrors': src/lxml/etree.c:8777: `__pyx_f_5etree_nullStructuredErrorFunc' undeclared (first use in this function) src/lxml/etree.c: At top level: src/lxml/etree.c:11396: sizeof applied to an incomplete type src/lxml/etree.c: In function `__pyx_tp_new_5etree_Parser': src/lxml/etree.c:11445: dereferencing pointer to incomplete type src/lxml/etree.c: At top level: src/lxml/etree.c:11549: sizeof applied to an incomplete type src/lxml/etree.c:12255: conflicting types for `__Pyx_WriteUnraisable' src/lxml/etree.c:8767: previous declaration of `__Pyx_WriteUnraisable' error: command 'gcc' failed with exit status 1 > > Regards, > > Martijn >

1 0

[lxml-dev] Bug report: double free or corruption
by Florian Wagner 19 May '05

19 May '05

Executing the following script results in an error with lxml-0.6: from lxml.etree import Element,dump,parse root = Element('root') add = parse('test.xml') root.append(add.getroot()) dump(root) The "test.xml" file contains only one tag. The output of dump prints the expected xml, but after that the following error occures: *** glibc detected *** double free or corruption (out): 0x080b885b *** Aborted Regards, Florian

2 2