Mailman 3 July 2010 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel 10 Apr '23

10 Apr '23

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon 09 Apr '23

09 Apr '23

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede 30 Jan '23

30 Jan '23

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel 11 Jan '23

11 Jan '23

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 30 Aug '22

30 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

[lxml-dev] confusing xpath performance characteristics
by jholg＠gmx.de 24 Aug '12

24 Aug '12

Hi, I ran into some performance characteristics of lxml/libxml2 xpath that I find rather confusing: I try to find the @type attribute of a certain element in an XML Schema (which contains lots of complexType definitions with lots of elements in them; unfortunately I can't post the schema): >>> timeit.Timer(stmt="""xpath(schema)""", setup="""from lxml import etree, objectify; schema=etree.parse('NDM.xsd').getroot(); xpath = etree.XPath('//xs:element[@name="equity"]/@type', namespaces={'xs': 'http://www.w3.org/2001/XMLSchema'})""").repeat(number=10) [0.095885038375854492, 0.096823930740356445, 0.096174955368041992] So I think I'm being smart and give a little more path information - reckoning that this should *improve* performance: >>> timeit.Timer(stmt="""xpath(schema)""", setup="""from lxml import etree, objectify; schema=etree.parse('NDM.xsd').getroot(); xpath = etree.XPath('/xs:schema//xs:element[@name="equity"]/@type', namespaces={'xs': 'http://www.w3.org/2001/XMLSchema'})""").repeat(number=10) [0.1770780086517334, 0.1775970458984375, 0.17748594284057617] Hm. Performance degrades slightly. I'm adding even more of the path to where my desired elements live in the schema: >>> timeit.Timer(stmt="""xpath(schema)""", setup="""from lxml import etree, objectify; schema=etree.parse('xsd/NDM.xsd').getroot(); xpath = etree.XPath('/xs:schema/xs:complexType//xs:element[@name="equity"]/@type', namespaces={'xs': 'http://www.w3.org/2001/XMLSchema'})""").repeat(number=10) [103.79744100570679, 103.83671712875366, 103.61817717552185] What??? >>> timeit.Timer(stmt="""xpath(schema)""", setup="""from lxml import etree, objectify; schema=etree.parse('/ae/data/pydev/hjoukl/NDM/SVN_CO/TRUNK/ndm/reference/xsd/NDM.xsd').getroot(); xpath = etree.XPath('/xs:schema/xs:complexType/*/xs:element[@name="equity"]/@type', namespaces={'xs': 'http://www.w3.org/2001/XMLSchema'})""").repeat(number=10) [0.044407129287719727, 0.044126987457275391, 0.044229030609130859] >>> Ok, this version's better than my naive approach, which seems logical to me. But why would '/xs:schema/xs:complexType//xs:element[@name="equity"]/@type' perform drastically slower than '/xs:schema/xs:complexType//xs:element[@name="equity"]/@type' ? libxml2 problem? Running the same xpaths in Oxygen I don't notice performance differences (can't profile this). Holger -- GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT! Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01

2 5

[lxml-dev] SyntaxErrors with Python 3
by Arfrever Frehtes Taifersar Arahesis 23 Nov '10

23 Nov '10

LXML r76211 generally supports Python 3, but there are still some SyntaxErrors. (The problem with ez_setup.py can be ignored.) $ python3.1 -m compileall -q . *** Error compiling ./benchmark/bench_etree.py ... File "./benchmark/bench_etree.py", line 10 UTEXT = u"some klingon: \F8D2" ^ SyntaxError: invalid syntax *** Error compiling ./benchmark/benchbase.py ... File "./benchmark/benchbase.py", line 10 _UTEXT = u"some klingon: \F8D2" * TREE_FACTOR ^ SyntaxError: invalid syntax *** Error compiling ./doc/mklatex.py ... File "./doc/mklatex.py", line 247 print "Creating %s" % outname ^ SyntaxError: invalid syntax *** Error compiling ./doc/rest2html.py ... File "./doc/rest2html.py", line 41 except ValueError, e: ^ SyntaxError: invalid syntax *** Error compiling ./doc/rest2latex.py ... File "./doc/rest2latex.py", line 44 except ValueError, e: ^ SyntaxError: invalid syntax *** Error compiling ./doc/s5/rst2s5.py ... File "./doc/s5/rst2s5.py", line 82 parsed = highlight(u'\n'.join(self.content), lexer, formatter) ^ SyntaxError: invalid syntax *** Error compiling ./ez_setup.py ... File "./ez_setup.py", line 106 except pkg_resources.VersionConflict, e: ^ SyntaxError: invalid syntax *** Error compiling ./src/local_doctest.py ... File "./src/local_doctest.py", line 372 raise TypeError, 'Expected a module: %r' % module ^ SyntaxError: invalid syntax *** Error compiling ./src/lxml/html/_diffcommand.py ... File "./src/lxml/html/_diffcommand.py", line 85 print "Not yet implemented" ^ SyntaxError: invalid syntax *** Error compiling ./src/lxml/html/tests/transform_feedparser_data.py ... File "./src/lxml/html/tests/transform_feedparser_data.py", line 91 print 'Bad data in %s:' % filename ^ SyntaxError: invalid syntax *** Error compiling ./src/lxml/tests/test_errors.py ... File "./src/lxml/tests/test_errors.py", line 1 # -*- coding: utf-8 -*- ^ SyntaxError: invalid character in identifier *** Error compiling ./tools/xpathgrep.py ... File "./tools/xpathgrep.py", line 5 except ImportError, e: ^ SyntaxError: invalid syntax -- Arfrever Frehtes Taifersar Arahesis

2 4

[lxml-dev] No error position when validating against XMLSchema
by Adam Bielański 01 Sep '10

01 Sep '10

Hello, I'm calling creating object with "etree.iterparse(open('NotValidFile.xml'), schema=schema)" and iterating over it raises etree.XMLSyntaxError, as expected. Unfortunately, value of 'position' attribute of that error is (0,0). Value of 'offset' attribute is None. Is there a way to get at least the line number of the offending tag in my XML file? When etree.XMLSyntaxError is raised in etree.XML(), it contains position info pointing precisely to the place where error occured. Is it possible also when using iterparse() ? Regards, Adam Bielański.

2 2

[lxml-dev] Invalid Schematron
by masetto 26 Aug '10

26 Aug '10

Hi all, i'm trying to validate an OVAL (http://oval.mitre.org) xml document against it's schematron rules ( http://oval.mitre.org/language/version5.7/ovaldefinition/schematron/oval-de… ) Following the manual (http://codespeak.net/lxml/validation.html) i wrote the following piece of code: from lxml import etree rule = open("oval-definitions-schematron.sch") defs = open("oval.xml") sct_doc = etree.parse(rule) try: schematron = etree.Schematron(sct_doc) except etree.SchematronParseError, e: print e.args print e.error_log print e.message doc = etree.parse(defs) print schematron.validate(doc) but i got the following error(s): Document is not a valid Schematron schema oval-definitions-schematron.sch:34:0:ERROR:SCHEMASP:SCHEMAP_NOROOT: Expecting a pattern element instead of phase (repeated N times) ... oval-definitions-schematron.sch:1547:0:ERROR:SCHEMASP:SCHEMAP_NOROOT: Failed to compile context expression oval-def:objects/*/*[@datatype='binary']|oval-def:states/*/*[@datatype='binary']|oval-def:states/*/* (repeated N times) $ dpkg -l | grep libxml2 ii libxml-libxml-perl 1.70.ds-1 Perl interface to the libxml2 library ii libxml2 2.7.6.dfsg-1ubuntu1 GNOME XML library ii libxml2-dev 2.7.6.dfsg-1ubuntu1 Development files for the GNOME XML library ii libxml2-utils 2.7.6.dfsg-1ubuntu1 XML utilities ii python-libxml2 2.7.6.dfsg-1ubuntu1 Python bindings for the GNOME XML library on Ubuntu 10.04 Can you help me? Thanks --- Masetto

3 2

[lxml-dev] decoding unicode strings
by Burak Arslan 08 Aug '10

08 Aug '10

hi, the lxml.etree.XMLID function does not accept unicode strings when the xml declaration tag is present at the beginning of the xml document. however, not all soap clients send the xml declaration, so sometimes i must rely on information in http headers to decode the string. my solution was this: try: root, xmlids = etree.XMLID(xml_string.decode(http_charset)) except ValueError,e: logger.debug('%s -- falling back to str decoding.' % (e)) root, xmlids = etree.XMLID(xml_string) is this the proper way to check whether an xml document candidate has an xml declaration at the beginning? thanks, burak

2 1