Mailman 3 June 2021 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel 10 Apr '23

10 Apr '23

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon 09 Apr '23

09 Apr '23

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede 30 Jan '23

30 Jan '23

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel 11 Jan '23

11 Jan '23

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 30 Aug '22

30 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

Tested value modified in validation error message
by Bob Kline 15 Jul '22

15 Jul '22

Before I file a ticket, I wanted to check here to find out if this is a known problem (I searched the bug tracker, but didn't see any matches). Our customer is using a commercial XML editor and the editor's implementation of the DOM API sometimes garbles whitespace inside text nodes when serializing XML documents for the document's xml property. This causes schema validation errors when we send that serialization off to be validated against the document type's schema using lxml. The problem we have run into with lxml is that the message property of the error object which comes back in the schema object's error_log has altered the value being validated. So, for example, if the text content of an element in the serialized DOM is "Processing\ncomplete" and the value it was supposed to match in the enumerated valid values is "Processing complete" then the message attribute for the corresponding object in the error_log has Element 'ProcessingStatusValue': [facet 'enumeration'] The value 'Processing complete' is not an element of the set {'Ready for English peer review', 'Ready for English scientific review', 'Ready for English OCCM review', 'Ready for Spanish peer review', 'Ready for Spanish OCCM review', 'Ready for publishing', 'Ready for translation', 'Processing complete'}. In effect saying "the value 'Processing complete' does not match the value 'Processing complete'." Took a very long time for us to figure out that the error message was wrong, and that it should have said ... The value 'Processing\ncomplete' is not an element of the set .... -- Bob Kline https://www.rksystems.com mailto:bkline@rksystems.com

4 10

Re: Cannot <include> from a network location
by Holger.Joukl＠LBBW.de 25 Jun '21

25 Jun '21

> Just a thought: Might this be proxy- or https-related? Does it work if you locally serve the xs:included schema with http? > > I *think* libxml2 respects http_proxy but I don’t know anything about https support. Just found that for an example adapted from https://bugs.launchpad.net/lxml/+bug/1234114/comments/3 (xs:include instead of xs:import): ############## # test_schema.py XSD = b"""<?xml version="1.0" encoding="UTF-8"?> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns="lxmltest" targetNamespace="http://www.w3.org/1999/xlink" elementFormDefault="qualified" attributeFormDefault="unqualified"> <xs:include schemaLocation="http://www.loc.gov/standards/xlink/xlink.xsd" /> </xs:schema> """ from lxml import etree parser = etree.XMLParser( load_dtd=True, no_network=True, huge_tree=True, resolve_entities=True) tree = etree.fromstring(XSD, parser=parser) schema = etree.XMLSchema(tree) print(schema) ############## I can successfully run this if the xs:include location is http but not https (the xlink.xsd is available both with https and http URLs). If I change it to https I get Traceback (most recent call last): File "test_schema.py", line 16, in <module> schema = etree.XMLSchema(tree) File "src/lxml/xmlschema.pxi", line 88, in lxml.etree.XMLSchema.__init__ lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}include': Failed to load the document 'https://www.loc.gov/standards/xlink/xlink.xsd' for inclusion., line 9 As I'm behind a proxy: I also just found out that while curl happily accepts http_proxy=my.proxy.address.net:8080 lxml (libxml2) only works if this is set to http_proxy=http://my.proxy.address.net:8080 i.e. with an explicit <scheme>:// Cheers, H. Landesbank Baden-Wuerttemberg Anstalt des oeffentlichen Rechts Hauptsitze: Stuttgart, Karlsruhe, Mannheim, Mainz HRA 12704 Amtsgericht Stuttgart HRA 4356, HRA 104 440 Amtsgericht Mannheim HRA 40687 Amtsgericht Mainz Die LBBW verarbeitet gemaess Erfordernissen der DSGVO Ihre personenbezogenen Daten. Informationen finden Sie unter https://www.lbbw.de/datenschutz.

2 2

Re: Cannot <include> from a network location
by Holger.Joukl＠LBBW.de 25 Jun '21

25 Jun '21

> On Friday, June 25, 2021 5:10:47 AM EDT Holger.Joukl(a)LBBW.de wrote: > > parser=etree.XMLParser(load_dtd=True, no_network=False, huge_tree=True, > > resolve_entities=True) > > Huh? You should set no_network=True! I think you're mistaken here. See https://lxml.de/apidoc/lxml.etree.html#lxml.etree.XMLParser: "[...] no_network - prevent network access for related files (default: True) [...]" So to the contrary I'd say that the OP is correct in assuming one needs to set no_network=False iff he indeed wants to load from the network. (From what I understand proper use of xml catalogs is the recommended way, though, so maybe that's what you meant?) However according to https://bugs.launchpad.net/lxml/+bug/1234114 this doesn't currently govern XML Schema xs:include/xs:import, at all. So this setting seems not make a difference currently, anyway. Best regards, H. Landesbank Baden-Wuerttemberg Anstalt des oeffentlichen Rechts Hauptsitze: Stuttgart, Karlsruhe, Mannheim, Mainz HRA 12704 Amtsgericht Stuttgart HRA 4356, HRA 104 440 Amtsgericht Mannheim HRA 40687 Amtsgericht Mainz Die LBBW verarbeitet gemaess Erfordernissen der DSGVO Ihre personenbezogenen Daten. Informationen finden Sie unter https://www.lbbw.de/datenschutz.

1 0

Re: Cannot <include> from a network location
by Holger.Joukl＠LBBW.de 25 Jun '21

25 Jun '21

The no_network argumenr to the XMLParser constructor does not seem to be working as described. The following import io from lxml import etree schema='''<schema xmlns="http://www.w3.org/2001/XMLSchema" targetNamespace="urn:paulhiggs:my-patch" elementFormDefault="qualified" attributeFormDefault="unqualified">  <include schemaLocation="https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd"/> <element name="Patch" type="PatchType"/>  <complexType name="PatchType"> <choice minOccurs="1" maxOccurs="unbounded"> <element name="add" type="add"/> <element name="remove" type="remove"/> <element name="replace" type="replace"/> </choice> <attribute name="paulsAttrib" type="string" use="required"/> </complexType> </schema> ''' parser=etree.XMLParser(load_dtd=True, no_network=False, huge_tree=True, resolve_entities=True) s=etree.parse(io.StringIO(schema), parser) my_schema=etree.XMLSchema(s) yields an unexpected error G:\lxml-test>python 10.py Traceback (most recent call last): File "G:\lxml-test\10.py", line 28, in <module> my_schema=etree.XMLSchema(s) File "src\lxml\xmlschema.pxi", line 88, in lxml.etree.XMLSchema.__init__ lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}include': Failed to load the document 'https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd' for inclusion., line 3 If I curl -O https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd and change to <include schemaLocation=" patch-ops.xsd"/> the loading of the schema is successful Just a thought: Might this be proxy- or https-related? Does it work if you locally serve the xs:included schema with http? I *think* libxml2 respects http_proxy but I don't know anything about https support. Then maybe using s.th. else for the http(s) access to the resources (e.g. requests) could work; I suspect one might need to use resolvers somehow for the "indirect" xs:include dependencies (https://lxml.de/resolvers.html). Never done that myself so be just a wild guess. I could be totally wrong ;-). Regards, Holger [cid:image001_e3261df1-efb3-4c64-a4de-9b63c5e52cfb.png]<https://www.lbbw.de/> [cid:image002_15f56f09-b8fe-4ddc-a247-e3cf3d25c71f.png]<https://twitter.com/lbbw> [cid:image003_e01dca75-944e-4ea3-8463-c9c061e5b36b.png] <https://www.linkedin.com/company/lbbw> [cid:image004_5642e2b4-e190-4f0c-a274-7ceb59fe913c.png] <https://www.xing.com/company/lbbw> [cid:image005_53d53024-7202-4d60-8d95-dc0f361239ca.png] <https://www.facebook.com/LBBW.Stuttgart/> [cid:image006_9c0b6462-8935-4b9c-9fe3-0caa90d8623b.png] <https://www.youtube.com/user/LBBWDirekt> [cid:image007_9a7ebd18-8e4e-4c3e-931a-ecc4bf575ace.png] <https://www.instagram.com/lbbw_karriere/> Landesbank Baden-Wuerttemberg Anstalt des oeffentlichen Rechts Hauptsitze: Stuttgart, Karlsruhe, Mannheim, Mainz HRA 12704 Amtsgericht Stuttgart HRA 4356, HRA 104 440 Amtsgericht Mannheim HRA 40687 Amtsgericht Mainz Die LBBW verarbeitet gemaess Erfordernissen der DSGVO Ihre personenbezogenen Daten. Informationen finden Sie unter https://www.lbbw.de/datenschutz.

1 0

Cannot <include> from a network location
by Paul Higgs 25 Jun '21

25 Jun '21

Hello The no_network argumenr to the XMLParser constructor does not seem to be working as described. The following import io from lxml import etree schema='''<schema xmlns="http://www.w3.org/2001/XMLSchema" targetNamespace="urn:paulhiggs:my-patch" elementFormDefault="qualified" attributeFormDefault="unqualified">  <include schemaLocation="https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd"/> <element name="Patch" type="PatchType"/>  <complexType name="PatchType"> <choice minOccurs="1" maxOccurs="unbounded"> <element name="add" type="add"/> <element name="remove" type="remove"/> <element name="replace" type="replace"/> </choice> <attribute name="paulsAttrib" type="string" use="required"/> </complexType> </schema> ''' parser=etree.XMLParser(load_dtd=True, no_network=False, huge_tree=True, resolve_entities=True) s=etree.parse(io.StringIO(schema), parser) my_schema=etree.XMLSchema(s) yields an unexpected error G:\lxml-test>python 10.py Traceback (most recent call last): File "G:\lxml-test\10.py", line 28, in <module> my_schema=etree.XMLSchema(s) File "src\lxml\xmlschema.pxi", line 88, in lxml.etree.XMLSchema.__init__ lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}include': Failed to load the document 'https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd' for inclusion., line 3 If I curl -O https://www.iana.org/assignments/xml-registry/schema/patch-ops.xsd and change to <include schemaLocation=" patch-ops.xsd"/> the loading of the schema is successful

1 0