Mailman 3 July 2018 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel 11 Apr '23

11 Apr '23

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon 10 Apr '23

10 Apr '23

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede 30 Jan '23

30 Jan '23

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel 11 Jan '23

11 Jan '23

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 31 Aug '22

31 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

No windows wheels for python 3.7 on pypi
by Toni Pejić 28 Jul '18

28 Jul '18

Hello, I was wondering if you dropped support for windows, because there are still no windows wheels for python 3.7 on pypi. I'm trying to update my project but lxml is my only dependency that still doesn't support python 3.7 on windows. -- Toni Pejić

1 0

Re: [lxml] lxml Digest, Vol 90, Issue 9
by Cosimo Lupo 26 Jul '18

26 Jul '18

yes, appveyor now provides python3.7. It's not true that everyone hates Windows.. lxml certainly doesn't ;) On Wed, Jul 25, 2018 at 1:00 PM <lxml-request(a)lxml.de> wrote: > Send lxml mailing list submissions to > lxml(a)lxml.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman-mail5.webfaction.com/listinfo/lxml > or, via email, send a message with subject or body 'help' to > lxml-request(a)lxml.de > > You can reach the person managing the list at > lxml-owner(a)lxml.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of lxml digest..." > > > Today's Topics: > > 1. why no wheel for win python 37? (Filip Kucharczyk) > 2. Re: why no wheel for win python 37? (Stefan Behnel) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 24 Jul 2018 18:48:44 +0200 > From: Filip Kucharczyk <fil.kucharczyk(a)gmail.com> > To: "lxml(a)lxml.de" <lxml(a)lxml.de> > Subject: [lxml] why no wheel for win python 37? > Message-ID: > < > CADtLFZfGXr_EJB6qC8F+_4+kd60w_8aqod41L13-kaW+ikCvqw(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Hi, > > I know everyone hates windows but where is there no compiled wheel file for > windows for python 37? > I have python 37 and compiling lxml does not work on my machine. > It just took my one day to figure out why lxml is installed just fine on a > machine with python 365 and not on my pc. > > so: please tell me: why is there no wheel > file lxml-4.2.3-cp37-cp37m-win_amd64.whl? > > Kind regards, > Filip >

1 1

why no wheel for win python 37?
by Filip Kucharczyk 25 Jul '18

25 Jul '18

Hi, I know everyone hates windows but where is there no compiled wheel file for windows for python 37? I have python 37 and compiling lxml does not work on my machine. It just took my one day to figure out why lxml is installed just fine on a machine with python 365 and not on my pc. so: please tell me: why is there no wheel file lxml-4.2.3-cp37-cp37m-win_amd64.whl? Kind regards, Filip

3 2

Incomplete XInclude Resolution for 2nd Level?
by Thomas Schraitle 13 Jul '18

13 Jul '18

Hi lxml lovers, I've discovered a strange behaviour when processing XIncludes. From my understanding, XInclude processing is an all-or-nothing method, right? If you resolve them with the .xinclude() method, then _all_ are resolved (pretending all are well-formed). Let's consider three DocBook 5 files: main.xml, first.xml, and second.xml. The main.xml includes first.xml which includes second.xml. The whole source code can be found in my Gist[1]. Basically, it looks like this: -- main.xml -- article title xi:include href="first.xml" -- first.xml -- section title xi:include href="second.xml" -- second.xml -- section title para The quick brown fox To resolve any XInclude elements, this is what I do (excerpt from the check.py file): def parse(xmlfile, xinclude=True): try: xmlparser = etree.XMLParser(collect_ids=False, recover=False) tree = etree.parse(xmlfile, parser=xmlparser) if xinclude: tree.xinclude() return 0 except (etree.XMLSyntaxError, etree.XIncludeError) as err: print("ERROR: %s" % err, file=sys.stderr) print(textwrap.indent(str(err.error_log), prefix=" "), file=sys.stderr) return 10 If all XML files are well-formed, this works fine. However, consider a user case with a syntax error in one of your files. Let's assume, I removed the </para> end tag in the file "second.xml". When I process first.xml (which directly includes second.xml), I get the following expected error: $ python3 check.py first.xml ERROR: Opening and ending tag mismatch: para line 8 and section, line 10, column 11 [...] However, when I process the main.xml file (where there is a level inbetween), nothing happens: $ python3 check.py main.xml # -- no output -- Why? This wasn't expected! It seems, only the first level of XIncludes (the first.xml) are resolved. If you compare the behaviour with the xmllint command, I get this: $ xmllint --noout --xinclude main.xml second.xml:7: parser error : Opening and ending tag mismatch: para line 8 and section </section> ^ second.xml:9: parser error : Premature end of data in tag section line 4 ^ first.xml:5: element include: XInclude error : could not load second.xml, and no fallback was found Is this a bug? Do I miss something? Any help would be very appreciated! Thank you! :) ---- Reference [1] https://gist.github.com/tomschr/8d86797ba19c57f41ea2a47535e8b431 -- Gruß/Regards, Thomas Schraitle

2 1

lxml doesnt seem to resolve relative, imported xsd files, when using https.
by Anrik Drenth 11 Jul '18

11 Jul '18

With Google chrome marking http as "not secure" in the browser I need to set lxml to use https. The url to the main xsd is https://www.pharmac.govt.nz/2006/07/Schedule.xsd. This is redirected to https://www.pharmac.govt.nz/wwwtrs/pub/2006/07/Schedule.xsd. The main xsd file imports further xsd files (relative to the main xsd file). Below are a few of my findings and discoveries. Any fixes, solution or help greatly appreciated. OS, software, and versions ubuntu = 16.4 LTS python = 2.7 lxml = 4.2.1 xsd: The main schema imports multiple xsd files. Link to the main xsd and imported xsd resources : https://www.pharmac.govt.nz/wwwtrs/pub/2006/07/ Example 1 - http - the below works: from lxml import etree schema = 'http://www.pharmac.govt.nz/2006/07/Schedule.xsd' schemadoc = etree.XMLSchema(file = schema) Example 2 - https - produces the below error: from lxml import etree schema = 'https://www.pharmac.govt.nz/2006/07/Schedule.xsd' schemadoc = etree.XMLSchema(file = schema) Traceback (most recent call last): File "xmltest.py", line 3, in <module> schemadoc = etree.XMLSchema(file = schema) File "src/lxml/xmlschema.pxi", line 86, in lxml.etree.XMLSchema.__init__ lxml.etree.XMLSchemaParseError: Failed to locate the main schema resource at 'https://www.pharmac.govt.nz/2006/07/Schedule.xsd'. **Yet calling the url "https://www.pharmac.govt.nz/2006/07/Schedule.xsd" loads the schema. Example 3 - http - the below works: from lxml import etree import urllib2 schema = 'http://www.pharmac.govt.nz/2006/07/Schedule.xsd' schema_src_file = urllib2.urlopen(schema) schema_doc = etree.parse(schema_src_file) schema = etree.XMLSchema(schema_doc) Example 4 - https - produces the below error: from lxml import etree import urllib2 schema = 'https://www.pharmac.govt.nz/2006/07/Schedule.xsd' schema_src_file = urllib2.urlopen(schema) schema_doc = etree.parse(schema_src_file) schema = etree.XMLSchema(schema_doc) Traceback (most recent call last): File "xmltest.py", line 6, in <module> schema = etree.XMLSchema(schema_doc) File "src/lxml/xmlschema.pxi", line 86, in lxml.etree.XMLSchema.__init__ lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}element', attribute 'ref': The QName value '{http://www.w3.org/1999/xhtml}div' does not resolve to a(n) element declaration., line 336 Example 5 - https - works (If I first save all the supporting xsd files locally) ** The below suggest the main xsd file can be found online via https; it just doesnt seem to load supporting xsd files via https. from lxml import etree import urllib2 schema = 'https://www.pharmac.govt.nz/2006/07/Schedule.xsd' schema_src_file = urllib2.urlopen(schema) xml_data = schema_src_file.read() schema_doc = etree.parse(xml_data) schema = etree.XMLSchema(schema_doc) Example 6 - works upto the assertValid ** Big THANKS to Roger Duthie for providing the below "class HTTPSResolver" code. To get this to work I had to change the "schemaLocation" from relative to the full path: From: schemaLocation="mathml2.xsd" To: schemaLocation="https://wwwdev.pharmac.govt.nz/2006/07/mathml2/mathml2.xsd" assertValid fails with: "Element '{https://wwwdev.pharmac.govt.nz/2006/07/Schedule#}Schedule No matching global declaration available for the validation root". Which is curious as it suggest lxml is validating the IRI?? from lxml import etree from urlparse import urlparse import requests class HTTPSResolver(etree.Resolver): __name__ = 'HTTPSResolver' def resolve(self, url, id_, context): url_components = urlparse(url) scheme = url_components.scheme # the resolver will only check for redirects if http/s is present if scheme == 'http' or scheme == 'https': head_response = requests.head(url, allow_redirects=True) new_request_url = head_response.url if len(head_response.history) != 0: # recursively, resolve the ultimate redirection target return self.resolve(new_request_url, id, context) else: if scheme == 'http': # libxml2 can handle this resource return self.resolve_filename(new_request_url, context) elif scheme == 'https': # libxml2 cannot resolve this resource, so do the work get_response = requests.get(new_request_url) return self.resolve_string(get_response.content, context, base_url=new_request_url) else: raise Exception("[%s]\ Something odd has happened - scheme should be http or https" % __name__) else: # treat resource as a plain old file return self.resolve_filename(url, context) schema = 'https://www.pharmac.govt.nz/2006/07/Schedule.xsd' parser = etree.XMLParser(load_dtd=True) resolver = HTTPSResolver(schema) parser.resolvers.add(resolver) schemadoc=etree.XMLSchema(etree.parse(schema, parser=parser)) --- === Code to Build the XML document === --- schemadoc.assertValid(Schedule)

2 2