Mailman 3 - lxml - The Python XML Toolkit

Return type of text_content()
by tomi.belan＠gmail.com March 15, 2025

March 15, 2025

I noticed that the text_content() method of lxml.html elements returns a _ElementUnicodeResult, i.e. a 'smart' string. However, its getparent(), attrname are None, and is_tail, is_text, is_attribute are False. This is the case even if the element contains a single text node. The XPath "string()" used in text_content()'s implementation never returns an existing text node, but always a new string. Wouldn't it make more sense for text_content() to return a normal str? E.g. by adding … [View More]

1 0

Performance issues when using element.clear() in Python 3.x
by Noorulamry Daud March 4, 2025

March 4, 2025

Hello everyone, I've been cracking my head about this performance issue I'm having and I could use some help. At my work we have to parse extremely large XML files - 20GB and even larger. The basic algorithm is as follows: with open(file, "rb") as reader: context = etree.iterparse(reader, events=('start', 'end')) for ev, el in context: (processing) el.clear() In Python 2.7, the processing time for a 20GB XML file is approximately 40 minutes. In Python 3.13, it's 7 hours, … [View More]

4 9

Appending XSLT to XML
by Schimon Jehudah Jan. 31, 2025

Jan. 31, 2025

Greetings! I would want to know whether there is a function to append XSLT stylesheet to XML files. I have resorted to converting XML data to string, in order to append a reference to an XSLT styleshett. See https://git.xmpp-it.net/sch/Rivista/src/branch/main/rivista/xml/xslt.py Please advise. Kind regards, Schimon

4 5

XML namespaces are not propagated over from the ancestor elements when using find* methods
by Matthew Ouyang Jan. 15, 2025

Jan. 15, 2025

I have a XML document that has namespaces in it. I want to use the find* methods to select elements but it's looks like it is not possible without specifying namespaces explicitly to every call. Is this true? Is this by design? This seems very burdensome to do so when namespaces are included in the XML document. It would be really nice if the namespaces in the XML document could be considered. xml = b"""<?xml version="1.0" encoding="UTF-8"?><root xmlns="… [View More]

3 3

Write etree to multiple files using xinclude
by Trevor Clarke Dec. 4, 2024

Dec. 4, 2024

I've got a fairly complex xml config setup with multiple files xincluded. I'm trying to write a tool that allows me to replace certain values programmatically and write the modified file. I lxml.etree.parse() the file then xinclude(). I replace the appropriate text values and want to write the tree back to the filesystem using the original files. I figured out that I can locate the file containing the modified node with something like: ``` cur, top = node, node while cur.base == node.base: … [View More]

1 0

Optimizing lxml for Handling Large XML Files: Tips and Experiences
by Lily Parker Oct. 30, 2024

Oct. 30, 2024

I've been using lxml to process large XML files recently, and I'm looking for ways to optimize performance. Specifically, I'm trying to filter specific nodes from large datasets and manage memory usage more effectively. I'd appreciate any tips or best practices from your experiences. Are there any techniques you use to enhance performance, or potential pitfalls I should watch out for? Thanks in advance for your insights!

2 1

GitHub lxml build scripts - helpful to others?
by abepolk＠gmail.com Oct. 9, 2024

Oct. 9, 2024

Hi all, I was interested in learning more about lxml. So, I wrote a couple of shell scripts that build lxml statically, and non-statically, and posted them on GitHub. Specifically, they are (I believe) the minimal code required to build lxml from source remotely on a freshly created Google Cloud Platform Cloud Compute VM, on a Debian Linux system. I used the documentation some. However, I had to add -fPIC in a static build command, and set the environmental variable LD_LIBRARY_PATH to use … [View More]

1 0

Broken EXSLT link in docs
by Jens Tröger Sept. 29, 2024

Sept. 29, 2024

Hello, I think the EXSLT link here: https://lxml.de/xpathxslt.html#regular-expressions-in-xpath or source here: https://github.com/lxml/lxml/blob/9818374770aedc96f8f1e77943f45dea8e7fb4a8/… should change from http://www.exslt.org/ to https://exslt.github.io/ or some other valid URL. Happy to provide a PR but the change seems trivial enough… Cheers, Jens -- Jens Tröger https://savage.light-speed.de/

2 1

problem running self tests
by wiz＠gatalith.at Aug. 12, 2024

Aug. 12, 2024

Hi! I'm trying to run the self tests for the pkgsrc package for lxml, currently at 5.3.0. lxml itself seems to work fine AFAICT, but I can't get the self tests to runs. I tried following the documented method from https://lxml.de/build.html but I get: ``` # python3.12 test.py Traceback (most recent call last): File "/scratch/textproc/py-lxml/work/lxml-5.3.0/test.py", line 620, in <module> exitcode = main(sys.argv) ^^^^^^^^^^^^^^ File "/scratch/textproc/py-lxml/work/… [View More]

2 1

Assistance Needed: Python Code Crashes After Multiple Iterations When Extracting HTML Elements Caixa de entrada
by Carlos Eduardo de Schuller Banjar July 29, 2024

July 29, 2024

Hello, everyone! I am encountering an issue with my Python code that opens multiple HTML pages and extracts elements from a specific class, if they exist. The code runs fine for a few iterations but crashes after enough iterations, always on the same HTML page. Interestingly, if I process this page individually, the code works without any problems. This issue has been bothering me for some time, and I have tried many approaches. When debugging, I noticed that the code always crashes within … [View More]

1 0