Mailman 3 April 2025 - lxml - The Python XML Toolkit

A strip_tags problem solved
by Martin Mueller April 30, 2025

April 30, 2025

Iterchildren reversed=True does it. I realized it half an hour after writing the below. Apologies for not testing it out earlier. I have what looks like a simple problem that turns out to be beyond my admittedly feeble skills. In a very large corpus of TEI encoded texts I have many instances of this pattern: <hi> <w>something</w <pc>.</pc> <hi> I want to change all of them to <w rend = “hi>something</w> <p>.</pc> without affecting <hi> tags that don’t have those constraints. There are two possible approaches to this. In the first I would strip the <hi> for all cases but only the cases that meet the condition of a <hi> tag that has a <w> child followed by a <pc> child. In the second, I would use a version of the addnext procedure but in reverse order. I cant’ get either of them to work. The strip_tags method suggests in its description strip_tags<https://lxml.de/4.0/api/lxml.etree-module.html#strip_tags>(tree_or_element, *tag_names) description that you might uses it for elements with particular constraints. But it doesn’t appear to recognize or follow the constraings.. For the addnext procedure I would need to find a way of traversing the <hi> list in reverse order. There are different ways of doing that in Python, but I haven’t a way of getting it done in an lxml script. I suspect that there is a very simple explanation, which I am too stupid to see. I’d be grateful for help. Martin Mueller Professor emeritus of English and Classics Northwestern University

2 1

A strip_tags problem
by Martin Mueller April 27, 2025

April 27, 2025

I have what looks like a simple problem that turns out to be beyond my admittedly feeble skills. In a very large corpus of TEI encoded texts I have many instances of this pattern: <hi> <w>something</w <pc>.</pc> <hi> I want to change all of them to <w rend = “hi>something</w> <p>.</pc> without affecting <hi> tags that don’t have those constraints. There are two possible approaches to this. In the first I would strip the <hi> for all cases but only the cases that meet the condition of a <hi> tag that has a <w> child followed by a <pc> child. In the second, I would use a version of the addnext procedure but in reverse order. I cant’ get either of them to work. The strip_tags method suggests in its description strip_tags<https://lxml.de/4.0/api/lxml.etree-module.html#strip_tags>(tree_or_element, *tag_names) description that you might uses it for elements with particular constraints. But it doesn’t appear to recognize or follow the constraings.. For the addnext procedure I would need to find a way of traversing the <hi> list in reverse order. There are different ways of doing that in Python, but I haven’t a way of getting it done in an lxml script. I suspect that there is a very simple explanation, which I am too stupid to see. I’d be grateful for help. Martin Mueller Professor emeritus of English and Classics Northwestern University

1 0

pip install of lxml 5.3.2 for Python 3.10 win32 gets bad CRC-32
by Michael Kinney April 18, 2025

April 18, 2025

Anyone else seeing this? Many other python versions are able to install lxml 5.3.2 Test>pip install lxml Collecting lxml Downloading lxml-5.3.2-cp310-cp310-win32.whl (3.5 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.5/3.5 MB 4.0 MB/s eta 0:00:00 Installing collected packages: lxml ERROR: Exception: Traceback (most recent call last): File "C:\Python310ia32\lib\site-packages\pip\_internal\cli\base_command.py", line 160, in exc_logging_wrapper status = run_func(*args) File "C:\Python310ia32\lib\site-packages\pip\_internal\cli\req_command.py", line 247, in wrapper return func(self, options, args) File "C:\Python310ia32\lib\site-packages\pip\_internal\commands\install.py", line 507, in run installed = install_given_reqs( File "C:\Python310ia32\lib\site-packages\pip\_internal\req\__init__.py", line 73, in install_given_reqs requirement.install( File "C:\Python310ia32\lib\site-packages\pip\_internal\req\req_install.py", line 796, in install install_wheel( File "C:\Python310ia32\lib\site-packages\pip\_internal\operations\install\wheel.py", line 729, in install_wheel _install_wheel( File "C:\Python310ia32\lib\site-packages\pip\_internal\operations\install\wheel.py", line 589, in _install_wheel file.save() File "C:\Python310ia32\lib\site-packages\pip\_internal\operations\install\wheel.py", line 388, in save shutil.copyfileobj(f, dest) File "C:\Python310ia32\lib\shutil.py", line 195, in copyfileobj buf = fsrc_read(length) File "C:\Python310ia32\lib\zipfile.py", line 927, in read data = self._read1(n) File "C:\Python310ia32\lib\zipfile.py", line 1017, in _read1 self._update_crc(data) File "C:\Python310ia32\lib\zipfile.py", line 945, in _update_crc raise BadZipFile("Bad CRC-32 for file %r" % self.name) zipfile.BadZipFile: Bad CRC-32 for file 'lxml/ElementInclude.py'

2 1

Max length of node content (huge nodes)
by Jens Tröger April 1, 2025

April 1, 2025

Hello, There’s a bit of related discussion here: https://stackoverflow.com/questions/45642168/avoid-parsing-huge-xml-element… https://stackoverflow.com/questions/30708873/what-is-the-length-of-maximum-… https://github.com/sparklemotion/nokogiri/issues/740 So, basically my code generated an XML with nodes whose texts seems to blow past some limitation: lxml.etree.XMLSyntaxError: xmlSAX2Characters: huge text node, line 1755, column 10001255 Interestingly, the XML validates fine using the --huge option: xmllint --huge --noout --xinclude --nofixup-base-uris --schema test.xsd test.xml Now I’m curious about two aspects here: 1) What actually is that current limitation on the size of nodes imposed by libxml2? 2) Assuming there is some flexibility with libxml2, what options does lxml offer to deal with huge text nodes? Much thanks! Jens -- Jens Tröger https://savage.light-speed.de/

3 5