Mailman 3 June 2015 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel April 11, 2023

April 11, 2023

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon April 10, 2023

April 10, 2023

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede Jan. 30, 2023

Jan. 30, 2023

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel Jan. 11, 2023

Jan. 11, 2023

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva Aug. 31, 2022

Aug. 31, 2022

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

Error from .itertext() “ValueError: Input object has no element: HtmlComment”
by John Munroe July 13, 2015

July 13, 2015

Hi I'm trying to iterate through the text content of a subtree using elt.itertext() (v3.5.0b1 git master branch) as follows: import lxml.html.soupparser as soupparser import requests doc = requests.get("http://f10.5post.com/forums/showthread.php?t=1142017").content tree = soupparser.fromstring(doc) nodes = tree.getchildren() for elt in nodes: for t in elt.itertext(): print t But I keep getting an error saying File "src/lxml/iterparse.pxi", line 248, in lxml.etree.iterwalk.__init__ (src/lxml/lxml.etree.c:134032) File "src/lxml/apihelpers.pxi", line 67, in lxml.etree._rootNodeOrRaise (src/lxml/lxml.etree.c:15220) ValueError: Input object has no element: HtmlComment Is there a way to skip all HTML comments? Also, what does this error actually mean? Any help will be appreciated. Thanks John

2 1

Iterparse memory problem
by Dionyz Lazar June 24, 2015

June 24, 2015

Hello, I have been using lxml (3.4.3) for parsing xmls from vendors. For example, here is one of the smaller files that should be publicly available: http://www.eberry.cz/editor/image/eshop_products/feed_seznam_jyxo.xml I am using urllib3 to get the response which should be file-like object that I am sending straight to iterparse method. It works great memory-wise as it does not have to put whole file into memory (some files can be huge). I am interested only in SHOPITEM element and I also clear() the element after I am done with it. I tried tag attribute of iterparse method to get events relevant only to this element. When I do that, the memory usage spikes up and it looks like it is putting whole file in memory. Any ideas on what could cause this behavior? Regards, Dio

2 1

Build error: No such file or directory: 'src/lxml/lxml.etree.c'
by John Munroe June 24, 2015

June 24, 2015

Hi, I've grabbed 3.5.0beta1 from github and tried building it. I'm on OS X and have lxml2.9.2 rather than lxml2.9.1. So, I’m using the following command to build: python setup.py build --static-deps --libxml2-version=2.9.2 --without-cython but I keep getting an error saying clang: error: no such file or directory: 'src/lxml/lxml.etree.c' clang: error: no input files Indeed, the C file doesn't exist and isn't part of the distribution though. Am I missing something? I'd like to have it installed in a virtualenv (eventually). Any help will be appreciated. Thanks John

2 2

Re: [lxml] Can I change maxvars?
by Stefan Behnel June 21, 2015

June 21, 2015

Sam Bull schrieb am 21.06.2015 um 12:12: > On Mon, 2014-07-14 at 20:52 +0200, Stefan Behnel wrote: >> Sam Bull, 12.07.2014 17:15: >>> I'm trying to process some XML files, and a few of them are several >>> thousand lines long, and with the moderately complicated XSL I'm using, >>> I seem to be hitting recursion limits. >>> >>> I'm currently getting this message: >>> lxml.etree.XSLTApplyError: xsltApplyXSLTTemplate: A potential >>> infinite template recursion was detected. >>> You can adjust maxTemplateVars (--maxvars) in order to raise the >>> maximum number of variables/params (currently set to 15000). >>> >>> It says I can adjust the value, but doesn't explain how, nor is this >>> value mentioned anywhere in the documentation. >>> >>> I've just had to change the maxdepth, which can be done with >>> XSLT.set_global_max_depth(), but there doesn't appear to be an >>> equivalent for maxvars. How can I change this value? >> >> You can't currently. The problem is, it was new in libxslt 1.1.27, and even >> the next lxml release will still support everything back to 1.1.23, so this >> needs a little C level hacking to support depending on the libxslt version >> it compiles against. >> >> The upside is that libxslt 1.1.27 also introduced a per-context setting >> (maxTemplateVars), i.e. you can define the value for each stylesheet run >> rather than setting a global value. A new keyword argument for XSLT() >> should work nicely here, e.g. "max_recursion_vars". The same applies to >> "maxTemplateDepth" in 1.1.27, which could be set as "max_recursion_depth" >> in XSLT(). > > Don't suppose there's been any progress on this? No. Pull requests still welcome. Stefan

1 0

xmlfile and namespaces/pretty printing
by Frederik Elwert June 12, 2015

June 12, 2015

Hello, I want to write a very large XML file to disc. Since I ran into memory issues using the regular ElementTree.write() method, I switched to using etree.xmlfile. Generally, it works quite well, but I ran into two issues. Here’s my test code: ----8<---- from lxml import etree P_DATA = '{http://www.dspin.de/data}' P_TEXT = '{http://www.dspin.de/data/textcorpus}' with etree.xmlfile('test.xml', encoding='utf-8') as xf: with xf.element(P_DATA + 'D-Spin', nsmap={None: 'http://www.dspin.de/data'}): with xf.element(P_TEXT + 'TextCorpus', lang='de', nsmap={None: 'http://www.dspin.de/data/textcorpus'}): element = etree.Element(P_TEXT + 'tokens', nsmap={None: 'http://www.dspin.de/data/textcorpus'}) element2 = etree.SubElement(element, P_TEXT + 'token') xf.write(element, pretty_print=True) ---->8---- And here’s the output: ----8<---- <D-Spin xmlns="http://www.dspin.de/data"><TextCorpus xmlns="http://www.dspin.de/data/textcorpus" lang="de"><tokens xmlns="http://www.dspin.de/data/textcorpus"> <token/> </tokens> </TextCorpus></D-Spin> ---->8---- Now my questions are: 1. I had to add an nsmap argument to the creation of "element" in order to prevent an "ns0:" prefix in the output. But this lead to a duplication of the declaration of the default namespace 'http://www.dspin.de/data/textcorpus' on both <TextCorpus> and <tokens>. Since the generation of the Elements that I write to the xmlfile happens somewhere else in the real code, it is a bit cumbersome to add nsmaps all over the place. And even then, I have the duplicated namespace declaration. So ideally I’d like xf.write() to be aware of the current namespace map defined by the xf.element. Is that possible? 2. I can pass "pretty_print=True" to xf.write(), but it naturally only affects those sub-trees. Is it possible to pretty-print the elements generated by xf.element() as well? Maybe it would be nice to be able to pass pretty_print to etree.xmlfile() itself? Regards, Frederik -- Dr. Frederik Elwert Project Manager/SeNeReKo Postdoctoral Researcher/KHK Centre for Religious Studies Ruhr-University Bochum Universitätsstr. 150 D-44780 Bochum Phone +49(0)234 32-23024

3 5