Mailman 3 August 2016 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel 11 Apr '23

11 Apr '23

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon 10 Apr '23

10 Apr '23

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede 30 Jan '23

30 Jan '23

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel 11 Jan '23

11 Jan '23

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 31 Aug '22

31 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

htmlfile doesn't escape attribute values
by Burak Arslan 27 Dec '16

27 Dec '16

Hello, This is a heads-up for bug 1594155 here: https://bugs.launchpad.net/lxml/+bug/1594155 Please consider the following test case. >>> from lxml import html >>> from lxml.etree import htmlfile >>> from lxml.html.builder import E >>> from StringIO import StringIO >>> out = StringIO() >>> with htmlfile(out) as f: ... with f.element("tagname", attrib={"attr": '"misquoted"'}): ... f.write("foo") ... >>> out.getvalue() '<tagname attr=""misquoted"">foo</tagname>' Expected output: '<tagname attr=""misquoted"">foo</tagname>' Lack of proper escaping confuses the hell out of browsers :) Proper escaping is needed to safely put html documents inside srcdoc attribute of an <iframe>. The workaround is to quote the data before putting it inside an attribute. Fortunately, only replacing " with " is enough and & is also not escaped (but it should be). versions: Python : sys.version_info(major=2, minor=7, micro=11, releaselevel='final', serial=0) lxml.etree : (3, 6, 0, 0) libxml used : (2, 9, 3) libxml compiled : (2, 9, 3) libxslt used : (1, 1, 28) libxslt compiled : (1, 1, 28) Best regards, Burak

1 1

XML schema validation error using 3.6.3
by Tom Kralidis 05 Nov '16

05 Nov '16

Hi all: moving from 3.6.2 to 3.6.3 introduces an XML Schema validation error. Test case: XML document: https://github.com/geopython/pycsw/blob/master/tests/suites/default/post/Ge… Associated XML Schema: http://schemas.opengis.net/csw/2.0.2/CSW-discovery.xsd (note there are numerous includes/imports. Full schema tree can be downloaded from http://schemas.opengis.net/SCHEMAS_OPENGIS_NET.zip). Code snippet: schema = etree.XMLSchema(file='/path/to/csw/2.0.2/CSW-discovery.xsd') parser = etree.XMLParser(schema=schema, resolve_entities=False) doc = etree.fromstring(postdata, parser) Result: Element '{http://www.opengis.net/cat/csw/2.0.2}GetRecordById', attribute 'service': The value '(null)' does not match the fixed value constraint 'CSW'. Testing results summary [1]: - lxml 3.6.1 && libxml2 2.9.1 passes - lxml 3.6.2 && libxml2 2.9.1 passes - lxml 3.6.3 && libxml2 2.9.4 FAILS with said validation error - lxml 3.6.4 && libxml2 2.9.4 FAILS with said validation error Any ideas? Is this a libxml2 issue? I notice 3.6.2 uses libxml2 2.9.1 whereas 3.6.3 uses libxml2 2.9.4 (on travis, fwiw). Let me know if you need more info or a clearer test case, or if/where I should file an issue. Thanks ..Tom [1] https://github.com/geopython/pycsw/pull/453

2 2

html5parser and Python 3
by Paul Tremberth 24 Aug '16

24 Aug '16

Hello, I am having trouble using lxml.html.html5parser[1] with Python 3. >>> from lxml.html import html5parser >>> html5parser.fromstring('<html><body>test</body></html>') Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/lxml/html/html5parser.py", line 147, in fromstring guess_charset=guess_charset) File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/lxml/html/html5parser.py", line 64, in document_fromstring return parser.parse(html, useChardet=guess_charset).getroot() File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/html5lib/html5parser.py", line 235, in parse self._parse(stream, False, None, *args, **kwargs) File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/html5lib/html5parser.py", line 85, in _parse self.tokenizer = _tokenizer.HTMLTokenizer(stream, parser=self, **kwargs) File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/html5lib/_tokenizer.py", line 36, in __init__ self.stream = HTMLInputStream(stream, **kwargs) File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/html5lib/_inputstream.py", line 149, in HTMLInputStream return HTMLUnicodeInputStream(source, **kwargs) TypeError: __init__() got an unexpected keyword argument 'useChardet' I don't see any doc mention of bytes or unicode input restriction on lxml.html.html5parser.fromstring and related, and in fact the code tests for both[3] bytes and unicode/str in Python 3. So I believe it's a bug. I also see that html5parser tests are not run on Travis, which I enabled on my fork of lxml just to see, effectively showing the same issue[2] I'm having locally, namely the use of 'useChardet' argument for Unicode strings, which html5lib's HTML parser only accepts for bytes input. There's another seperate issue with bytes input with html5parser.fromstring() (not with document_fromstring()) >>> html5parser.fromstring(b'<html><body>test</body></html>') Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/paul/.virtualenvs/lxml.py35/lib/python3.5/site-packages/lxml/html/html5parser.py", line 151, in fromstring if start.startswith('<html') or start.startswith('<!doctype'): TypeError: startswith first arg must be bytes or a tuple of bytes, not str >>> html5parser.document_fromstring(b'<html><body>test</body></html>') <Element {http://www.w3.org/1999/xhtml}html at 0x7f7000219b48> >>> Info on my setup: lxml : 3.6.4.0 libxml2 : 2.9.4 Python : 3.5.2 (default, Jul 5 2016, 12:43:10) - [GCC 5.4.0 20160609] Platform : Linux-4.4.0-34-generic-x86_64-with-Ubuntu-16.04-xenial Let me know if I should file a bug on Launchpad or if this is tracked already (I could not find anything similar in Launchpad). Cheers, /Paul. [1] http://lxml.de/html5parser.html [2] https://travis-ci.org/redapple/lxml/jobs/154796295 [3] https://github.com/lxml/lxml/blob/master/src/lxml/html/html5parser.py#L58

1 0

Windows wheels
by klo uo 22 Aug '16

22 Aug '16

Hi, could you please provide Windows wheels, so that we can install lxml with pip. It would be really nice to be able to include lxml in requirements.txt and expect that it would install on major platforms. Thanks, Klo

2 1

3.6.3 error on OS X: library not found for -lrt
by Christian Long 18 Aug '16

18 Aug '16

Hi, I'm getting an error installing 3.6.3 on OS X 10.10.5 $ pip install lxml==3.6.3 Collecting lxml==3.6.3 Using cached lxml-3.6.3.tar.gz Building wheels for collected packages: lxml Running setup.py bdist_wheel for lxml ... - ... clang -fno-strict-aliasing -fno-common -dynamic -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -I/usr/include/libxml2 -Isrc/lxml/includes -I/usr/local/Cellar/python/2.7.10_2/Frameworks/Python.framework/Versions/2.7/include/python2.7 -c src/lxml/lxml.etree.c -o build/temp.macosx-10.10-x86_64-2.7/src/lxml/lxml.etree.o -w -flat_namespace clang -bundle -undefined dynamic_lookup build/temp.macosx-10.10-x86_64-2.7/src/lxml/lxml.etree.o -lxslt -lexslt -lrt -lxml2 -lz -lm -o build/lib.macosx-10.10-x86_64-2.7/lxml/etree.so ld: library not found for -lrt clang: error: linker command failed with exit code 1 (use -v to see invocation) error: command 'clang' failed with exit status 1 3.6.2 installs fine $ pip install lxml==3.6.2 Collecting lxml==3.6.2 Installing collected packages: lxml Successfully installed lxml-3.6.2 It looks like rt was added as a build dependency in 3.6.3. https://github.com/lxml/lxml/commit/8687eb00fc50a61d020ffec11ddd76946ed0bc86 Maybe using the old values for the libs argument on OS X would work. elif sys.platform in ('darwin',): if OPTION_STATIC: libs = ['z', 'm'] else: libs = ['xslt', 'exslt', 'xml2', 'z', 'm'] Thanks, Christian

1 0