Mailman 3 January 2017 - lxml - The Python XML Toolkit

etree.cpython-34m.so: undefined symbol: PyExc_SystemErro
by Финковский Игорь 14 Jan '17

14 Jan '17

REPEAT without HTML ___________________________________________________________ Good afternoon everyone. Sorry for the mistakes English is not my native. Could you help to solve the following problem: in the corporate web server runs the Python interpreter. When I execute the following code in it from lxml import etree error occurs /usr/lib64/python3.4/site-packages/lxml/etree.cpython-34m.so: undefined symbol: PyExc_SystemError But the same code works in IDLE for example. After talking with colleagues I realized that the error occurs because the lxml library does not have libpython.so in the list of dependencies. Could it be? how to rebuild specifying this dependency? I work on CentOS7 x64 python34 x86_64 from lxml import etree print("%-20s: %s" % ('Python', sys.version_info)) Python : sys.version_info(major=3, minor=4, micro=5, releaselevel='final', serial=0) print("%-20s: %s" % ('lxml.etree', etree.LXML_VERSION)) lxml.etree : (3, 7, 2, 0) print("%-20s: %s" % ('libxml used', etree.LIBXML_VERSION)) libxml used : (2, 9, 3) print("%-20s: %s" % ('libxml compiled', etree.LIBXML_COMPILED_VERSION)) libxml compiled : (2, 9, 3) print("%-20s: %s" % ('libxslt used', etree.LIBXSLT_VERSION)) libxslt used : (1, 1, 29) Показать цитату целикомПоказать всю переписку libxslt compiled : (1, 1, 29) -- С уважением, Игорь Финковский +7 (909) 256-90-45 89092569045(a)ya.ru

2 1

Overzealous urlencoding
by Burak Arslan 14 Jan '17

14 Jan '17

Behold: >>> from lxml.builder import E as Ex >>> from lxml.html.builder import E as Eh >>> from lxml import html, etree >>> >>> etree.tostring(Ex.a(href="[", mref="[")) '<a href="[" mref="["/>' >>> etree.tostring(Eh.a(href="[", mref="[")) '<a href="[" mref="["/>' >>> html.tostring(Ex.a(href="[", mref="[")) '<a href="%5B" mref="["></a>' >>> html.tostring(Eh.a(href="[", mref="[")) '<a href="%5B" mref="["></a>' >>> html.tostring(Eh.b(href="[", mref="[")) '<b href="%5B" mref="["></b>' Don't you think it's outside of lxml's area of responsibility to force ALL (not just the ones in anchors) href attributes to be urlencode()'d in html mode? FYI this is needed for polymer where one might need to use data binding syntax like <a href="[[item.link]]">Some Text</a> (Actually, polymer recommends $ syntax for native attributes, so this is unlikely to be a real-world problem, but the point still stands. ie <a href$="[[item.link]]">Some Text</a>) Python has perfectly fine urlencoding machinery and it should be my responsibility to use that whenever needed, not the responsibility of my xml library. What do you think? Best, Burak

2 1

a variable as the value of an XPath predicate or some other way of identifying an element? PS
by Martin Mueller 10 Jan '17

10 Jan '17

To be more precise, my <ref> elements have target attributes whose value is the value of the xml:id of the note. So another version of the question is Given ref/@target=”somevalue”, how can I call up the note whose xml:id is the value of the target attribute? Is it possible in lxml to pass a variable to the value of an XPath predicate? I have a corpus of texts with lots of <note> element. I’ve created a<ref> elements for the siglum of each note and given the <ref> element and its corresponding <note> element xml:ids that differ only in a final flag. Thus the <ref> element with an id ‘A00011-358a’ maps to a <note> element with the id ‘A00011-358-b. So, if I know either the ref or the note id I can identify the other. If the value of ref is “somevalue-a” the value of the other will be “somevalue-b”. There doesn’t seem to be a way of doing this with Xpath. The value of a predicate must be a literal of some sort. Or do I get this wrong? And if I’m right, is there another way of starting from “somevalue-a” and asking lxml to take me to “somevalue-a[:-1] + ‘b’? Martin Mueller Professor emeritus of English and Classics Northwestern University

2 1

a variable as the value of an XPath predicate or some other way of identifying an element?
by Martin Mueller 09 Jan '17

09 Jan '17

Is it possible in lxml to pass a variable to the value of an XPath predicate? I have a corpus of texts with lots of <note> element. I’ve created a<ref> elements for the siglum of each note and given the <ref> element and its corresponding <note> element xml:ids that differ only in a final flag. Thus the <ref> element with an id ‘A00011-358a’ maps to a <note> element with the id ‘A00011-358-b. So, if I know either the ref or the note id I can identify the other. If the value of ref is “somevalue-a” the value of the other will be “somevalue-b”. There doesn’t seem to be a way of doing this with Xpath. The value of a predicate must be a literal of some sort. Or do I get this wrong? And if I’m right, is there another way of starting from “somevalue-a” and asking lxml to take me to “somevalue-a[:-1] + ‘b’? Martin Mueller Professor emeritus of English and Classics Northwestern University

1 0

ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters
by Ron Gaw <ronmlgaw at yahoo dot com> 04 Jan '17

04 Jan '17

After *finally* getting LXML installed successfully into site-packages, I'm still getting very basic errors during __init__ of etree instances. I've found several potential explanations, but need a little help narrowing which one is correct, since I do not quite (yet) understand how python2.7 or the LXML code itself is causing the Unicode error: In xmlschema.pxi, line 22-24:------------------------------------------- cdef XPath _check_for_default_attributes = XPath( u"boolean(//xs:attribute[@default or @fixed][1])", namespaces={u'xs': u'http://www.w3.org/2001/XMLSchema'}) ------------------------------------------- $ python2 Python 2.7.11 (default, Mar 4 2016, 10:54:03) [GCC 4.9.2] on msys Type "help", "copyright", "credits" or "license" for more information. >>> import sys >>> from lxml import etree Traceback (most recent call last): File "<stdin>", line 1, in <module> File "src/lxml/xmlschema.pxi", line 22, in init lxml.etree (src/lxml/lxml.etree.c:227959) cdef XPath _check_for_default_attributes = XPath( File "src/lxml/xpath.pxi", line 414, in lxml.etree.XPath.__init__ (src/lxml/lxml.etree.c:170395) _XPathEvaluatorBase.__init__(self, namespaces, extensions, File "src/lxml/xpath.pxi", line 133, in lxml.etree._XPathEvaluatorBase.__init__ (src/lxml/lxml.etree.c:166611) self._context = _XPathContext(namespaces, extensions, self._error_log, File "src/lxml/xpath.pxi", line 57, in lxml.etree._XPathContext.__init__ (src/lxml/lxml.etree.c:165567) _BaseContext.__init__(self, namespaces, extensions, error_log, enable_regexp, File "src/lxml/extensions.pxi", line 89, in lxml.etree._BaseContext.__init__ (src/lxml/lxml.etree.c:154495) prefix_utf = self._to_utf(prefix) File "src/lxml/extensions.pxi", line 128, in lxml.etree._BaseContext._to_utf (src/lxml/lxml.etree.c:155101) utf = _utf8(s) File "src/lxml/apihelpers.pxi", line 1443, in lxml.etree._utf8 (src/lxml/lxml.etree.c:31495) raise ValueError( ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters Initially, I found this report, but no longer believe it's the most likely (included just in case):https://www.odoo.com/forum/help-1/question/how-to-resolve-valueerror-… Now I've found this, which seems more likely at least as much as I understand it (still not seeing any non-UTF in those 3 xmlschema.pxi lines??):https://github.com/html5lib/html5lib-python/issues/96 Is it something with the "//xs"??

2 1

lxml-3.4.0 problem with <xs:alternative>
by giannis.bakas 04 Jan '17

04 Jan '17

Dear all, I want to use lxml to validate an xml with an xsd. In the xsd I am using the tag <xs:alternative> inside an element tag and I am getting this error: lxml.etree.XMLSchemaParseError: Element '{http://www.w3.org/2001/XMLSchema}element': The content is not valid. Expected is (annotation?, ((simpleType | complexType)?, (unique | key | keyref)*))., line 5 ---XSD--- 4: <xs:element name="node" type="node"> 5: <xs:alternative test="@mode = 'A'" type="node-type-A"/> 6: <xs:alternative test="@mode = 'B'" type="node-type-B"/> 7: </xs:element> Does lxml support conditional types of XSD 1.1. I am using version 3.4.0 Best regards, Yannis

2 1

ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters
by Ron Gaw <ronmlgaw at yahoo dot com> 04 Jan '17

04 Jan '17

On Sun, 01 Jan 2017 02:59:39 +0000 Ron Gaw <ronmlgaw at yahoo.com> wrote:> $ python2 > Python 2.7.11 (default, Mar 4 2016, 10:54:03) > [GCC 4.9.2] on msys > Type "help", "copyright", "credits" or "license" for more information. > >>> import sys > >>> from lxml import etree > Traceback (most recent call last): > File "<stdin>", line 1, in <module> > File "src/lxml/xmlschema.pxi", line 22, in init lxml.etree (src/lxml/lxml.etree.c:227959) > cdef XPath _check_for_default_attributes = XPath( > File "src/lxml/xpath.pxi", line 414, in lxml.etree.XPath.__init__ (src/lxml/lxml.etree.c:170395) > _XPathEvaluatorBase.__init__(self, namespaces, extensions, > File "src/lxml/xpath.pxi", line 133, in lxml.etree._XPathEvaluatorBase.__init__ (src/lxml/lxml.etree.c:166611) > self._context = _XPathContext(namespaces, extensions, self._error_log, > File "src/lxml/xpath.pxi", line 57, in lxml.etree._XPathContext.__init__ (src/lxml/lxml.etree.c:165567) > _BaseContext.__init__(self, namespaces, extensions, error_log, enable_regexp, > File "src/lxml/extensions.pxi", line 89, in lxml.etree._BaseContext.__init__ (src/lxml/lxml.etree.c:154495) > prefix_utf = self._to_utf(prefix) > File "src/lxml/extensions.pxi", line 128, in lxml.etree._BaseContext._to_utf (src/lxml/lxml.etree.c:155101) > utf = _utf8(s) > File "src/lxml/apihelpers.pxi", line 1443, in lxml.etree._utf8 (src/lxml/lxml.etree.c:31495) > raise ValueError( > ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters Updating to show debug output (NOTE: I've manually deleted all output starting with the "#" to simplify / shorten this): $ python2 -vvvvv import zipimport # builtin import site # precompiled from /usr/lib/python2.7/site.pyc import os # precompiled from /usr/lib/python2.7/os.pyc import errno # builtin import posix # builtin import posixpath # precompiled from /usr/lib/python2.7/posixpath.pyc import stat # precompiled from /usr/lib/python2.7/stat.pyc import genericpath # precompiled from /usr/lib/python2.7/genericpath.pyc import warnings # precompiled from /usr/lib/python2.7/warnings.pyc import linecache # precompiled from /usr/lib/python2.7/linecache.pyc import types # precompiled from /usr/lib/python2.7/types.pyc import UserDict # precompiled from /usr/lib/python2.7/UserDict.pyc import _abcoll # precompiled from /usr/lib/python2.7/_abcoll.pyc import abc # precompiled from /usr/lib/python2.7/abc.pyc import _weakrefset # precompiled from /usr/lib/python2.7/_weakrefset.pyc import _weakref # builtin import copy_reg # precompiled from /usr/lib/python2.7/copy_reg.pyc import traceback # precompiled from /usr/lib/python2.7/traceback.pyc import sysconfig # precompiled from /usr/lib/python2.7/sysconfig.pyc import re # precompiled from /usr/lib/python2.7/re.pyc import sre_compile # precompiled from /usr/lib/python2.7/sre_compile.pyc import _sre # builtin import sre_parse # precompiled from /usr/lib/python2.7/sre_parse.pyc import sre_constants # precompiled from /usr/lib/python2.7/sre_constants.pyc dlopen("/usr/lib/python2.7/lib-dynload/_locale.dll", 2); import _locale # dynamically loaded from /usr/lib/python2.7/lib-dynload/_locale.dll import _sysconfigdata # precompiled from /usr/lib/python2.7/_sysconfigdata.pyc import encodings # directory /usr/lib/python2.7/encodings import encodings # precompiled from /usr/lib/python2.7/encodings/__init__.pyc import codecs # precompiled from /usr/lib/python2.7/codecs.pyc import _codecs # builtin import encodings.aliases # precompiled from /usr/lib/python2.7/encodings/aliases.pyc import encodings.utf_8 # precompiled from /usr/lib/python2.7/encodings/utf_8.pyc Python 2.7.11 (default, Mar 4 2016, 10:54:03) [GCC 4.9.2] on msys Type "help", "copyright", "credits" or "license" for more information. dlopen("/usr/lib/python2.7/lib-dynload/readline.dll", 2); import readline # dynamically loaded from /usr/lib/python2.7/lib-dynload/readline.dll >>> import sys >>> from lxml import etree import lxml # directory /usr/lib/python2.7/site-packages/lxml-3.7.1-x86_64.egg/lxml import lxml # precompiled from /usr/lib/python2.7/site-packages/lxml-3.7.1-x86_64.egg/lxml/__init__.pyc dlopen("/usr/lib/python2.7/site-packages/lxml-3.7.1-x86_64.egg/lxml/etree.dll", 2); import collections # precompiled from /usr/lib/python2.7/collections.pyc dlopen("/usr/lib/python2.7/lib-dynload/_collections.dll", 2); import _collections # dynamically loaded from /usr/lib/python2.7/lib-dynload/_collections.dll dlopen("/usr/lib/python2.7/lib-dynload/operator.dll", 2); import operator # dynamically loaded from /usr/lib/python2.7/lib-dynload/operator.dll import keyword # precompiled from /usr/lib/python2.7/keyword.pyc import heapq # precompiled from /usr/lib/python2.7/heapq.pyc dlopen("/usr/lib/python2.7/lib-dynload/itertools.dll", 2); import itertools # dynamically loaded from /usr/lib/python2.7/lib-dynload/itertools.dll dlopen("/usr/lib/python2.7/lib-dynload/_heapq.dll", 2); import _heapq # dynamically loaded from /usr/lib/python2.7/lib-dynload/_heapq.dll import thread # builtin import io # precompiled from /usr/lib/python2.7/io.pyc dlopen("/usr/lib/python2.7/lib-dynload/_io.dll", 2); import _io # dynamically loaded from /usr/lib/python2.7/lib-dynload/_io.dll import lxml._elementpath # precompiled from /usr/lib/python2.7/site-packages/lxml-3.7.1-x86_64.egg/lxml/_elementpath.pyc import encodings.ascii # from /usr/lib/python2.7/encodings/ascii.py import inspect # precompiled from /usr/lib/python2.7/inspect.pyc import string # precompiled from /usr/lib/python2.7/string.pyc dlopen("/usr/lib/python2.7/lib-dynload/strop.dll", 2); import strop # dynamically loaded from /usr/lib/python2.7/lib-dynload/strop.dll import dis # precompiled from /usr/lib/python2.7/dis.pyc import opcode # precompiled from /usr/lib/python2.7/opcode.pyc import imp # builtin import tokenize # precompiled from /usr/lib/python2.7/tokenize.pyc import token # precompiled from /usr/lib/python2.7/token.pyc import gzip # from /usr/lib/python2.7/gzip.py import struct # precompiled from /usr/lib/python2.7/struct.pyc dlopen("/usr/lib/python2.7/lib-dynload/_struct.dll", 2); import _struct # dynamically loaded from /usr/lib/python2.7/lib-dynload/_struct.dll dlopen("/usr/lib/python2.7/lib-dynload/time.dll", 2); import time # dynamically loaded from /usr/lib/python2.7/lib-dynload/time.dll dlopen("/usr/lib/python2.7/lib-dynload/zlib.dll", 2); import zlib # dynamically loaded from /usr/lib/python2.7/lib-dynload/zlib.dll import rply.errors # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/errors.pyc import rply.token # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/token.pyc import rply.lexer # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/lexer.pyc import rply.lexergenerator # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/lexergenerator.pyc import hashlib # precompiled from /usr/lib/python2.7/hashlib.pyc dlopen("/usr/lib/python2.7/lib-dynload/_hashlib.dll", 2); import _hashlib # dynamically loaded from /usr/lib/python2.7/lib-dynload/_hashlib.dll import json # directory /usr/lib/python2.7/json import json # from /usr/lib/python2.7/json/__init__.py import json.decoder # from /usr/lib/python2.7/json/decoder.py import json.scanner # from /usr/lib/python2.7/json/scanner.py dlopen("/usr/lib/python2.7/lib-dynload/_json.dll", 2); import _json # dynamically loaded from /usr/lib/python2.7/lib-dynload/_json.dll import json.encoder # from /usr/lib/python2.7/json/encoder.py import random # precompiled from /usr/lib/python2.7/random.pyc import __future__ # precompiled from /usr/lib/python2.7/__future__.pyc dlopen("/usr/lib/python2.7/lib-dynload/math.dll", 2); import math # dynamically loaded from /usr/lib/python2.7/lib-dynload/math.dll dlopen("/usr/lib/python2.7/lib-dynload/binascii.dll", 2); import binascii # dynamically loaded from /usr/lib/python2.7/lib-dynload/binascii.dll dlopen("/usr/lib/python2.7/lib-dynload/_random.dll", 2); import _random # dynamically loaded from /usr/lib/python2.7/lib-dynload/_random.dll import appdirs # loaded from Zip /usr/lib/python2.7/site-packages/appdirs-1.4.0-py2.7.egg/appdirs.pyc import rply.utils # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/utils.pyc import rply.grammar # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/grammar.pyc import rply.parser # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/parser.pyc import rply.parsergenerator # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/parsergenerator.pyc import rply # loaded from Zip /usr/lib/python2.7/site-packages/rply-0.7.4-py2.7.egg/rply/__init__.pyc import rnc2rng.parser # loaded from Zip /usr/lib/python2.7/site-packages/rnc2rng-2.1-py2.7.egg/rnc2rng/parser.pyc import cgi # from /usr/lib/python2.7/cgi.py import urlparse # precompiled from /usr/lib/python2.7/urlparse.pyc import mimetools # precompiled from /usr/lib/python2.7/mimetools.pyc import tempfile # precompiled from /usr/lib/python2.7/tempfile.pyc dlopen("/usr/lib/python2.7/lib-dynload/cStringIO.dll", 2); import cStringIO # dynamically loaded from /usr/lib/python2.7/lib-dynload/cStringIO.dll dlopen("/usr/lib/python2.7/lib-dynload/fcntl.dll", 2); import fcntl # dynamically loaded from /usr/lib/python2.7/lib-dynload/fcntl.dll import rfc822 # precompiled from /usr/lib/python2.7/rfc822.pyc import rnc2rng.serializer # loaded from Zip /usr/lib/python2.7/site-packages/rnc2rng-2.1-py2.7.egg/rnc2rng/serializer.pyc import rnc2rng # loaded from Zip /usr/lib/python2.7/site-packages/rnc2rng-2.1-py2.7.egg/rnc2rng/__init__.pyc Traceback (most recent call last): File "<stdin>", line 1, in <module> File "src/lxml/xmlschema.pxi", line 22, in init lxml.etree (src/lxml/lxml.etree.c:227961) cdef XPath _check_for_default_attributes = XPath( File "src/lxml/xpath.pxi", line 414, in lxml.etree.XPath.__init__ (src/lxml/lxml.etree.c:170397) _XPathEvaluatorBase.__init__(self, namespaces, extensions, File "src/lxml/xpath.pxi", line 133, in lxml.etree._XPathEvaluatorBase.__init__ (src/lxml/lxml.etree.c:166613) self._context = _XPathContext(namespaces, extensions, self._error_log, File "src/lxml/xpath.pxi", line 57, in lxml.etree._XPathContext.__init__ (src/lxml/lxml.etree.c:165569) _BaseContext.__init__(self, namespaces, extensions, error_log, enable_regexp, File "src/lxml/extensions.pxi", line 89, in lxml.etree._BaseContext.__init__ (src/lxml/lxml.etree.c:154497) prefix_utf = self._to_utf(prefix) File "src/lxml/extensions.pxi", line 128, in lxml.etree._BaseContext._to_utf (src/lxml/lxml.etree.c:155103) utf = _utf8(s) File "src/lxml/apihelpers.pxi", line 1443, in lxml.etree._utf8 (src/lxml/lxml.etree.c:31496) raise ValueError( ValueError: All strings must be XML compatible: Unicode or ASCII, no NULL bytes or control characters

1 0

Invalid requirement, parse error at "'-===x86-'"
by Ron Gaw <ronmlgaw at yahoo dot com> 01 Jan '17

01 Jan '17

Okay, I haven't solved the "why", but I have made it work (the bdist_egg installation into site-packages, that is). After executing $ python2 setup.py bdist_egg$ mv dist/lxml-3.7.1-py2.7-mingw64_nt-6.1-2.6.0$0.304/5/3$-x86_64.egg lxml-3.7.1-x86_64.egg$ python2 -m easy_install lxml-3.7.1-x86_64.egg Now LXML is found correctly in the following: /msys64/usr/lib/python2.7/site-packages/lxml-3.7.1-x86_64.egg/lxml/ However - Simple attempts to use LXML still fail - but I will open a new thread since this appears to be a different / unique issue.

1 0