Mailman 3 May 2007 - lxml - The Python XML Toolkit

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 30 Aug '22

30 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

[lxml-dev] Pickling objectified trees
by Christian Zagrodnick 09 Jun '08

09 Jun '08

Hi, the other day I had to pickle objectified trees. I just thought to share my findings. Pickling is about serialization. IMHO the natural serialization of an objectified tree is its XML representation. So the following basically does that: -------------------------- import copy_reg import lxml.etree import lxml.objectify def treeFactory(state): """Un-Pickle factory.""" return lxml.objectify.fromstring(state) copy_reg.constructor(treeFactory) def reduceObjectifiedElement(object): """Reduce function for lxml.objectify trees. See http://docs.python.org/lib/pickle-protocol.html for details. """ return (treeFactory, (lxml.etree.tostring(object), )) copy_reg.pickle(lxml.objectify.ObjectifiedElement, reduceObjectifiedElement, treeFactory) ----------------------------------------- You might consider just registering the reduce function in lxml itself. Shouldn't hurt, should it. -- Christian Zagrodnick gocept gmbh & co. kg · forsterstrasse 29 · 06112 halle/saale www.gocept.com · fon. +49 345 12298894 · fax. +49 345 12298891

2 4

[lxml-dev] lxml namespaces
by Maxim Sloyko 19 Feb '08

19 Feb '08

Hi All! I have a little problem with XML namespaces. In my application I have two XML processors, that process the same document, one after the other. The first one looks for nodes in 'ns1' namespace, and substitutes them, according to some algorithm. After this processor is finished, it is guaranteed that there are no more 'ns1' nodes left in the tree. 'ns1' namespace dclaration is still there, in the root node (well, I put it there manually). Now, when this namespace is no longer needed, I want to get rid of it, because it confuses some other processors (namely, my browser) So, the question is, how do I do that? del tree.getroot().nsmap['ns1'] does not seem to do the trick :( Thanks in advance and Happy Holidays! -- Maxim Sloyko

3 5

[lxml-dev] python crashes in xmlDictFree inside Zope
by Eric Tiffany 04 Jun '07

04 Jun '07

I have been prototyping some XMLSchema parsing/validating using lxml 1.3beta. Everthing works great from python 2.4.4 started from the command line, or running from inside Eclipse. However, when I moved my code over to my Plone product, python crashes when Zope is initializing the product. I am creating my XMLSchema object there. THe code is essentially the same, running under the same python and with the same libs (afaik). Some earlier attempts (with python 2.4.3) gave me this error: python(11139) malloc: *** Deallocation of a pointer not malloced: 0x80; This could be a double free(), or free() called with the middle of an allocated block; Try setting environment variable MallocHelp to see tools to help debug I'm not seeing that now, as I have "upgraded" to python 2.4.4 which seems to be stripped or something. I don't have a test case immediately available, but here is the stack backtrace from the python crash log: OS Version: 10.4.9 (Build 8P2137) Report Version: 4 Command: Python Path: /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Resources/Python .app/Contents/MacOS/Python Parent: bash [11055] Version: 2.4a0 (2.4alpha1) PID: 11135 Thread: 0 Exception: EXC_BAD_ACCESS (0x0001) Codes: KERN_PROTECTION_FAILURE (0x0002) at 0x00000001 Thread 0 Crashed: 0 libxml2.2.dylib 0x033f6294 xmlDictFree + 45 1 libxml2.2.dylib 0x033f62e2 xmlDictFree + 123 2 libxml2.2.dylib 0x033f62e2 xmlDictFree + 123 3 etree.so 0x06406a08 __pyx_f_5etree_14_ParserContext_initThreadDictRef + 63 (etree.c:19725) 4 etree.so 0x06406a5b __pyx_f_5etree_14_ParserContext_initParserDict + 35 (etree.c:19740) 5 etree.so 0x06431bca __pyx_f_5etree_11_BaseParser__parseDocFromFile + 99 (etree.c:21340) 6 etree.so 0x0646a8f4 __pyx_f_5etree__parseDocument + 395 (etree.c:22486) 7 etree.so 0x0646cc50 __pyx_f_5etree_parse + 176 (etree.c:10300) 8 org.python.python 0x0027faca PyEval_EvalFrame + 22777 (ceval.c:3568) 9 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 10 org.python.python 0x0027e49f PyEval_EvalFrame + 17102 (ceval.c:3661) 11 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 12 org.python.python 0x0027e49f PyEval_EvalFrame + 17102 (ceval.c:3661) 13 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 14 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 15 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 16 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 17 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 18 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 19 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 20 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 21 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 22 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 23 org.python.python 0x002808a5 PyEval_EvalCode + 87 (ceval.c:490) 24 org.python.python 0x002a75fd PyRun_FileExFlags + 200 (pythonrun.c:1285) 25 org.python.python 0x002a78e0 PyRun_SimpleFileExFlags + 640 (pythonrun.c:869) 26 org.python.python 0x002b13ec Py_Main + 3199 (main.c:493) 27 org.python.python 0x00001fae 0x1000 + 4014 28 org.python.python 0x00001ed5 0x1000 + 3797 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x033f6275 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000001 esi: 0x05856fd0 ebp: 0xbfffcfe8 esp: 0xbfffcfb0 ss: 0x0000001f efl: 0x00010286 eip: 0x033f6294 cs: 0x00000017 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x2fff org.python.python 2.4a0 (2.4alpha1) /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Resources/Python .app/Contents/MacOS/Python 0xa0000 - 0xa1fff icglue.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/icglue.so 0xb8000 - 0xb9fff time.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/time.so 0xc3000 - 0xc6fff strop.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/strop.so 0x205000 - 0x2d9fff org.python.python 2.4a0 (2.2) /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Python 0x575000 - 0x576fff cStringIO.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/cStringIO.so 0x580000 - 0x581fff collections.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/collections.so 0x5cc000 - 0x5d2fff _socket.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_socket.so 0x5e7000 - 0x5e8fff _ssl.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_ssl.so 0x705000 - 0x737fff libssl.0.9.8.dylib /opt/local/lib/libssl.0.9.8.dylib 0x74b000 - 0x75cfff libz.1.dylib /opt/local/lib/libz.1.dylib 0x761000 - 0x763fff struct.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/struct.so 0x76f000 - 0x771fff binascii.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/binascii.so 0x7bc000 - 0x7bdfff math.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/math.so 0x7c5000 - 0x7c6fff _random.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_random.so 0x7cd000 - 0x7cefff fcntl.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/fcntl.so 0x7d6000 - 0x7d7fff md5.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/md5.so 0x7de000 - 0x7dffff sha.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/sha.so 0x7e6000 - 0x7e6fff _bisect.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_bisect.so 0x1008000 - 0x10f7fff libcrypto.0.9.8.dylib /opt/local/lib/libcrypto.0.9.8.dylib 0x11a0000 - 0x11abfff datetime.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/datetime.so 0x120e000 - 0x1211fff array.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/array.so 0x1222000 - 0x1222fff grp.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/grp.so 0x126e000 - 0x127bfff cPickle.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/cPickle.so 0x129a000 - 0x129dfff _Res.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_Res.so 0x12ac000 - 0x12b2fff _File.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_File.so 0x12cb000 - 0x12ccfff MacOS.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/MacOS.so 0x1348000 - 0x1374fff pyexpat.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/pyexpat.so 0x1427000 - 0x1427fff _weakref.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_weakref.so 0x142d000 - 0x142dfff _initgroups.so /Applications/Plone-2.5.2/lib/python/initgroups/_initgroups.so 0x1433000 - 0x1433fff crypt.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/crypt.so 0x1439000 - 0x143afff _heapq.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_heapq.so 0x1442000 - 0x1442fff _Missing.so /Applications/Plone-2.5.2/lib/python/Missing/_Missing.so 0x144e000 - 0x1450fff cPersistence.so /Applications/Plone-2.5.2/lib/python/persistent/cPersistence.so 0x145b000 - 0x145cfff TimeStamp.so /Applications/Plone-2.5.2/lib/python/persistent/TimeStamp.so 0x1463000 - 0x1464fff cPickleCache.so /Applications/Plone-2.5.2/lib/python/persistent/cPickleCache.so 0x146e000 - 0x146ffff _zope_interface_coptimizations.so /Applications/Plone-2.5.2/lib/python/zope/interface/_zope_interface_coptimiz ations.so 0x1477000 - 0x1477fff _MultiMapping.so /Applications/Plone-2.5.2/lib/python/MultiMapping/_MultiMapping.so 0x14fe000 - 0x1502fff cAccessControl.so /Applications/Plone-2.5.2/lib/python/AccessControl/cAccessControl.so 0x1510000 - 0x1512fff _ExtensionClass.so /Applications/Plone-2.5.2/lib/python/ExtensionClass/_ExtensionClass.so 0x151c000 - 0x1520fff _Acquisition.so /Applications/Plone-2.5.2/lib/python/Acquisition/_Acquisition.so 0x152e000 - 0x152ffff _Record.so /Applications/Plone-2.5.2/lib/python/Record/_Record.so 0x1537000 - 0x1539fff cDocumentTemplate.so /Applications/Plone-2.5.2/lib/python/DocumentTemplate/cDocumentTemplate.so 0x1585000 - 0x1591fff parser.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/parser.so 0x15e8000 - 0x15eafff zlib.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/zlib.so 0x1633000 - 0x1635fff operator.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/operator.so 0x167f000 - 0x1681fff _zope_proxy_proxy.so /Applications/Plone-2.5.2/lib/python/zope/proxy/_zope_proxy_proxy.so 0x168f000 - 0x1691fff itertools.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/itertools.so 0x16a0000 - 0x16a0fff _zope_i18nmessageid_message.so /Applications/Plone-2.5.2/lib/python/zope/i18nmessageid/_zope_i18nmessageid_ message.so 0x16e7000 - 0x16e7fff _zope_thread.so /Applications/Plone-2.5.2/lib/python/zope/thread/_zope_thread.so 0x16ee000 - 0x16f1fff _proxy.so /Applications/Plone-2.5.2/lib/python/zope/security/_proxy.so 0x1701000 - 0x1702fff _zope_security_checker.so /Applications/Plone-2.5.2/lib/python/zope/security/_zope_security_checker.so 0x174a000 - 0x174afff _zope_hookable.so /Applications/Plone-2.5.2/lib/python/zope/hookable/_zope_hookable.so 0x1790000 - 0x1790fff _ComputedAttribute.so /Applications/Plone-2.5.2/lib/python/ComputedAttribute/_ComputedAttribute.so 0x17d6000 - 0x17d9fff _zope_app_container_contained.so /Applications/Plone-2.5.2/lib/python/zope/app/container/_zope_app_container_ contained.so 0x17e8000 - 0x17e8fff _Persistence.so /Applications/Plone-2.5.2/lib/python/Persistence/_Persistence.so 0x17ee000 - 0x17eefff _MethodObject.so /Applications/Plone-2.5.2/lib/python/MethodObject/_MethodObject.so 0x17f4000 - 0x17f5fff select.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/select.so 0x20c8000 - 0x20d3fff _OOBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_OOBTree.so 0x20f0000 - 0x20f0fff stopper.so /Applications/Plone-2.5.2/lib/python/Products/ZCTextIndex/stopper.so 0x20f6000 - 0x20f6fff okascore.so /Applications/Plone-2.5.2/lib/python/Products/ZCTextIndex/okascore.so 0x2245000 - 0x2250fff _OIBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_OIBTree.so 0x226d000 - 0x2278fff _IOBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_IOBTree.so 0x2297000 - 0x22a3fff _IIBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_IIBTree.so 0x2abd000 - 0x2ae7fff _imaging.so /opt/local/lib/python2.4/site-packages/PIL/_imaging.so 0x2b79000 - 0x2b94fff libjpeg.62.dylib /opt/local/lib/libjpeg.62.dylib 0x2be2000 - 0x2be4fff _csv.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_csv.so 0x2bf0000 - 0x2bf0fff _ThreadLock.so /Applications/Plone-2.5.2/lib/python/ThreadLock/_ThreadLock.so 0x2f85000 - 0x2f87fff unicodedata.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/unicodedata.so 0x3285000 - 0x32a8fff libxml2mod.so /opt/local/lib/python2.4/site-packages/libxml2mod.so 0x3337000 - 0x3427fff libxml2.2.dylib /opt/local/lib/libxml2.2.dylib 0x3456000 - 0x354bfff libiconv.2.dylib /opt/local/lib/libiconv.2.dylib 0x3c05000 - 0x3c10fff _fsBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_fsBTree.so 0x52eb000 - 0x52ecfff ZopeSplitter.so /Applications/Plone-2.5.2/lib/python/Products/PluginIndexes/TextIndex/Splitt er/ZopeSplitter/ZopeSplitter.so 0x56c5000 - 0x56d0fff libexslt.0.dylib /opt/local/lib/libexslt.0.dylib 0x5a05000 - 0x5a2efff libxslt.1.dylib /opt/local/lib/libxslt.1.dylib 0x6405000 - 0x6477fff etree.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/si te-packages/lxml-1.3beta-py2.4-macosx-10.4-i386.egg/lxml/etree.so 0x8fe00000 - 0x8fe4afff dyld 46.12 /usr/lib/dyld 0x90000000 - 0x90170fff libSystem.B.dylib /usr/lib/libSystem.B.dylib 0x901c0000 - 0x901c2fff libmathCommon.A.dylib /usr/lib/system/libmathCommon.A.dylib 0x901c4000 - 0x90201fff com.apple.CoreText 1.1.2 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/CoreText.framework/Versions/A/CoreText 0x90228000 - 0x902fefff ATS /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ATS.framework/Versions/A/ATS 0x9031e000 - 0x90773fff com.apple.CoreGraphics 1.258.61 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/CoreGraphics.framework/Versions/A/CoreGraphics 0x9080a000 - 0x908d2fff com.apple.CoreFoundation 6.4.7 (368.28) /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundatio n 0x90910000 - 0x90910fff com.apple.CoreServices 10.4 (???) /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices 0x90912000 - 0x90a05fff libicucore.A.dylib /usr/lib/libicucore.A.dylib 0x90a55000 - 0x90ad4fff libobjc.A.dylib /usr/lib/libobjc.A.dylib 0x90afd000 - 0x90b61fff libstdc++.6.dylib /usr/lib/libstdc++.6.dylib 0x90bd0000 - 0x90bd7fff libgcc_s.1.dylib /usr/lib/libgcc_s.1.dylib 0x90bdc000 - 0x90c4ffff com.apple.framework.IOKit 1.4.6 (???) /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit 0x90c64000 - 0x90c76fff libauto.dylib /usr/lib/libauto.dylib 0x90c7c000 - 0x90f22fff com.apple.CoreServices.CarbonCore 682.21 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Carb onCore.framework/Versions/A/CarbonCore 0x90f65000 - 0x90fcdfff com.apple.CoreServices.OSServices 4.1 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSSe rvices.framework/Versions/A/OSServices 0x91006000 - 0x91044fff com.apple.CFNetwork 129.20 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNe twork.framework/Versions/A/CFNetwork 0x91057000 - 0x91067fff com.apple.WebServices 1.1.3 (1.1.0) /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/WebS ervicesCore.framework/Versions/A/WebServicesCore 0x91072000 - 0x910f1fff com.apple.SearchKit 1.0.5 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Sear chKit.framework/Versions/A/SearchKit 0x9112b000 - 0x91149fff com.apple.Metadata 10.4.4 (121.36) /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Meta data.framework/Versions/A/Metadata 0x91155000 - 0x91163fff libz.1.dylib /usr/lib/libz.1.dylib 0x91166000 - 0x91305fff com.apple.security 4.5.2 (29774) /System/Library/Frameworks/Security.framework/Versions/A/Security 0x91403000 - 0x9140bfff com.apple.DiskArbitration 2.1.1 /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitrat ion 0x91412000 - 0x91419fff libbsm.dylib /usr/lib/libbsm.dylib 0x9141d000 - 0x91443fff com.apple.SystemConfiguration 1.8.6 /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemCo nfiguration 0x91455000 - 0x914cbfff com.apple.audio.CoreAudio 3.0.4 /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio 0x9151c000 - 0x9151cfff com.apple.ApplicationServices 10.4 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Applicat ionServices 0x9151e000 - 0x9154afff com.apple.AE 314 (313) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/AE.framework/Versions/A/AE 0x9155d000 - 0x91631fff com.apple.ColorSync 4.4.9 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ColorSync.framework/Versions/A/ColorSync 0x9166c000 - 0x916dffff com.apple.print.framework.PrintCore 4.6 (177.13) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/PrintCore.framework/Versions/A/PrintCore 0x9170d000 - 0x917b6fff com.apple.QD 3.10.24 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/QD.framework/Versions/A/QD 0x917dc000 - 0x91827fff com.apple.HIServices 1.5.2 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/HIServices.framework/Versions/A/HIServices 0x91846000 - 0x9185cfff com.apple.LangAnalysis 1.6.3 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/LangAnalysis.framework/Versions/A/LangAnalysis 0x91868000 - 0x91883fff com.apple.FindByContent 1.5 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/FindByContent.framework/Versions/A/FindByContent 0x9188e000 - 0x918cbfff com.apple.LaunchServices 182 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/LaunchServices.framework/Versions/A/LaunchServices 0x918df000 - 0x918ebfff com.apple.speech.synthesis.framework 3.5 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/SpeechSynthesis.framework/Versions/A/SpeechSynthesis 0x918f2000 - 0x91931fff com.apple.ImageIO.framework 1.5.4 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/ImageIO 0x91944000 - 0x919f6fff libcrypto.0.9.7.dylib /usr/lib/libcrypto.0.9.7.dylib 0x91a3c000 - 0x91a52fff libcups.2.dylib /usr/lib/libcups.2.dylib 0x91a57000 - 0x91a75fff libJPEG.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libJPEG.dylib 0x91a7a000 - 0x91ad9fff libJP2.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libJP2.dylib 0x91aeb000 - 0x91aeffff libGIF.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libGIF.dylib 0x91af1000 - 0x91b75fff libRaw.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libRaw.dylib 0x91b79000 - 0x91bb6fff libTIFF.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libTIFF.dylib 0x91bbc000 - 0x91bd6fff libPng.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libPng.dylib 0x91bdb000 - 0x91bddfff libRadiance.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libRadiance.dylib 0x91bdf000 - 0x91cbdfff libxml2.2.dylib /usr/lib/libxml2.2.dylib 0x91cda000 - 0x91cdafff com.apple.Accelerate 1.3.1 (Accelerate 1.3.1) /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate 0x91cdc000 - 0x91d6afff com.apple.vImage 2.5 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage .framework/Versions/A/vImage 0x91d71000 - 0x91d71fff com.apple.Accelerate.vecLib 3.3.1 (vecLib 3.3.1) /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/vecLib 0x91d73000 - 0x91dccfff libvMisc.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libvMisc.dylib 0x91dd5000 - 0x91df9fff libvDSP.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libvDSP.dylib 0x91e01000 - 0x9220afff libBLAS.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libBLAS.dylib 0x92244000 - 0x925f8fff libLAPACK.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libLAPACK.dylib 0x92625000 - 0x92712fff libiconv.2.dylib /usr/lib/libiconv.2.dylib 0x92714000 - 0x92791fff com.apple.DesktopServices 1.3.6 /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/D esktopServicesPriv 0x927d2000 - 0x92a02fff com.apple.Foundation 6.4.8 (567.29) /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation 0x92baa000 - 0x92baafff com.apple.Carbon 10.4 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon 0x92bac000 - 0x92bbcfff com.apple.ImageCapture 3.0.4 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/ImageCaptu re.framework/Versions/A/ImageCapture 0x92bcb000 - 0x92bd3fff com.apple.speech.recognition.framework 3.6 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechReco gnition.framework/Versions/A/SpeechRecognition 0x92bd9000 - 0x92bdffff com.apple.securityhi 2.0.1 (24742) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SecurityHI .framework/Versions/A/SecurityHI 0x92be5000 - 0x92c76fff com.apple.ink.framework 101.2.1 (71) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Ink.framew ork/Versions/A/Ink 0x92c8a000 - 0x92c8efff com.apple.help 1.0.3 (32.1) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Help.frame work/Versions/A/Help 0x92c91000 - 0x92caffff com.apple.openscripting 1.2.5 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/OpenScript ing.framework/Versions/A/OpenScripting 0x92cc1000 - 0x92cc7fff com.apple.print.framework.Print 5.2 (192.4) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Print.fram ework/Versions/A/Print 0x92ccd000 - 0x92d30fff com.apple.htmlrendering 66.1 (1.1.3) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HTMLRender ing.framework/Versions/A/HTMLRendering 0x92d57000 - 0x92d98fff com.apple.NavigationServices 3.4.4 (3.4.3) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Navigation Services.framework/Versions/A/NavigationServices 0x92dbf000 - 0x92dcdfff com.apple.audio.SoundManager 3.9.1 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CarbonSoun d.framework/Versions/A/CarbonSound 0x92dd4000 - 0x92dd9fff com.apple.CommonPanels 1.2.3 (73) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CommonPane ls.framework/Versions/A/CommonPanels 0x92dde000 - 0x930d3fff com.apple.HIToolbox 1.4.9 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox. framework/Versions/A/HIToolbox --

5 17

[lxml-dev] html branch
by Ian Bicking 04 Jun '07

04 Jun '07

I've started a branch with lxml.html, in http://codespeak.net/svn/lxml/branch/html It currently includes: lxml.doctestcompare: XML/HTML doctests lxml.usedoctest: enable the doctest from within a doctest lxml.html.usedoctest: enable the doctest, using the HTML parser lxml.html: * lxml.html.HtmlMixin, defining on each element: - remove_element: element removes itself from a tree - remove_tag: element removes itself but not its children from a tree - find_rel_links: find <a rel="?"> - find_class: find <* class="?"> * HTML: parser * parse_elements: parse fragment, return list of elements * parse_element: parse fragment, return single element * Element: apparently a highly broken element factory (segfaults?!) * tostring: HTML serialization lxml.defs: lists of HTML tags (e.g., block_tags) lxml.clean: clean Javascript and other problem code from HTML lxml.rewritelinks: change the links in a document lxml.htmldiff: make human-readable diffs and blame reports The usedoctest modules are based on a really horrible hack. It seems to work, except for some reason lxml/html/tests/test_clean.txt is sometimes run without the doctest change. The other doctests aren't run like this, and when you explicitly run the test (e.g., python test.py test_clean) it runs fine. So something weird with the test runner, I guess. -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

2 9

[lxml-dev] unittest.main()
by Ian Bicking 30 May '07

30 May '07

I noticed many tests have: if __name__ == '__main__': unittest.main() But this seems to ignore test_suite(), so it's not really very useful. This seems more helpful: if __name__ == '__main__': print 'to test use test.py %s' % __file__ -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

4 3

[lxml-dev] matches()
by Ian Bicking 29 May '07

29 May '07

Using lxml trunk: doc.xpath('descendant-or-self::*[starts-with(lower-case(@href), "javascript:")]') works, but: doc.xpath('descendant-or-self::*[matches(@href, "^javascript:", "i")]') Returns ["i"]. This does not seem right...? -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

2 4

[lxml-dev] lxml 1.3 - or 2.0?
by Stefan Behnel 29 May '07

29 May '07

Hi all, I'm currently thinking about what should be changed or fixed for lxml 2.0, a preliminary list is at the end of TODO.txt. As fixing the entity handling would visibly change the way parsers behave (more exceptions, stricter parsing, etc.), maybe this would rather go into that list. This is what I have for now: * reformat error log lines, add column number * always use '<string>' as URL when tree was parsed from string? (can libxml2 handle this?) * clean up (and remove?) duplicated API for extension functions * find a way to integrate Schematron (if it's available) * always use ns-prefixed type names in objectify's ``xsi:type`` attributes * remove ``findOrBuildNodeNs()`` from C-API (replaced by findOrBuildNodeNsPrefix) * lxml.html (Ian?) * clean support for entities (maybe an Entity element class?) * follow PEP 8 in API naming (avoidCamelCase in_favour_of_underscores) The list of trunk changes since 1.2.1 is already pretty long, and there were some major changes under the hood (even since 1.3beta), e.g. the namespace cleanup code, XSD type prefixing in objectify, exception messages, etc. Hence, I'm actually considering to skip the 1.3 release and to rather start working on 2.0 directly, so that we could have an alpha version soon. Maybe some more bug fixes could be backported into a 1.2.2 first, so that people can work with it, but a 1.3 would mean "new features". I would like to have the freedom to break a few things here in order to make their API cleaner. And that means 2.0, not 1.3. Comments? Stefan

4 4

[lxml-dev] Entity handling in lxml
by Stefan Behnel 27 May '07

27 May '07

Hi all, lets make this a new thread to discuss the topic that was raised by Eric Garin. The parsers in lxml are currently configured to replace entity references (&entity;) by their definition. This requires a DTD, either inside the document, as external URL reference or from the system catalog. The parsers do not currently load DTDs by default, neither do they do validation. So, the current situation is: 1) If you use the default parser, all entities will pass through without exception, but put an error message in the error_log: entity.xml:5:ERROR:PARSER:WAR_UNDECLARED_ENTITY: Entity 'oneXXX' not defined They will not be visible at the API level, they will cut off text that contains them ("my &entity; value" will result in a text property value "my "), but they will be serialised correctly. They may also break a lot of things internally, as the implementation is not prepared for dealing with stuff like entity reference nodes. 2) If you configure a parser to load the DTD, declared entities will be replaced and undeclared entities will behave as above. 3) If you configure a parser to validate against a DTD, it will still behave exactly as above. This behaviour is definitely a bug. It would be cleaner to do this: 1) The default parser should replace internally defined entities and report all other entities as an error. 2) A parser that loads the DTD should report undeclared entities as an error (although it would not do any validation). 3) A validating parser should report undeclared entities as an error, just as any other structural or semantic deviation from the DTD. The alternative would be to provide an API for entities and to rewrite the internals to deal with them somehow. We could potentially make entity references a sort of element that behaves more or less like a comment. Entities would mainly have a name and a tail. We would then need an Entity() factory and integrate entity reference nodes into the internal traversal code (basically: let _isElement(c_entity_node) return 1). When would they appear in the tree? We would additionally need a "resolve_entities" keyword argument for the parsers, that would be the easiest way to deal with this. If it is set, unresolvable entities will result in an error as described above. Otherwise, entity references will not be replaced. Any comments? Stefan

1 0

Re: [lxml-dev] lxml lets undeclared entities pass through silently (was: Xhtml and entities)
by Stefan Behnel 27 May '07

27 May '07

Hi Eric, please reply also to the mailing list (reply all), not just to me. That way, you may also get comments by other people and the mails will be archived and others can search and read them. Eric Garin wrote: > Sorry Stefan but I've actually read this documentation (and even several times) Sorry if I sounded somewhat harsh, I do believe you. > So I did a test with something really simple : [parse XML containing an undeclared entity] > Result : parser says nothing even if &oneXXX; is not declared Not quite, it does say something, it just doesn't raise an exception. >>> from lxml import etree >>> parser = etree.XMLParser() >>> xml = etree.parse("entity.xml", parser) Ok, no exception here, so what happened? >>> print parser.error_log entity.xml:5:ERROR:PARSER:WAR_UNDECLARED_ENTITY: Entity 'oneXXX' not defined So, libxml2 did find the missing entity and reported the error to lxml. I looked into it and it seems that the parser continued parsing and returned a document containing the entity reference, saying that it was well formed. Therefore, lxml did not raise an exception. When you serialise the document after parsing, you will see that the entity reference is still in there,so this actually works. However, when you print the ".text" of the element containing the entity reference, it is not printed, so you can see that it is not passed on to the API level. Given the normal lxml behaviour of resolving entities and not supporting them at the API level at all, I would call this a bug. However, it is not obvious how to deal with this. I mean, entity references currently pass in and out rather nicely, they are just not visible. So raising an error here would likely break some existing code that does not explicitly load DTDs to resolve them but relies on lxml's current behaviour of passing them through. On the other hand, there is no easy way to support them at the API level, as they can occur anywhere in text content. I mean, how should lxml distinguish between a user passing in the entity "&entity;" and someone who just passes in the text "In XML, entities are written as &entity;", expecting that it gets properly escaped like any other text in lxml.etree? So it is better to raise an error here than to have users deal with entities. Any opinions on this? Stefan

2 2