Mailman 3 June 2007 - lxml - The Python XML Toolkit

[lxml-dev] list-like views?
by Ian Bicking June 18, 2007

June 18, 2007

In the atom wrapper I made, I expose a categories attribute on entries. This returns a list (-like object) of the <category> elements. It also lets you add and remove from that list to modify the entry. I generally don't do this, as it feels a little too clever to me. The list-like object isinstance(obj, list), but it's a subclass, and has a different repr. But I still worry about confusion. Anyway, I was thinking of adding something similar to HtmlElement for .classes, which would expose the HTML classes. This way you wouldn't have to have methods like has_class, add_class, and remove_class (or do it manually with string manipulation). How does this sound? The class I used is _LiveList, here: https://svn.openplans.org/svn/TaggerStore/trunk/taggerstore/atom.py -- basically it just calls some callbacks everytime something is added or removed from the list. Ian

2 3

[lxml-dev] Annoying interaction between comments and text
by Itamar Shtull-Trauring June 15, 2007

June 15, 2007

Lets say I have an element with some text in it. No subelements, just text. It may have a comment in it, but I really don't want to have to think about it. In elementtree I can just do: >>> elementtree.ElementTree.fromstring("<x>hello  world</x>").text 'hello world' But, in lxml if I do that I get: >>> lxml.etree.fromstring("<x>hello  world</x>").text 'hello ' One needs to use xpath to extract all the text. This is problematic because it means you can basically *never use the text attribute of elements*, since someone may have added a comment. Since comments have no semantic meaning this is something of a problem. I bet there's lots and lots of lxml code that would break if someone added a comment inside an element's text.

2 2

[lxml-dev] atom model
by Ian Bicking June 15, 2007

June 15, 2007

After writing a object model for Atom that serialized to and parsed from XML, I realized Atom and its XML representation really shouldn't be separated, so I created some custom elements to make it a bit easier to handle, while still using the XML as the sole source of information. I'm a little unsure what to do about the namespaces. Everything is in a namespace, but it's tedious to put in everywhere. I've put in some little helper methods internally, and mostly you don't need to use the namespace globally, but I'm unsure about it all. I've created an Element() function that automatically adds the namespace if no namespace is given; helps a little I guess. The standard ways of creating elements is a bit tedious, really. I guess builder can help there a bit, though I don't see a way to give my own parser (which I need in this case). Any suggestions about any of it are welcome. The module is at: https://svn.openplans.org/svn/TaggerStore/trunk/taggerstore/atom.py I didn't really look around in the lxml source, but I used several descriptors that could be general purpose. Maybe there's a better way to do these, or maybe they could go in lxml somewhere. -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

3 5

[lxml-dev] python test.py --coverage and doctests
by Ian Bicking June 14, 2007

June 14, 2007

The coverage analyzer in test.py doesn't seem to notice stuff that happens in doctests. Is there any way around this? Ian

1 0

[lxml-dev] Renaming the drop_*() methods
by Stefan Behnel June 14, 2007

June 14, 2007

Hi Ian, Ian Bicking wrote: > Stefan Behnel wrote: >> as I was reviewing your code, I decided to rename drop_tag() and >> drop_element() to drop_element() and drop_tree() respectively. > > I don't mind drop_tree, but I think drop_element is confusing. For > instance, we both have different ideas about what it seems to imply -- > to me if feels like it should drop the element and its children. What > makes it different than .remove() I guess is that it doesn't remove the > tail Which is a good reason why drop_element() is not a good name, you are right. In ET, an Element is something with a tag, a text, children and a tail, and only the tag is removed here. So let's make it drop_tree() and drop_tag() then. > Incidentally, someone asked for a drop_tree method in another context, > and maybe it makes sense in more than just HTML. It's a tricky method > to get right, in that you can do it lazily and get it wrong (e.g., > assume the element doesn't have a tail, or assume it does and it's not > None, or that the element really has a previous sibling, or doesn't). Right. But what about helper *functions* then instead? They could work on any element, not just on those that define them as methods. Stefan PS: I'm setting the list back on CC to open this discussion for other comments.

2 4

[lxml-dev] is tostring() confusing?
by Ian Bicking June 13, 2007

June 13, 2007

Having tostring() as a function and not a method seems a bit odd to me. I know it's from ElementTree, but at least for HTML it's awkward -- using lxml.etree.tostring on HTML is almost certain to create bad output; the output won't be real XHTML (lacking namespaces and it'll probably be invalid), and it will parse quite badly as HTML (<script src="..."/> for instance will typically break the entire page in a browser). When I was first using ElementTree, I remember being a bit baffled by the lack of a serializing method. I then found tostring and kind of forgot about it, but as I copy tostring methods around (e.g., lxml.html.tostring) it's starting to seem like a problem again. -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

3 4

[lxml-dev] helping debug osx segfaults
by whit June 13, 2007

June 13, 2007

been beating my head against getting lxml setup on osx. is there any sort of debug information I could give yall that would help or does anyone have any hot tips for getting things running? currently, I'm running trunk and having intermittent segfaults using etree. lxml is linked against most current fink libxml2 and libxslt2 (I think) I can dig out more info if it would help. -w -- ------ d. whit morriss ------ - senior engineer, opencore - - http://www.openplans.org - - m: 415-710-8975 - "If you don't know where you are, you don't know anything at all" Dr. Edgar Spencer, Ph.D., 1995

3 3

[lxml-dev] Url corruption during XSLT transformation
by Alexander Kozlovsky June 12, 2007

June 12, 2007

Hello again! I discovered a bug which is happening during XSLT transformation Consider this simple XSLT template: >>> from lxml import etree >>> xslt = etree.XSLT(etree.XML(''' ... <xsl:stylesheet version = '1.0' xmlns:xsl='http://www.w3.org/1999/XSL/Transform'> ... <xsl:output method="html" /> ... <xsl:template match="/"> ... <xsl:copy-of select="." /> ... </xsl:template> ... </xsl:stylesheet> ... ''')) The purpose of this template is just copying all document content as HTML instead of XML. But strange thing happened with urls: /test?a=1&b=2?c=3 becomes /test?a=1 What happens is all url content after the first '&' disappears >>> xml = etree.XML('<html><body><a href="/test?x=10&y=20&z=30">sample link</a></body></html>') >>> html = str(xslt(xml)) >>> print html <html><body><a href="/test?x=10">sample link</a></body></html> Probably it is not lxml, but libxslt2 bug, but I don't know, where to submit patch I dealt with this problem by replacing all the 'copy-of' elements with identity transformation, but probably it is less effective >>> xslt2 = etree.XSLT(etree.XML(''' ... <xsl:stylesheet version = '1.0' xmlns:xsl='http://www.w3.org/1999/XSL/Transform'> ... <xsl:output method="html" /> ... <xsl:template match="/ | @* | node()"> ... <xsl:copy> ... <xsl:apply-templates select="@* | node()" /> ... </xsl:copy> ... </xsl:template> ... </xsl:stylesheet> ... ''')) >>> html2 = str(xslt2(xml)) >>> print html2 <html><body><a href="/test?x=10&y=20&z=30">sample link</a></body></html> If it is libxslt2 bug, can you please submit bug instead of me :) ? I don't know anything about libxslt2... -- Best regards, Alexander mailto:alexander.kozlovsky@gmail.com

3 11

[lxml-dev] Is it bug?
by Alexander Kozlovsky June 12, 2007

June 12, 2007

Hello! I discover some counterintuitive behavior of 'tail' attribute: >>> from lxml import etree >>> a = etree.XML('<a><b>text</b>tail</a>') >>> b = a[0] >>> print b.tail tail >>> a[:] = [] >>> print b.tail None # EXPECTED: tail I think, it is bug or at least worth note in documentation Thank you for the great library, anyway! :) -- Best regards, Alexander mailto:alexander.kozlovsky@gmail.com

2 3

[lxml-dev] lxml.etree.parse doesn't take parser argument into account?
by Christian Zagrodnick June 11, 2007

June 11, 2007

Hi, maybe I'm doning something very wrong here. Regarding the following: In [1]:import StringIO In [2]:import lxml.etree In [3]:import lxml.objectify In [4]:parser = lxml.etree.XMLParser() In [5]:parser.setElementClassLookup(lxml.objectify.ObjectifyElementClassLookup()) In [6]:lxml.etree.parse(StringIO.StringIO("<a/>"), parser) Out[6]:<etree._ElementTree object at 0x1450e40> I would have expected to get an objectified element out of the parse call. What am I missing here? Or is this a bug? This is lxml-1.3beta-py2.4-macosx-10.4-i386. -- Christian Zagrodnick gocept gmbh & co. kg · forsterstrasse 29 · 06112 halle/saale www.gocept.com · fon. +49 345 12298894 · fax. +49 345 12298891

2 2

[lxml-dev] Development of Extentions
by Martin Owens June 9, 2007

June 9, 2007

Hello all, For inkscape we are looking to create a pysvg python module based on lxml; I would like very much to base the extentions on the perl based SVG::DOM2 modules which have not only XML controls but SVG methods too. I've been looking at the documentation trying to figure it all out how this can be done. So far what I think needs to happen is: we create a class that inherrits from lxml.ElementTree that will grab the right element class depending on the element name and namespace. then we make a whole bunch of classes that inherrit from the lxml.Element class which will become the controls into the lxml backend. does this ream sane? Best Regards, Martin Owens

2 2

[lxml-dev] lxml.doctestcompare
by Ian Bicking June 7, 2007

June 7, 2007

I figured out why the tests fail when run in series, when using lxml.(html.)usedoctest -- since it works on import, the import is only run once. After that the module isn't really imported again, so the code that executes on import isn't run. I don't know if there's any feasible way around this. Well, I could unload the module when the doctest is through, just like I unload my OutputChecker hack. That might be okay. Bah. -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

2 3

[lxml-dev] python crashes in xmlDictFree inside Zope
by Eric Tiffany June 5, 2007

June 5, 2007

I have been prototyping some XMLSchema parsing/validating using lxml 1.3beta. Everthing works great from python 2.4.4 started from the command line, or running from inside Eclipse. However, when I moved my code over to my Plone product, python crashes when Zope is initializing the product. I am creating my XMLSchema object there. THe code is essentially the same, running under the same python and with the same libs (afaik). Some earlier attempts (with python 2.4.3) gave me this error: python(11139) malloc: *** Deallocation of a pointer not malloced: 0x80; This could be a double free(), or free() called with the middle of an allocated block; Try setting environment variable MallocHelp to see tools to help debug I'm not seeing that now, as I have "upgraded" to python 2.4.4 which seems to be stripped or something. I don't have a test case immediately available, but here is the stack backtrace from the python crash log: OS Version: 10.4.9 (Build 8P2137) Report Version: 4 Command: Python Path: /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Resources/Python .app/Contents/MacOS/Python Parent: bash [11055] Version: 2.4a0 (2.4alpha1) PID: 11135 Thread: 0 Exception: EXC_BAD_ACCESS (0x0001) Codes: KERN_PROTECTION_FAILURE (0x0002) at 0x00000001 Thread 0 Crashed: 0 libxml2.2.dylib 0x033f6294 xmlDictFree + 45 1 libxml2.2.dylib 0x033f62e2 xmlDictFree + 123 2 libxml2.2.dylib 0x033f62e2 xmlDictFree + 123 3 etree.so 0x06406a08 __pyx_f_5etree_14_ParserContext_initThreadDictRef + 63 (etree.c:19725) 4 etree.so 0x06406a5b __pyx_f_5etree_14_ParserContext_initParserDict + 35 (etree.c:19740) 5 etree.so 0x06431bca __pyx_f_5etree_11_BaseParser__parseDocFromFile + 99 (etree.c:21340) 6 etree.so 0x0646a8f4 __pyx_f_5etree__parseDocument + 395 (etree.c:22486) 7 etree.so 0x0646cc50 __pyx_f_5etree_parse + 176 (etree.c:10300) 8 org.python.python 0x0027faca PyEval_EvalFrame + 22777 (ceval.c:3568) 9 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 10 org.python.python 0x0027e49f PyEval_EvalFrame + 17102 (ceval.c:3661) 11 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 12 org.python.python 0x0027e49f PyEval_EvalFrame + 17102 (ceval.c:3661) 13 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 14 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 15 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 16 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 17 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 18 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 19 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 20 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 21 org.python.python 0x0027ebaa PyEval_EvalFrame + 18905 (ceval.c:3651) 22 org.python.python 0x00280665 PyEval_EvalCodeEx + 1774 (ceval.c:2741) 23 org.python.python 0x002808a5 PyEval_EvalCode + 87 (ceval.c:490) 24 org.python.python 0x002a75fd PyRun_FileExFlags + 200 (pythonrun.c:1285) 25 org.python.python 0x002a78e0 PyRun_SimpleFileExFlags + 640 (pythonrun.c:869) 26 org.python.python 0x002b13ec Py_Main + 3199 (main.c:493) 27 org.python.python 0x00001fae 0x1000 + 4014 28 org.python.python 0x00001ed5 0x1000 + 3797 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x033f6275 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000001 esi: 0x05856fd0 ebp: 0xbfffcfe8 esp: 0xbfffcfb0 ss: 0x0000001f efl: 0x00010286 eip: 0x033f6294 cs: 0x00000017 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x2fff org.python.python 2.4a0 (2.4alpha1) /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Resources/Python .app/Contents/MacOS/Python 0xa0000 - 0xa1fff icglue.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/icglue.so 0xb8000 - 0xb9fff time.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/time.so 0xc3000 - 0xc6fff strop.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/strop.so 0x205000 - 0x2d9fff org.python.python 2.4a0 (2.2) /opt/local/Library/Frameworks/Python.framework/Versions/2.4/Python 0x575000 - 0x576fff cStringIO.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/cStringIO.so 0x580000 - 0x581fff collections.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/collections.so 0x5cc000 - 0x5d2fff _socket.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_socket.so 0x5e7000 - 0x5e8fff _ssl.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_ssl.so 0x705000 - 0x737fff libssl.0.9.8.dylib /opt/local/lib/libssl.0.9.8.dylib 0x74b000 - 0x75cfff libz.1.dylib /opt/local/lib/libz.1.dylib 0x761000 - 0x763fff struct.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/struct.so 0x76f000 - 0x771fff binascii.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/binascii.so 0x7bc000 - 0x7bdfff math.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/math.so 0x7c5000 - 0x7c6fff _random.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_random.so 0x7cd000 - 0x7cefff fcntl.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/fcntl.so 0x7d6000 - 0x7d7fff md5.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/md5.so 0x7de000 - 0x7dffff sha.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/sha.so 0x7e6000 - 0x7e6fff _bisect.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_bisect.so 0x1008000 - 0x10f7fff libcrypto.0.9.8.dylib /opt/local/lib/libcrypto.0.9.8.dylib 0x11a0000 - 0x11abfff datetime.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/datetime.so 0x120e000 - 0x1211fff array.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/array.so 0x1222000 - 0x1222fff grp.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/grp.so 0x126e000 - 0x127bfff cPickle.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/cPickle.so 0x129a000 - 0x129dfff _Res.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_Res.so 0x12ac000 - 0x12b2fff _File.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_File.so 0x12cb000 - 0x12ccfff MacOS.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/MacOS.so 0x1348000 - 0x1374fff pyexpat.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/pyexpat.so 0x1427000 - 0x1427fff _weakref.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_weakref.so 0x142d000 - 0x142dfff _initgroups.so /Applications/Plone-2.5.2/lib/python/initgroups/_initgroups.so 0x1433000 - 0x1433fff crypt.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/crypt.so 0x1439000 - 0x143afff _heapq.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_heapq.so 0x1442000 - 0x1442fff _Missing.so /Applications/Plone-2.5.2/lib/python/Missing/_Missing.so 0x144e000 - 0x1450fff cPersistence.so /Applications/Plone-2.5.2/lib/python/persistent/cPersistence.so 0x145b000 - 0x145cfff TimeStamp.so /Applications/Plone-2.5.2/lib/python/persistent/TimeStamp.so 0x1463000 - 0x1464fff cPickleCache.so /Applications/Plone-2.5.2/lib/python/persistent/cPickleCache.so 0x146e000 - 0x146ffff _zope_interface_coptimizations.so /Applications/Plone-2.5.2/lib/python/zope/interface/_zope_interface_coptimiz ations.so 0x1477000 - 0x1477fff _MultiMapping.so /Applications/Plone-2.5.2/lib/python/MultiMapping/_MultiMapping.so 0x14fe000 - 0x1502fff cAccessControl.so /Applications/Plone-2.5.2/lib/python/AccessControl/cAccessControl.so 0x1510000 - 0x1512fff _ExtensionClass.so /Applications/Plone-2.5.2/lib/python/ExtensionClass/_ExtensionClass.so 0x151c000 - 0x1520fff _Acquisition.so /Applications/Plone-2.5.2/lib/python/Acquisition/_Acquisition.so 0x152e000 - 0x152ffff _Record.so /Applications/Plone-2.5.2/lib/python/Record/_Record.so 0x1537000 - 0x1539fff cDocumentTemplate.so /Applications/Plone-2.5.2/lib/python/DocumentTemplate/cDocumentTemplate.so 0x1585000 - 0x1591fff parser.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/parser.so 0x15e8000 - 0x15eafff zlib.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/zlib.so 0x1633000 - 0x1635fff operator.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/operator.so 0x167f000 - 0x1681fff _zope_proxy_proxy.so /Applications/Plone-2.5.2/lib/python/zope/proxy/_zope_proxy_proxy.so 0x168f000 - 0x1691fff itertools.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/itertools.so 0x16a0000 - 0x16a0fff _zope_i18nmessageid_message.so /Applications/Plone-2.5.2/lib/python/zope/i18nmessageid/_zope_i18nmessageid_ message.so 0x16e7000 - 0x16e7fff _zope_thread.so /Applications/Plone-2.5.2/lib/python/zope/thread/_zope_thread.so 0x16ee000 - 0x16f1fff _proxy.so /Applications/Plone-2.5.2/lib/python/zope/security/_proxy.so 0x1701000 - 0x1702fff _zope_security_checker.so /Applications/Plone-2.5.2/lib/python/zope/security/_zope_security_checker.so 0x174a000 - 0x174afff _zope_hookable.so /Applications/Plone-2.5.2/lib/python/zope/hookable/_zope_hookable.so 0x1790000 - 0x1790fff _ComputedAttribute.so /Applications/Plone-2.5.2/lib/python/ComputedAttribute/_ComputedAttribute.so 0x17d6000 - 0x17d9fff _zope_app_container_contained.so /Applications/Plone-2.5.2/lib/python/zope/app/container/_zope_app_container_ contained.so 0x17e8000 - 0x17e8fff _Persistence.so /Applications/Plone-2.5.2/lib/python/Persistence/_Persistence.so 0x17ee000 - 0x17eefff _MethodObject.so /Applications/Plone-2.5.2/lib/python/MethodObject/_MethodObject.so 0x17f4000 - 0x17f5fff select.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/select.so 0x20c8000 - 0x20d3fff _OOBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_OOBTree.so 0x20f0000 - 0x20f0fff stopper.so /Applications/Plone-2.5.2/lib/python/Products/ZCTextIndex/stopper.so 0x20f6000 - 0x20f6fff okascore.so /Applications/Plone-2.5.2/lib/python/Products/ZCTextIndex/okascore.so 0x2245000 - 0x2250fff _OIBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_OIBTree.so 0x226d000 - 0x2278fff _IOBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_IOBTree.so 0x2297000 - 0x22a3fff _IIBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_IIBTree.so 0x2abd000 - 0x2ae7fff _imaging.so /opt/local/lib/python2.4/site-packages/PIL/_imaging.so 0x2b79000 - 0x2b94fff libjpeg.62.dylib /opt/local/lib/libjpeg.62.dylib 0x2be2000 - 0x2be4fff _csv.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/_csv.so 0x2bf0000 - 0x2bf0fff _ThreadLock.so /Applications/Plone-2.5.2/lib/python/ThreadLock/_ThreadLock.so 0x2f85000 - 0x2f87fff unicodedata.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/li b-dynload/unicodedata.so 0x3285000 - 0x32a8fff libxml2mod.so /opt/local/lib/python2.4/site-packages/libxml2mod.so 0x3337000 - 0x3427fff libxml2.2.dylib /opt/local/lib/libxml2.2.dylib 0x3456000 - 0x354bfff libiconv.2.dylib /opt/local/lib/libiconv.2.dylib 0x3c05000 - 0x3c10fff _fsBTree.so /Applications/Plone-2.5.2/lib/python/BTrees/_fsBTree.so 0x52eb000 - 0x52ecfff ZopeSplitter.so /Applications/Plone-2.5.2/lib/python/Products/PluginIndexes/TextIndex/Splitt er/ZopeSplitter/ZopeSplitter.so 0x56c5000 - 0x56d0fff libexslt.0.dylib /opt/local/lib/libexslt.0.dylib 0x5a05000 - 0x5a2efff libxslt.1.dylib /opt/local/lib/libxslt.1.dylib 0x6405000 - 0x6477fff etree.so /opt/local/Library/Frameworks/Python.framework/Versions/2.4/lib/python2.4/si te-packages/lxml-1.3beta-py2.4-macosx-10.4-i386.egg/lxml/etree.so 0x8fe00000 - 0x8fe4afff dyld 46.12 /usr/lib/dyld 0x90000000 - 0x90170fff libSystem.B.dylib /usr/lib/libSystem.B.dylib 0x901c0000 - 0x901c2fff libmathCommon.A.dylib /usr/lib/system/libmathCommon.A.dylib 0x901c4000 - 0x90201fff com.apple.CoreText 1.1.2 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/CoreText.framework/Versions/A/CoreText 0x90228000 - 0x902fefff ATS /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ATS.framework/Versions/A/ATS 0x9031e000 - 0x90773fff com.apple.CoreGraphics 1.258.61 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/CoreGraphics.framework/Versions/A/CoreGraphics 0x9080a000 - 0x908d2fff com.apple.CoreFoundation 6.4.7 (368.28) /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundatio n 0x90910000 - 0x90910fff com.apple.CoreServices 10.4 (???) /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices 0x90912000 - 0x90a05fff libicucore.A.dylib /usr/lib/libicucore.A.dylib 0x90a55000 - 0x90ad4fff libobjc.A.dylib /usr/lib/libobjc.A.dylib 0x90afd000 - 0x90b61fff libstdc++.6.dylib /usr/lib/libstdc++.6.dylib 0x90bd0000 - 0x90bd7fff libgcc_s.1.dylib /usr/lib/libgcc_s.1.dylib 0x90bdc000 - 0x90c4ffff com.apple.framework.IOKit 1.4.6 (???) /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit 0x90c64000 - 0x90c76fff libauto.dylib /usr/lib/libauto.dylib 0x90c7c000 - 0x90f22fff com.apple.CoreServices.CarbonCore 682.21 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Carb onCore.framework/Versions/A/CarbonCore 0x90f65000 - 0x90fcdfff com.apple.CoreServices.OSServices 4.1 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSSe rvices.framework/Versions/A/OSServices 0x91006000 - 0x91044fff com.apple.CFNetwork 129.20 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNe twork.framework/Versions/A/CFNetwork 0x91057000 - 0x91067fff com.apple.WebServices 1.1.3 (1.1.0) /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/WebS ervicesCore.framework/Versions/A/WebServicesCore 0x91072000 - 0x910f1fff com.apple.SearchKit 1.0.5 /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Sear chKit.framework/Versions/A/SearchKit 0x9112b000 - 0x91149fff com.apple.Metadata 10.4.4 (121.36) /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Meta data.framework/Versions/A/Metadata 0x91155000 - 0x91163fff libz.1.dylib /usr/lib/libz.1.dylib 0x91166000 - 0x91305fff com.apple.security 4.5.2 (29774) /System/Library/Frameworks/Security.framework/Versions/A/Security 0x91403000 - 0x9140bfff com.apple.DiskArbitration 2.1.1 /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitrat ion 0x91412000 - 0x91419fff libbsm.dylib /usr/lib/libbsm.dylib 0x9141d000 - 0x91443fff com.apple.SystemConfiguration 1.8.6 /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemCo nfiguration 0x91455000 - 0x914cbfff com.apple.audio.CoreAudio 3.0.4 /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio 0x9151c000 - 0x9151cfff com.apple.ApplicationServices 10.4 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Applicat ionServices 0x9151e000 - 0x9154afff com.apple.AE 314 (313) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/AE.framework/Versions/A/AE 0x9155d000 - 0x91631fff com.apple.ColorSync 4.4.9 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ColorSync.framework/Versions/A/ColorSync 0x9166c000 - 0x916dffff com.apple.print.framework.PrintCore 4.6 (177.13) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/PrintCore.framework/Versions/A/PrintCore 0x9170d000 - 0x917b6fff com.apple.QD 3.10.24 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/QD.framework/Versions/A/QD 0x917dc000 - 0x91827fff com.apple.HIServices 1.5.2 (???) /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/HIServices.framework/Versions/A/HIServices 0x91846000 - 0x9185cfff com.apple.LangAnalysis 1.6.3 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/LangAnalysis.framework/Versions/A/LangAnalysis 0x91868000 - 0x91883fff com.apple.FindByContent 1.5 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/FindByContent.framework/Versions/A/FindByContent 0x9188e000 - 0x918cbfff com.apple.LaunchServices 182 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/LaunchServices.framework/Versions/A/LaunchServices 0x918df000 - 0x918ebfff com.apple.speech.synthesis.framework 3.5 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/SpeechSynthesis.framework/Versions/A/SpeechSynthesis 0x918f2000 - 0x91931fff com.apple.ImageIO.framework 1.5.4 /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/ImageIO 0x91944000 - 0x919f6fff libcrypto.0.9.7.dylib /usr/lib/libcrypto.0.9.7.dylib 0x91a3c000 - 0x91a52fff libcups.2.dylib /usr/lib/libcups.2.dylib 0x91a57000 - 0x91a75fff libJPEG.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libJPEG.dylib 0x91a7a000 - 0x91ad9fff libJP2.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libJP2.dylib 0x91aeb000 - 0x91aeffff libGIF.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libGIF.dylib 0x91af1000 - 0x91b75fff libRaw.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libRaw.dylib 0x91b79000 - 0x91bb6fff libTIFF.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libTIFF.dylib 0x91bbc000 - 0x91bd6fff libPng.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libPng.dylib 0x91bdb000 - 0x91bddfff libRadiance.dylib /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Framewor ks/ImageIO.framework/Versions/A/Resources/libRadiance.dylib 0x91bdf000 - 0x91cbdfff libxml2.2.dylib /usr/lib/libxml2.2.dylib 0x91cda000 - 0x91cdafff com.apple.Accelerate 1.3.1 (Accelerate 1.3.1) /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate 0x91cdc000 - 0x91d6afff com.apple.vImage 2.5 /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage .framework/Versions/A/vImage 0x91d71000 - 0x91d71fff com.apple.Accelerate.vecLib 3.3.1 (vecLib 3.3.1) /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/vecLib 0x91d73000 - 0x91dccfff libvMisc.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libvMisc.dylib 0x91dd5000 - 0x91df9fff libvDSP.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libvDSP.dylib 0x91e01000 - 0x9220afff libBLAS.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libBLAS.dylib 0x92244000 - 0x925f8fff libLAPACK.dylib /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib .framework/Versions/A/libLAPACK.dylib 0x92625000 - 0x92712fff libiconv.2.dylib /usr/lib/libiconv.2.dylib 0x92714000 - 0x92791fff com.apple.DesktopServices 1.3.6 /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/D esktopServicesPriv 0x927d2000 - 0x92a02fff com.apple.Foundation 6.4.8 (567.29) /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation 0x92baa000 - 0x92baafff com.apple.Carbon 10.4 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon 0x92bac000 - 0x92bbcfff com.apple.ImageCapture 3.0.4 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/ImageCaptu re.framework/Versions/A/ImageCapture 0x92bcb000 - 0x92bd3fff com.apple.speech.recognition.framework 3.6 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechReco gnition.framework/Versions/A/SpeechRecognition 0x92bd9000 - 0x92bdffff com.apple.securityhi 2.0.1 (24742) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SecurityHI .framework/Versions/A/SecurityHI 0x92be5000 - 0x92c76fff com.apple.ink.framework 101.2.1 (71) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Ink.framew ork/Versions/A/Ink 0x92c8a000 - 0x92c8efff com.apple.help 1.0.3 (32.1) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Help.frame work/Versions/A/Help 0x92c91000 - 0x92caffff com.apple.openscripting 1.2.5 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/OpenScript ing.framework/Versions/A/OpenScripting 0x92cc1000 - 0x92cc7fff com.apple.print.framework.Print 5.2 (192.4) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Print.fram ework/Versions/A/Print 0x92ccd000 - 0x92d30fff com.apple.htmlrendering 66.1 (1.1.3) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HTMLRender ing.framework/Versions/A/HTMLRendering 0x92d57000 - 0x92d98fff com.apple.NavigationServices 3.4.4 (3.4.3) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Navigation Services.framework/Versions/A/NavigationServices 0x92dbf000 - 0x92dcdfff com.apple.audio.SoundManager 3.9.1 /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CarbonSoun d.framework/Versions/A/CarbonSound 0x92dd4000 - 0x92dd9fff com.apple.CommonPanels 1.2.3 (73) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CommonPane ls.framework/Versions/A/CommonPanels 0x92dde000 - 0x930d3fff com.apple.HIToolbox 1.4.9 (???) /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox. framework/Versions/A/HIToolbox --

5 17

[lxml-dev] html branch
by Ian Bicking June 4, 2007

June 4, 2007

I've started a branch with lxml.html, in http://codespeak.net/svn/lxml/branch/html It currently includes: lxml.doctestcompare: XML/HTML doctests lxml.usedoctest: enable the doctest from within a doctest lxml.html.usedoctest: enable the doctest, using the HTML parser lxml.html: * lxml.html.HtmlMixin, defining on each element: - remove_element: element removes itself from a tree - remove_tag: element removes itself but not its children from a tree - find_rel_links: find <a rel="?"> - find_class: find <* class="?"> * HTML: parser * parse_elements: parse fragment, return list of elements * parse_element: parse fragment, return single element * Element: apparently a highly broken element factory (segfaults?!) * tostring: HTML serialization lxml.defs: lists of HTML tags (e.g., block_tags) lxml.clean: clean Javascript and other problem code from HTML lxml.rewritelinks: change the links in a document lxml.htmldiff: make human-readable diffs and blame reports The usedoctest modules are based on a really horrible hack. It seems to work, except for some reason lxml/html/tests/test_clean.txt is sometimes run without the doctest change. The other doctests aren't run like this, and when you explicitly run the test (e.g., python test.py test_clean) it runs fine. So something weird with the test runner, I guess. -- Ian Bicking | ianb(a)colorstudy.com | http://blog.ianbicking.org | Write code, do good | http://topp.openplans.org/careers

2 9

[lxml-dev] Network downloading of schemas should be off by default?
by Itamar Shtull-Trauring June 3, 2007

June 3, 2007

Right now, AFAICT, is is on by default in lxml.etree.XMLParser. Network queries by library code are a bad idea: it's an unexpected behavior, causing potential security risk and guaranteed performance problems. -- Itamar Shtull-Trauring http://itamarst.org

3 2

[lxml-dev] XMLSchema validation with XMLSchema.xsd failing
by David Pratt June 3, 2007

June 3, 2007

Can someone advise whether XMLSchema is currently able validate xml schemas. I am on mac 10.4.9 using lxml 1.3 beta using macs default libxml2. In my initial attempt, I am getting the following errors (after catching the exception in the log). I am using XMLSchema.xsd to validate against as you can see. The error comes before my next step - which would validate the schema I am interested in. Here is my session: >>> import lxml.etree >>> from am.xmlschema import xmlschema_path >>> xmlschema_doc = lxml.etree.parse(xmlschema_path) >>> try: ... xmlschema = lxml.etree.XMLSchema(xmlschema_doc) ... except Exception, e: ... print e.error_log ... /Users/davidpratt/Desktop/xmlschemademo/dev/am.xmlschema/src/am/xmlschema/XMLSchema.xsd:655:ERROR:SCHEMASP:SCHEMAP_REDEFINED_ELEMENT: Element 'element': A global element declaration with the name 'element' does already exist. /Users/davidpratt/Desktop/xmlschemademo/dev/am.xmlschema/src/am/xmlschema/XMLSchema.xsd:864:ERROR:SCHEMASP:SCHEMAP_REDEFINED_ELEMENT: Element 'element': A global element declaration with the name 'group' does already exist. >>> Many thanks Regards David

2 1

[lxml-dev] Crash on Win32 under heavy stress
by Sidnei da Silva June 2, 2007

June 2, 2007

Hi there, We're doing some stress testing before rolling some code based on lxml into production and we've been able to reproduce a crash when reusing the same XSLT object repeatedly. I will dump some information here in the hope that anyone can shed a light before I go trying to compile debug versions of everything and the kitchen sink. The test is composed of a rather small XML file, and a rather big and complex XSLT with several <xsl:import /> <xsl:include /> etc. We fire up 10 threads. Each one has it's own parsed XML file and XSLT, they are not being shared across threads. Each thread then goes on a loop, applying the XSLT to the XML file and serializing the result to a string. With a less than 1000 iterations the crash almost never happens. At about 50000 iterations, the crash is pretty much guaranteed to happen. There doesn't seem to be any memory leak or anything, memory usage is quite stable. This is using the 1.2.1 release. This is a static build on Win32, against: libxml2-2.6.26.win32 libxslt-1.1.17.win32 zlib-1.2.3.win32 iconv-1.9.2.win32 The crash information says its an 'access violation' and it happens somewhere in etree.pyd, when I bring up the debugger only etree.pyd and python24.dll are on the stack (which I guess is pretty useless information). I am hoping to make a debug build to get more information. I can try running the same code on Linux and seeing if it happens there too, or I can try a debug build, or hopefully someone will come out and say I'm doing something wrong here or that the version of libxml2 I'm using has known issues. I can also provide the test code + data upon request. -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

3 5