Mailman 3 - lxml - The Python XML Toolkit

Re: [lxml-dev] Segfault on OS X
by Paul Everitt April 16, 2005

April 16, 2005

On Apr 15, 2005, at 12:14 AM, Marc-Antoine Parent wrote: > OK... > Would you mind sending us the terminal output of the build process? > (i.e. do a make clean/make test, and copy the terminal contents) > I would like to know what gets picked up. > Also, after the build, please send us the output of > otool -L path/to/lxml/src/lxml/etree.so Sure, thanks for the offer of help! otool output is first: $ otool -L ./build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/etree.so ./… [View More]build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/etree.so: /opt/local/lib/libxml2.2.dylib (compatibility version 9.0.0, current version 9.16.0) /opt/local/lib/libxslt.1.dylib (compatibility version 3.0.0, current version 3.12.0) /usr/lib/libSystem.B.dylib (compatibility version 1.0.0, current version 71.1.1) Next, build: socrates:~/sandboxes/lxml paul$ python ./setup.py build running build running build_py creating build creating build/lib.darwin-7.8.0-Power_Macintosh-2.3 creating build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml creating build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/tests/__init__.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/tests/test_etree.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/tests/test_unicode.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/tests/test_xpathevaluator.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/__init__.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml copying src/lxml/_elementpath.py -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml running build_ext building 'lxml.etree' extension creating build/temp.darwin-7.8.0-Power_Macintosh-2.3 creating build/temp.darwin-7.8.0-Power_Macintosh-2.3/src creating build/temp.darwin-7.8.0-Power_Macintosh-2.3/src/lxml gcc -fno-strict-aliasing -Wno-long-double -no-cpp-precomp -mno-fused-madd -fno-common -DNDEBUG -g -O3 -Wall -Wstrict-prototypes -I/opt/local/include/libxml2 -I/opt/local/include -I/opt/local/include/python2.3 -c src/lxml/etree.c -o build/temp.darwin-7.8.0-Power_Macintosh-2.3/src/lxml/etree.o -w gcc -L/opt/local/lib -bundle -undefined dynamic_lookup build/temp.darwin-7.8.0-Power_Macintosh-2.3/src/lxml/etree.o -L/opt/local/lib -L/opt/local/lib -lxml2 -lxslt -o build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/etree.so creating build/lib.darwin-7.8.0-Power_Macintosh-2.3/.svn copying src/.svn/README.txt -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/.svn creating build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/.svn copying src/lxml/.svn/README.txt -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/.svn copying src/lxml/tests/test.xml -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests copying src/lxml/tests/test_broken.xml -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests creating build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests/.svn copying src/lxml/tests/.svn/README.txt -> build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/tests/.svn socrates:~/sandboxes/lxml paul$ sudo python ./setup.py install running install running build running build_py running build_ext running install_lib copying build/lib.darwin-7.8.0-Power_Macintosh-2.3/lxml/etree.so -> /opt/local/lib/python2.3/site-packages/lxml socrates:~/sandboxes/lxml paul$ socrates:~/sandboxes/lxml paul$ socrates:~/sandboxes/lxml paul$ python Python 2.3.5 (#1, Mar 6 2005, 18:54:59) [GCC 3.3 20030304 (Apple Computer, Inc. build 1671)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> socrates:~/sandboxes/lxml paul$ cd socrates:~ paul$ cd projects/ socrates:~/projects paul$ cd plonemarketing/ socrates:~/projects/plonemarketing paul$ ls PloneMarketing doc schemas data models templates socrates:~/projects/plonemarketing paul$ cd PloneMarketing/ socrates:~/projects/plonemarketing/PloneMarketing paul$ python Python 2.3.5 (#1, Mar 6 2005, 18:54:59) [GCC 3.3 20030304 (Apple Computer, Inc. build 1671)] on darwin Type "help", "copyright", "credits" or "license" for more information. >>> from lxml import etree >>> f = open ("../data/tmp/content.xml", "r") >>> content = etree.parse(f) >>> f.close() >>> del f, content >>> f = open ("../data/tmp/content.xml", "r") >>> f.close() >>> f = open ("../data/tmp/content.xml", "r") >>> content = etree.parse(f) Segmentation fault [View Less]

3 5

Re: [lxml-dev] Segfault on OS X
by Marc-Antoine Parent April 14, 2005

April 14, 2005

OK... Would you mind sending us the terminal output of the build process? (i.e. do a make clean/make test, and copy the terminal contents) I would like to know what gets picked up. Also, after the build, please send us the output of otool -L path/to/lxml/src/lxml/etree.so Thank you, Marc-Antoine

1 0

Re: [lxml-dev] Segfault on OS X
by Marc-Antoine Parent April 14, 2005

April 14, 2005

Sorry, I forgot to copy the list again. (Could you set the reply-to field in the listserv?) > I've extended the use of the guessing code in setup.py to also extract > the library information. Try the trunk and see whether that helps? It does. However, I noticed in the compilation process, the guessing code only looks at xml2-config, not at xslt-config. Somehow, the compilation still works without -I/usr/local/lib, but I am not sure where it finds the libxsl include files, and I do … [View More]

2 1

Re: [lxml-dev] Segfault on OS X
by Martijn Faassen April 14, 2005

April 14, 2005

Hey, [this was mailed to just me by mistake, presmably, so cc to the list] Marc-Antoine Parent wrote: >> I've extended the use of the guessing code in setup.py to also extract >> the library information. Try the trunk and see whether that helps? > > It does. However, I noticed in the compilation process, the guessing > code only looks at xml2-config, not at xslt-config. Somehow, the > compilation still works without -I/usr/local/lib, but I am not sure > where … [View More]

1 0

Fwd: [lxml-dev] Segfault on OS X
by Marc-Antoine Parent April 13, 2005

April 13, 2005

FYI, I also have the same problem. I ran the tests through gdb, and this is what I get. xmllint: using libxml version 20619 gdb python GNU gdb 5.3-20030128 (Apple version gdb-330.1) (Fri Jul 16 21:42:28 GMT 2004) Copyright 2003 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for … [View More]GDB. Type "show warranty" for details. This GDB was configured as "powerpc-apple-darwin". Reading symbols for shared libraries ... done (gdb) set args test.py -p -v (gdb) run Starting program: /usr/bin/python test.py -p -v Reading symbols for shared libraries . done ... Reading symbols for shared libraries . done 3/238 ( 1.3%): test_attribute_items (lxml.tests.test_etree.ETreeTestCase) Program received signal EXC_BAD_ACCESS, Could not access memory. 0x94ad072c in xmlDictOwns () (gdb) bt #0 0x94ad072c in xmlDictOwns () #1 0x94a53068 in xmlFreeNodeList () #2 0x94a518f8 in xmlFreeProp () #3 0x94a51810 in xmlFreePropList () #4 0x94a53028 in xmlFreeNodeList () #5 0x94a504f4 in xmlFreeDoc () #6 0x004f4230 in __pyx_tp_dealloc_5etree__DocumentBase (o=0x3e110) at src/lxml/etree.c:354 #7 0x004f43fc in __pyx_tp_dealloc_5etree__NodeBase (o=0xd4e8) at src/lxml/etree.c:9688 #8 0x10024898 in frame_dealloc (f=0x124ae0) at Objects/frameobject.c:394 #9 0x1007cab8 in fast_function (func=0x121d30, pp_stack=0xc, n=7, na=5194268, nk=1187120) at Python/ceval.c:3632 #10 0x1007c908 in call_function (pp_stack=0xbfffdfcc, oparg=1255136) at Python/ceval.c:3568 #11 0x1007a384 in PyEval_EvalFrame (f=0x83d810) at Python/ceval.c:2163 #12 0x1007b4c8 in PyEval_EvalCodeEx (co=0x0, globals=0x1326e0, locals=0x42657475, args=0x10078444, argcount=1049072, kws=0x1007a374, kwcount=1, defs=0x83d96c, defcount=1, closure=0x0) at Python/ceval.c:2730 #13 0x100264b8 in function_call (func=0x10c809, arg=0x1001f0, kw=0x83d810) at Objects/funcobject.c:548 #14 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #15 0x1007d078 in ext_do_call (func=0x6d430, pp_stack=0xbfffe290, flags=269601980, na=1, nk=0) at Python/ceval.c:3824 #16 0x1007a474 in PyEval_EvalFrame (f=0x116730) at Python/ceval.c:2203 #17 0x1007b4c8 in PyEval_EvalCodeEx (co=0x11688c, globals=0x1326e0, locals=0x42657475, args=0xa30d0, argcount=1049072, kws=0x1007a374, kwcount=1, defs=0x83d96c, defcount=0, closure=0x0) at Python/ceval.c:2730 #18 0x100264b8 in function_call (func=0x627eb, arg=0x1001f0, kw=0x116730) at Objects/funcobject.c:548 #19 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #20 0x10015ccc in instancemethod_call (func=0x6d470, arg=0x567878, kw=0x0) at Objects/classobject.c:2431 #21 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #22 0x1005959c in slot_tp_call (self=0xa30d0, args=0x54c570, kwds=0x0) at Objects/typeobject.c:4526 #23 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #24 0x1007cc28 in do_call (func=0xa30d0, pp_stack=0xa30d0, na=0, nk=1049072) at Python/ceval.c:3755 #25 0x1007c920 in call_function (pp_stack=0x0, oparg=1255136) at Python/ceval.c:3570 #26 0x1007a384 in PyEval_EvalFrame (f=0x109bc0) at Python/ceval.c:2163 #27 0x1007b4c8 in PyEval_EvalCodeEx (co=0x1, globals=0x1326e0, locals=0x42657475, args=0x10078444, argcount=1049072, kws=0x1007a374, kwcount=1, defs=0x83d96c, defcount=0, closure=0x0) at Python/ceval.c:2730 #28 0x100264b8 in function_call (func=0x2092dc, arg=0x1001f0, kw=0x109bc0) at Objects/funcobject.c:548 #29 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #30 0x1007d078 in ext_do_call (func=0x6d8b0, pp_stack=0xbfffebd0, flags=269601980, na=1, nk=0) at Python/ceval.c:3824 #31 0x1007a474 in PyEval_EvalFrame (f=0x107160) at Python/ceval.c:2203 #32 0x1007b4c8 in PyEval_EvalCodeEx (co=0x1072bc, globals=0x1326e0, locals=0x42657475, args=0x55bc70, argcount=1049072, kws=0x1007a374, kwcount=1, defs=0x83d96c, defcount=0, closure=0x0) at Python/ceval.c:2730 #33 0x100264b8 in function_call (func=0x62cc3, arg=0x1001f0, kw=0x107160) at Objects/funcobject.c:548 #34 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #35 0x10015ccc in instancemethod_call (func=0x6d8f0, arg=0xd3350, kw=0x0) at Objects/classobject.c:2431 #36 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #37 0x1005959c in slot_tp_call (self=0x55bc70, args=0x565690, kwds=0x0) at Objects/typeobject.c:4526 #38 0x1000c58c in PyObject_Call (func=0x121d30, arg=0x1326e0, kw=0x0) at Objects/abstract.c:1751 #39 0x1007cc28 in do_call (func=0x55bc70, pp_stack=0x55bc70, na=0, nk=1049072) at Python/ceval.c:3755 #40 0x1007c920 in call_function (pp_stack=0x0, oparg=1255136) at Python/ceval.c:3570 #41 0x1007a384 in PyEval_EvalFrame (f=0x104c50) at Python/ceval.c:2163 #42 0x1007ca80 in fast_function (func=0x121d30, pp_stack=0x104dc8, n=268928068, na=5194268, nk=1187120) at Python/ceval.c:3629 #43 0x1007c908 in call_function (pp_stack=0xbffff3fc, oparg=1255136) at Python/ceval.c:3568 #44 0x1007a384 in PyEval_EvalFrame (f=0x842c10) at Python/ceval.c:2163 #45 0x1007ca80 in fast_function (func=0x121d30, pp_stack=0x842dc8, n=268928068, na=5194268, nk=1187120) at Python/ceval.c:3629 #46 0x1007c908 in call_function (pp_stack=0xbffff5ac, oparg=1255136) at Python/ceval.c:3568 #47 0x1007a384 in PyEval_EvalFrame (f=0x108850) at Python/ceval.c:2163 #48 0x1007b4c8 in PyEval_EvalCodeEx (co=0x1, globals=0x1326e0, locals=0x42657475, args=0x10078444, argcount=1049072, kws=0x1007a374, kwcount=1, defs=0x83d96c, defcount=0, closure=0x0) at Python/ceval.c:2730 #49 0x1007e8bc in PyEval_EvalCode (co=0x121d30, globals=0x1326e0, locals=0x0) at Python/ceval.c:484 #50 0x100b3124 in run_node (n=0x10078444, filename=0x1326e0 "Alpha", globals=0x1, locals=0x1089a4, flags=0x0) at Python/pythonrun.c:1265 #51 0x100b28b0 in PyRun_SimpleFileExFlags (fp=0xa0009818, filename=0xbffffa10 "test.py", closeit=1083472, flags=0x10b849) at Python/pythonrun.c:860 #52 0x100bf884 in Py_Main (argc=129616, argv=0xbffffa13) at Modules/main.c:484 #53 0x000018d0 in _start (argc=129616, argv=0xa0009818, envp=0xbffffa13) at /SourceCache/Csu/Csu-47/crt.c:267 #54 0x8fe1a558 in __dyld__dyld_start () [View Less]

2 6

[lxml-dev] off-topic: libxml on OS X
by Marc-Antoine Parent April 13, 2005

April 13, 2005

BTW, if you need a fresh version of libxml binaries for 10.3, I maintain a generally up-to-date installer of libxml2, libxsl and python bindings at http://maparent.webhop.net/tinderbox/libxml.pkg.tgz Marc-Antoine Parent

1 0

[lxml-dev] etree.parse() works, and it's quick.
by Wade Leftwich April 12, 2005

April 12, 2005

I have tested etree as a dropin replacement for ElementTree, in an application that parses and transforms xml representations of magazine articles. It seems to work fine on the 300,000 articles in my database: that is to say, no exceptions, **no segfaults**, and 20 or so records pulled at random appear to be correct. With no desire to start a big testing argument going, I can also say that etree.parse() is comparable to cElementTree.parse() in terms of speed. Reading 100,000 xml … [View More]

2 3

[lxml-dev] default namespace for xpath
by Tim Parkin April 12, 2005

April 12, 2005

Hello, You'll have to excuse me if this is a bit of a newbie question but I'm trying to parse an xhtml document with a default namespace and was wondering if there is a simple way of setting this when applying an xpath query? I think that I'm going to have to wait for xpath2 but for the sake of 'ease of use' is there a way of working that will allow me to use '//body' on a document that uses a default namespace xmlns="http://www.w3.org/1999/xhtml"? (or any other default namespace for … [View More]

2 1

[lxml-dev] lxml 0.5.1 released!
by Martijn Faassen April 9, 2005

April 9, 2005

Hi there, Some critical unicode-related errors were discovered in lxml 0.5, so I've done a 0.5.1 release which fixes them. Enjoy! The release can be found on: http://codespeak.net/lxml Regards, Martijn

1 0

[lxml-dev] etree.Element() segfault
by Wade Leftwich April 9, 2005

April 9, 2005

Hi, Using lxml 0.5 with Python 2.3.5 and libxml 2.6.16 (Debian Unstable packages), I get a segfault by passing a unicode string containing a high-bit character as an attribute value to the Element() constructor. This does not happen when passing the same value to Element.set(): ###### In [9]:gooduni = u'"straight quotes"' In [10]:baduni = u'\u201ccurly quotes\u201d' In [11]:a = etree.Element('a') In [12]:a.set('goodattr', gooduni) In [13]:etree.dump(a) <a goodattr=""… [View More]

2 2