Mailman 3 May 2010 - lxml - The Python XML Toolkit

[lxml-dev] Fwd: Re: installing lxml on MacOS
by Stefan Behnel May 18, 2010

May 18, 2010

[Forwarding to the list] -------- Original Message -------- Subject: Re: [lxml-dev] installing lxml on MacOS Date: Tue, 18 May 2010 08:34:21 -0600 From: Lacy K. Fuller To: Stefan Behnel On May 17, 2010, at 11:17 PM, Stefan Behnel wrote: > Lacy K. Fuller, 18.05.2010 01:25: >> So I'm trying to figure this out as well, running on MacOS 10.5.8 >> with >> Python 2.4 and trying to install lxml 2.2.6. I tried forcing >> libxml2 to >> 2.7.3 > > That shouldn't matter. > > >> but I'm still getting the undefined symbols error: >> >> Undefined symbols for architecture i386: >> "_gzdirect", referenced from: >> ___xmlParserInputBufferCreateFilename in libxml2.a(xmlIO.o) >> ld: symbol(s) not found for architecture i386 >> collect2: ld returned 1 exit status >> Undefined symbols for architecture ppc: >> "_gzdirect", referenced from: >> ___xmlParserInputBufferCreateFilename in libxml2.a(xmlIO.o) >> ld: symbol(s) not found for architecture ppc >> collect2: ld returned 1 exit status >> lipo: can't open input file: /var/folders/jV >> /jVkN8QoVGXSIHfVVe53L-k+++TQ/-Tmp-//ccJ1jdEf.out >> (No such file or directory) >> make[2]: *** [xmllint] Error 1 >> make[1]: *** [all-recursive] Error 1 >> make: *** [all] Error 2 >> >> I'm not sure how to remove isysroot from CFLAGS and LDFLAGS >> as was mentioned in another post > > See buildlibxml.py. > > >> I'm trying to use a buildout to install currently. > > So the above is from a buildout? Which are you using? I got a recipe from a site online (http://pypi.python.org/pypi/z3c.recipe.staticlxml ) and modified it slightly. Strangely, just after I posted my question, I decided to try starting my buildout over in a different directory as a final attempt and it worked perfectly. I'm not sure what the difference was, but it's working fine now. Thanks for your help! Lacy

1 0

[lxml-dev] installing lxml on MacOS
by Stephen Graham May 18, 2010

May 18, 2010

I am trying to go down the learning curve on lxml. I tried to follow the install instructions to install lxml on my MacOS As root, I did: STATIC_DEPS=true easy_install lxml The install chugged away, but eventually failed: ... Undefined symbols for architecture i386: "_gzdirect", referenced from: ___xmlParserInputBufferCreateFilename in libxml2.a(xmlIO.o) ld: symbol(s) not found for architecture i386 collect2: ld returned 1 exit status Undefined symbols for architecture ppc: "_gzdirect", referenced from: ___xmlParserInputBufferCreateFilename in libxml2.a(xmlIO.o) ld: symbol(s) not found for architecture ppc collect2: ld returned 1 exit status lipo: can't open input file: /var/tmp//ccsmIZu8.out (No such file or directory) make[2]: *** [xmllint] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 Traceback (most recent call last): File "/usr/bin/easy_install", line 8, in <module> load_entry_point('setuptools==0.6c7', 'console_scripts', 'easy_install')() File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 1670, in main with_ei_usage(lambda: File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 1659, in with_ei_usage return f() File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 1674, in <lambda> distclass=DistributionWithoutHelpCommands, **kw File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/distutils/core.py", line 151, in setup dist.run_commands() File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/distutils/dist.py", line 974, in run_commands self.run_command(cmd) File "/System/Library/Frameworks/Python.framework/Versions/2.5/lib/ python2.5/distutils/dist.py", line 994, in run_command cmd_obj.run() File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 211, in run self.easy_install(spec, not self.no_deps) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 446, in easy_install return self.install_item(spec, dist.location, tmpdir, deps) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 471, in install_item dists = self.install_eggs(spec, download, tmpdir) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 655, in install_eggs return self.build_and_install(setup_script, setup_base) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 930, in build_and_install self.run_setup(setup_script, setup_base, args) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/command/easy_install.py", line 919, in run_setup run_setup(setup_script, args) File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/sandbox.py", line 27, in run_setup lambda: execfile( File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/sandbox.py", line 63, in run return func() File "/System/Library/Frameworks/Python.framework/Versions/2.5/ Extras/lib/python/setuptools/sandbox.py", line 29, in <lambda> {'__file__':setup_script, '__name__':'__main__'} File "setup.py", line 119, in <module> File "/tmp/easy_install-XVh5wp/lxml-2.2.6/setupinfo.py", line 50, in ext_modules File "/tmp/easy_install-XVh5wp/lxml-2.2.6/buildlibxml.py", line 208, in build_libxml2xslt File "/tmp/easy_install-XVh5wp/lxml-2.2.6/buildlibxml.py", line 158, in call_subprocess Exception: Command "make" returned code 2 Any thing obvious jump out at anyone that I might have missed? thanks in advance sgg Steve Graham sgg(a)ci.uchicago.edu

5 16

[lxml-dev] Trying to build lxml for Mac OS X >= 10.4 with zlib and iconv
by Pascal Oberndörfer May 14, 2010

May 14, 2010

Hello, I am trying to build lxml 2.2.6 for Python on OS X 10.4 and up (for PPC and i386) using static libs for libiconv and libz. The build seem to go fine, but I am experiencing import problems. Here are the steps I am following: - Downloading and extracting lxml 2.2.6 - Placing zlib-1.2.5, libiconv-1.13.1, libxml2-2.7.7, and libxslt-1.1.26 in the 'libs' sub folder - Using a modified 'buildlibxml.py' (based on a version originally done by Stefan) everything seems to compile without errors using: "python setup.py build \ --static-deps \ --libxml2-version=2.7.7 \ --libxslt-version=1.1.26 \ --libiconv-version=1.13.1 \ --zlib-version=1.2.5" - Looking into 'build/tmp/libxml2/lib' shows six libraries: libz.a, libiconv.a, libcharset.a, libxml2.a, libxslt.a, and libexslt.a. lipo says all are PPC+i386 (two way Universal) - After doing python setup.py install I can do "import lxml", but "import lxml.html" fails with: "ImportError: dlopen(/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/lxml/etree.so, 2): Symbol not found: _libiconv_close" I don't know how to proceed from here, especially as during the build of libxml2 it seems to pick up 'libiconv.a' correctly from: "libtool: link: gcc -arch ppc -arch i386 -isysroot /Developer/SDKs/MacOSX10.4u.sdk -O2 -pedantic -W -Wformat -Wunused -Wimplicit -Wreturn-type -Wswitch -Wcomment -Wtrigraphs -Wformat -Wchar-subscripts -Wuninitialized -Wparentheses -Wshadow -Wpointer-arith -Wcast-align -Wwrite-strings -Waggregate-return -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Winline -Wredundant-decls -arch ppc -arch i386 -isysroot /Developer/SDKs/MacOSX10.4u.sdk -o xpath1 xpath1.o ../../.libs/libxml2.a -L/Users/admin/Desktop/lxml-2.2.6/build/tmp/libxml2/lib -lpthread -lz /Users/admin/Desktop/lxml-2.2.6/build/tmp/libxml2/lib/libiconv.a -lm" The only strange thing I can see is something lwhere it says '-liconv': "/bin/sh ../libtool --tag=CC --mode=link gcc -arch ppc -arch i386 -isysroot /Developer/SDKs/MacOSX10.4u.sdk -O2 -pedantic -W -Wformat -Wunused -Wimplicit -Wreturn-type -Wswitch -Wcomment -Wtrigraphs -Wformat -Wchar-subscripts -Wuninitialized -Wparentheses -Wshadow -Wpointer-arith -Wcast-align -Wwrite-strings -Waggregate-return -Wstrict-prototypes -Wmissing-prototypes -Wnested-externs -Winline -Wredundant-decls -arch ppc -arch i386 -isysroot /Developer/SDKs/MacOSX10.4u.sdk -o gjobread gjobread.o ../libxml2.la -lpthread -L/Users/admin/Desktop/lxml-2.2.6/build/tmp/libxml2/lib -lz -L/Users/admin/Desktop/lxml-2.2.6/build/tmp/libxml2/lib -liconv -lm " But I don't know how to change this. So now I am a bit lost. Any help would be very much appreciated! Thanks, Pascal PS. Let me know if I should post the modified 'buildlibxml.py'.

1 1

[lxml-dev] Segmentation fault when building from source
by Shankaranarayanan Puzhavakath Narayanan May 14, 2010

May 14, 2010

Hello, I was trying to build and test lxml on "SunOS 5.10 Generic_141444-09 sun4u sparc" machine when I encountered the following issue while running the test : bash-3.00$ /usr/local/bin/make test python setup.py build_ext -i Building lxml version 2.2.6. NOTE: Trying to build without Cython, pre-generated 'src/lxml/lxml.etree.c' needs to be available. Using build configuration of libxslt 1.1.15 Building against libxml2/libxslt in the following directory: /usr/lib running build_ext python test.py -p -v TESTED VERSION: 2.2.6 Python: (2, 4, 4, 'final', 0) lxml.etree: (2, 2, 6, 0) libxml used: (2, 6, 23) libxml compiled: (2, 6, 23) libxslt used: (1, 1, 15) libxslt compiled: (1, 1, 15) 878/1040 ( 84.4%): test_schematron_invalid_schema_empty (lxml.tests.test_schematron.ETreeSchematronTestCase)make: *** [test_inplace] Segmentation Fault (core dumped) Thanks, Shankar.

1 0

[lxml-dev] How to install lxml-wrapper on OS X ?
by pooz May 14, 2010

May 14, 2010

Hello, I am trying to use the software "inkscape" with its extension inkscape2tikz (http://code.google.com/p/inkscape2tikz/) But I got an error, which needs the lxml-wrapper: "The fantastic lxml wrapper for libxml2 is required by inkex.py and therefore this extension. Please download and install the latest version from http://cheeseshop.python.org/pypi/lxml/, or install it through your package manager by a command like: sudo apt-get install python-lxml" a) I was guessing, that Python is already installed on OS X? b) Where can I get this for OS X and how to install it? I would be very thankful for any advice sincerely pooz

3 2

[lxml-dev] Beginner's question about lxml.
by Lashkara Singh May 12, 2010

May 12, 2010

Hello everyone. I am new to Python and this is the first time I will be doing proper development using a library. I will be using lxml for my project. Since I am new, I obviously don't know the standard method of doing stuff, so as to say. My project involves a XML parser in Python. Can anyone point me to some project that implements XML parsing with lxml / Python so that I can study the source code just to see how things are done. A small and compact project would do wonders. I know how to do stuff after reading the documentation, but if I see some sample code, it would help me in understanding stuff better. I tried to find some project related to this, but I was not successful. Any inputs would be appreciated.

2 2

[lxml-dev] LD_LIBRARY_PATH issues
by Yogesh Tomar May 5, 2010

May 5, 2010

Hi all, Here is my wierd problem. I am using lxml v 2.2.6 on a custom python (2.6.1) installation that i did for a project. I use extensively LD_LIBRARY_PATH for setting the env variables for libraries to be loaded at runtime. I am getting this error while running. ImportError: /home/tomary/Python/2.6.1_x32/lib/python2.6/site-packages/lxml-2.2.6-py2.6-linux-x86_64.egg/lxml/etree.so: undefined symbol: xmlSchematronSetValidStructuredErrors It seems that this error occurs because the wrong version of libxml2 is getting loaded. Though I have set up the correct version in the right place at the front of LD_LIBRARY_PATH. Please help. Regards, Yogesh Tomar

2 1

[lxml-dev] Newline while outputting a XML file.
by Lashkara Singh May 4, 2010

May 4, 2010

Hello everyone. I am developing a Python application that interprets/ writes XML files and I will be using lxml for this. However when writing to the XML using lxml, how can I force it to do a newline on every new tag? What I mean by this is, consider the following code: http://codepad.org/boEQxxqU The output of this code is: <html><head><title>Trying</title></head></html> I want the output to be: <html> <head> <title>Trying</title> </head> </html> Sorry if this question is too noobish, but I am just beginning.

3 5

[lxml-dev] examine XSD xml schema
by Michael Konietzny May 3, 2010

May 3, 2010

Hello, I would like to examine a XSD schema in python. Currently I'm using lxml which is doing it's job very very well when it only has to validate a document against the schema. But, I want to know whats inside of the schema and access the elements in the lxml behavior. The schema: |<?xml version="1.0"?> <xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <xsd:include schemaLocation="worker_remote_base.xsd"/> <xsd:include schemaLocation="transactions_worker_responses.xsd"/> <xsd:include schemaLocation="transactions_worker_requests.xsd"/> </xsd:schema> | The lxml code to load the schema is (simplyfied): |xsd_file_handle= open( self._xsd_file, 'rb') xsd_text= xsd_file_handle.read() schema_document= etree.fromstring(xsd_text, base_url=xmlpath) xmlschema= etree.XMLSchema(schema_document) | I'm then able to use schema_document (which is etree._Element) to go through the schema as an XML document. But since etree.fromstring (at least it seams like that) expects a XML document the |xsd:include| elements are not processed. The problem is currently solved by parsing the first schema document, then load the include elements and then insert them one by one into the main document by hand: |BASE_URL= "/xml/" schema_document= etree.fromstring(xsd_text, base_url=BASE_URL) tree= schema_document.getroottree() schemas= [] for schemaChildin schema_document.iterchildren(): if schemaChild.tag.endswith("include"): try: h= open(os.path.join(BASE_URL, schemaChild.get("schemaLocation")), "r") s= etree.fromstring(h.read(), base_url=BASE_URL) schemas.append(s) except Exception as ex: print "failed to load schema: %s" % ex finally: h.close() # remove the<xsd:include ...> element self._schema_document.remove(schemaChild) for sin schemas: # inside<schema> for sChildin s: schema_document.append(sChild) | What I'm asking for is an idea how to solve the problem by using a more common way. I've already searched for other schema parsers in python but for now there was nothing that would fit in that case. Greetings, Michael

2 1

[lxml-dev] Adding internal DTD entities?
by Brad Smith May 1, 2010

May 1, 2010

Hello all, First, thanks to those responsible for lxml, it has made processing xml in python an almost-fun experience! ;) I have only found one thing I need to be able to do, but of which I can't seem to find any examples. I have entities defined in a file that is shared by all of the files in a document (which are xi:include'ed into the main doc). Thus, I want each document to begin with something like: <!DOCTYPE book PUBLIC "-//OASIS//DTD DocBook XML V4.5//EN" "http://www.oasis-open.org/docbook/xml/4.5/docbookx.dtd" [ <!ENTITY % common_entities SYSTEM "common.ent" > %common_entities; ]> The problem is that some of the files in the doc are auto-generated by a python/lxml pre-processing script, and I can't figure out how to have lxml insert that entity definition into the doctype declaration. Any suggestions here would be greatly appreciated. Thanks! --Brad

2 1