Mailman 3 June 2009 - lxml - The Python XML Toolkit

[lxml-dev] Possible bug, libxml segfault?
by Avleen Vig June 4, 2009

June 4, 2009

Hi folks :) I sent this message to the xml@gnome list, but that place is seems very quiet lately. I'm hoping someone here might have some insight. Indeed this might be a bug in lxml, we're not sure. Background: We use libxml and libxslt in one of our applications (specifically, in Python via lxml). Recently we've seen our application dying at strange times for no apparent reason. We managed to get a core file out of one crash, and the results of some of our debugging are here: http://xml.pastebin.com/m70c259d6 (I'd be happy to poke more in a particular direction on there, I'm a bit new to gdb :) To me, it seems the parser is complaining while trying to parse the namespaces in the <stylesheet> node in transforms/_base.xslt The node for that opens like this: <xsl:stylesheet version="1.0" xmlns="http://www.w3.org/1999/xhtml"; xmlns:xsl="http://www.w3.org/1999/XSL/Transform"; xmlns:tfxslt="http://tfnet.co.uk/ns/tfxslt"; xmlns:fb="http://www.facebook.com/2008/fbml"; extension-element-prefixes="tfxslt str exsl" exclude-result-prefixes="str exsl tfxslt fb" xmlns:error="http://www.woome.com/error/";> I dug a little deeper and found a bunch of the "address out of bounds" errors and thought I should ask here as I'm drawing a blank on where to go next. The problem happens intermittently, but usually several times a day. I could probably reproduce it. I also see the 'exclude-result-prefixes' mentioned in the backtrace, could that be involved here? Any suggestions you have would be much appreciated!

2 3

[lxml-dev] Target parser parsing error
by qhlonline June 4, 2009

June 4, 2009

Hi, all There are more informations about my parsing error when I use target parser to parse http://www.jiayuan.com/ . The fatal error reported out is: Input is not proper UTF-8, indicate encoding ! To find the real place where this problem occured, I have tried to convert the HTML string encoding with iconv directly. This time it also report error, and the error character index in string is just the same with my lxml test. Now things are clear that this parsing error is caused by encoding conversion of iconv from utf-8 to utf-8 when there are illegal characters in the source. When I do not define the data function in my target parser, It will paser without error report. Is it means that when I escape the data function , the UTF-8 to UTF-8 conversion is also escaped ? Or some correct conversion has been done before the call to the data function ? yours

2 3

[lxml-dev] ODS file with lxml
by Ovnicraft June 4, 2009

June 4, 2009

Hi folks, i am triying to manipulate the content.xml file from ODS in lxml but when i try: doc = etree.parse(xmldata), give me the content of xmldata in STDOUT, i guess it can be parsed. I attached the file what i ma using. Waiting your suggest, regards, -- Cristian Salamea http://twitter.com/ovnicraft Software Libre / Open Source (+593-8) 4-36-44-48

2 1

[lxml-dev] lxml deconding problem caused by <meta> tag specification
by qhlonline June 3, 2009

June 3, 2009

Hi, all There are instances that when an HTML file has meta tags, the charset declared in tag is not right, because the HTML content next is using a different encoding. But lxml will parse accroding to what said. In this situation, it may report error information of error decoding, but some times it can parse, and generate a DOM that is not complete. eg. I have a WEB file has while the following content is encoded with GBK(which is a Supper set of GB2312). We have got a result with only part of the HTML tags parsed out. I wan't to know, if lxml have any warning or error information reported for this situation? What it is? and how can we deal with this kind of fault ? Is there any common method? I have also seen some HTML files have tag attributes "lang", I don't know whether this attribute is used in the HTML parsing process. In meta tag like , there are also language statement, But in the htmlCheckMeta method of libxml2 library source, I didn't find any processing with the http-equiv attribute value "Content-Language". Is it because that "Content-Language" is not standerd? Is lxml support this attribute? if so , how to deal with the " content="zh-cn" " declaration when it was saying another different language? yours

2 2

[lxml-dev] lxml about Target Parser
by qhlonline June 3, 2009

June 3, 2009

Hi，all When I used the lxml with self defined Target Parser, There is a function that can be redefined-- data . def data (self, data): When can we use it? and what it will do when we simply write a single line: "return " ? Is there any encoding conversion?

2 2

[lxml-dev] XML Documents & I18N (the way Cocoon does it)
by Alexis Georges June 1, 2009

June 1, 2009

Hello everyone, I am maintaining a multilingual website which works with XML, XSLT to generate XHTML. I am working with Apache Cocoon (http://cocoon.apache.org/2.1/) using (among other things) their I18NTransformer. Basically I can use elements in the I18N (http://apache.org/cocoon/i18n/2.1) namespace, and then tell Cocoon to apply the I18NTransfomer to the document; this replaces the I18N elements with a localized value (eg. a formatted date/number, a translated label/attribute, etc...). I have been looking at lxml a little bit to see if I could move to a Python-based framework for the website. I am not quite sure how to go about the I18N part though. Using the Babel library (http://babel.edgewall.org/) along with request headers to generate localized data, I have everything I need. What is missing is the "parser" for the I18N elements. All I can think of right now is to implement a SAX parser, the way Cocoon does (in Java). Does anyone have suggestions? Am I making this too complicated? Thanks! Alexis

2 2