Mailman 3 July 2009 - lxml - The Python XML Toolkit

[lxml-dev] complex node
by Jonas July 14, 2009

July 14, 2009

Hi, I'm trying to parsing a xml file (in python) to convert it to dictionaries and then to JSON. This is the file: http://unicode.org/cldr/data/common/main/es.xml and I've got all nodes except dates', which is enought complex. Any idea to get it? because I'm very tired of try it.

2 3

Re: [lxml-dev] lxml binary egg redux
by Stefan Behnel July 12, 2009

July 12, 2009

Stephan Eletzhofer wrote: > Am 12.07.2009 um 21:29 schrieb Stefan Behnel: >> Stephan Eletzhofer wrote: >>> I've built 2.4, 2.5 and 2.6 versions of LXML 2.2.2 and uploaded them. >> >> Any reason why the 2.5 egg is so much bigger than the others? > > Hmm: > > $ ls -lah lib.macosx-10.5-i386-2.?/lxml/*.so > -rwxr-xr-x 1 seletz staff 3,0M 12. Jul 11:09 > lib.macosx-10.5-i386-2.4/lxml/etree.so > -rwxr-xr-x 1 seletz staff 1,7M 12. Jul 11:09 > lib.macosx-10.5-i386-2.4/lxml/objectify.so > -rwxr-xr-x 1 seletz staff 5,5M 12. Jul 21:15 > lib.macosx-10.5-i386-2.5/lxml/etree.so > -rwxr-xr-x 1 seletz staff 3,0M 12. Jul 21:16 > lib.macosx-10.5-i386-2.5/lxml/objectify.so > -rwxr-xr-x 1 seletz staff 2,8M 12. Jul 21:20 > lib.macosx-10.5-i386-2.6/lxml/etree.so > -rwxr-xr-x 1 seletz staff 1,5M 12. Jul 21:20 > lib.macosx-10.5-i386-2.6/lxml/objectify.so > > I've built the 2.5 version using the Apple-supplied python 2.5, the > other ones using the > macports variants. I've no idea about the sizes, really. :p I guess the macports builds are platform specific, while the Apple-builds are fat eggs, i.e. they would work on both PPC and x86. Given that Apple's platform Python is 2.5, I guess it's ok to provide the other eggs only for macports. And I also guess that 'fatness' isn't really a future-proof requirement, either... Anyway, thanks for the contribution! Stefan

1 0

[lxml-dev] blather question about XML declaration
by Hervé Cauwelier July 9, 2009

July 9, 2009

Hi, I just wonder why lxml is producing XML declarations such as <?xml version='1.0' encoding='UTF-8'?> or sometimes <?xml version='1.0' encoding='UTF-8'?> instead of the most common (to my knowledge) <?xml version="1.0" encoding="UTF-8"?> For now I don't ask tostring() to print it, I concatenate my own with the tree serialisation. Thanks, Hervé

2 1

[lxml-dev] space normalisation for .text and .tail
by F Wolff July 7, 2009

July 7, 2009

Hallo all On 2009-03-24 I wrote about space normalisation with reference to the xml:space attribute, and the string() and normalize-string() functions in xpath. I solved my problem in code, partly due to slightly changing requirements. Now I need to do similar magic, but need to handle the text nodes separately, without descending into child nodes. >From the xpath document: > The string-value of an element node is the concatenation of the > string-values of all text node descendants of the element node in > document order. ...which is not what I need to do in this case. Is there a way to apply the normalize-text() to a node's .text or .tail only? Is there another way to obtain the same result? From the looks of it, there is no reliable way that I can normalise correctly in code, since I won't know if a newline (for example) was given as a newline or as a character reference, and this should influence the normalisation. Any help is appreciated. Friedel -- Recently on my blog: http://translate.org.za/blogs/friedel/en/content/presentation-afrilex-alasa…

2 2

[lxml-dev] lxml.html, now with ignored namespaces!
by Thomas Weigel July 4, 2009

July 4, 2009

I am using lxml to parse HTML documents, which include a custom namespace (for example, "FRUIT"). In lxml 2.2.0, on Windows, this worked just fine, and elements could be processed based on this data. In lxml 2.2.2, on Linux, this fails. The above example becomes "FRUIT" as soon as it is parsed by lxml.html (or lxml.etree.HTMLParser()). I don't know if this is caused by the switch to Linux, or the upgrade to 2.2.2. I don't have control over the installation, so I can't switch to 2.2.2 under Windows, or 2.2.0 under Linux to check. I did find this reference (the only reference to this I could find) to the HTML ignoring namespaces: http://codespeak.net/lxml/lxmlhtml.html#running-html-doctests ...however, it wasn't doing that before, and it seems odd that this is only mentioned in the doctests section. Is there a way to work around this? Are custom namespaces simply not possible in lxml's HTML? Notes: 1. The XML parser will not work. Some documents will have legal HTML that breaks an XML parser, like " ". 2. Here is the sample code: ----- >>> import lxml.html as parser >>> document = parser.fromstring("""<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.1//EN" "http://www.w3.org/TR/xhtml11/DTD/xhtml11.dtd"><html xmlns="http://www.w3.org/TR/1999/REC-html-in-xml" xmlns:cs="http://something.com/cs" xml:lang="en" lang="en"><head><title>Help!</title></head><body>My namespaces are going to disappear!FRUIT</body></html>""") >>> print parser.tostring(document) ----- The output: ----- <html xmlns="http://www.w3.org/TR/1999/REC-html-in-xml" cs="http://something.com/cs" xml:lang="en" lang="en"><head><title>Help!</title></head><body>My namespaces are going to disappear!FRUIT</body></html> ----- Thomas Weigel

3 5

[lxml-dev] Really dumb question
by john mcginnis July 1, 2009

July 1, 2009

I have completed a build with easy_install. Looking at site-packages I also see a lxml directory that exists. What I don't find however is a lxml.py module anywhere. If you have a successful build should there not be a lxml.py module somewhere? Thanks. JohnMc

2 1

[lxml-dev] parsing DTDs - listing of valid elements
by Elliott Slaughter June 30, 2009

June 30, 2009

Hi, I'm trying to get the elements in a DTD. Since these internals are not exported in the Python interface of lxml.etree, I am trying to write a Cython extension to do so, as previously suggested on this mailing list (see link below). http://codespeak.net/pipermail/lxml-dev/2009-January/004298.html To quote the message, "all you'd really need is the internal _c_dtd field of the DTD class, which you could cimport". I'm wondering exactly how I am supposed to do that (my attempts so far are described below). It would also be nice to know if the last attempt to do so was successful or not. Thanks. Any help would be appreciated. Here is what I've tried so far (on Python 2.5.4, Cython 0.11.2, Windows): The DTD class is not declared in etreepublic.pxd, so I can't just "cimport etreepublic". The actual DTD class definition is in dtd.pxi, as stated in the message. But I can't just "include 'dtd.pxi' " because it inherits from the _Validator class in lxml.etree.pyx . And I can't "cimport lxml.etree" because there is no file lxml.etree.pxd. I tried writing a lxml.etree.pxd file to circumvent these barriers (which was thoroughly confusing because _Validator contains an _ErrorLog which made me search through several other files...), but even when I got the entire thing to compile, it failed to load in Python: >>> import mydtd Traceback (most recent call last): File "<stdin>", line 1, in <module> File "lxml.etree.pxd", line 3, in mydtd (mydtd.c:513) cdef class _LogEntry: ValueError: lxml.etree._LogEntry does not appear to be the correct type object I have attached my lxml.etree.pxd in case I made any mistakes, in the event that this method can be made to work. -- Elliott Slaughter "Don't worry about what anybody else is going to do. The best way to predict the future is to invent it." - Alan Kay

2 3