Mailman 3 July 2009 - lxml - The Python XML Toolkit

[lxml-dev] id function of xpath and parseid
by Daniel Albeseder Aug. 6, 2009

Aug. 6, 2009

Hi! I wonder why there is no parseid function inside the objectify module? Is there a reason, why this is only in etree? Additionally I wonder, how the `id` function of XPath does work with lxml. I created a schema-aware parser, which reads an XML-file, where some attributes are declared as xs:ID inside the schema. However the `xpath` method always returns an empty list of nodes, even if the IDs given are inside the XML. Example: ---- from lxml import etree xsd = \ """ <xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <xsd:element name="root" type="rootType"/> <xsd:complexType name="rootType"> <xsd:sequence> <xsd:element name="foo" type="fooType" maxOccurs="unbounded"/> </xsd:sequence> <xsd:attribute name="id" type="xsd:ID" use="required"/> </xsd:complexType> <xsd:complexType name="fooType"> <xsd:attribute name="id" type="xsd:ID" use="optional"/> </xsd:complexType> </xsd:schema> """ xml = """<root id="a"><foo id="b"/><foo id="bar"/><foo/></root>""" schema = etree.XMLSchema (etree.XML (xsd)) parser = etree.XMLParser (schema = schema) root = etree.XML (xml, parser = parser) for i in ["a", "b", "bar"] : print root.xpath ("id('%s')" % i) print "---" print root.get ("id") for el in root : print el.get ("id") --- Returns just: [] [] [] --- a b bar None where the first three lists should not be empty IMHO. Can anyone help me? Best regards Daniel

2 3

[lxml-dev] Getting 'user-visible' text from HTML
by Adam Nelson Aug. 6, 2009

Aug. 6, 2009

Is there a shortcut method (or even a pasted script) that allows lxml to get all the 'user-visible' text? I'm writing a screen scraper that then takes that text and looks for banned words next to an advertiser's content - and therefore I need to run a regular expression on everything a user might see (including meta keywords, etc...) but I don't care about the actual tags themselves, or urls, etc... Right now, I'm just doing the regex on the entire HTML block. Thanks, Adam

4 3

[lxml-dev] lxml
by Yassin Ezbakhe Aug. 6, 2009

Aug. 6, 2009

Hi, I'm using Python 2.6.2 (Windows) and lxml 2.2.2. When I run the following piece of code, it gets stuck. import lxml.etree as et s = "<root><a><b/><c/></a><d/><e/></root>" xml = et.fromstring(s) print xml[0] # prints element a print xml[2] # prints element e print xml[3] # it should raise an out of range exception, but it gets stuck What is the problem? In the original ElementTree implementation, I get an IndexError. Thanks, Yassin

3 2

[lxml-dev] Jython and XPointer support
by Daniel Albeseder Aug. 6, 2009

Aug. 6, 2009

Hi! I wonder if there is, or will be any Jython support of lxml? We are currently evaluating several possibilities to support several XML-features in Python and Jython together. This includes XPath, XSLT, XPointer. The last one is supported by libxml2 but I have not found any support inside lxml. Have I missed something? Will there be XPointer support in lxml in the future? About Jython: There is of course the possibility to use JNA to access the libxml2 library natively, but I do not comprehend how to access lxml from within Jython, since it is not a "normal" shared library, but a shared object created for CPython in Cython. Does anyone have any hint about that? Best regards Daniel

2 1

[lxml-dev] Parsing namespace declarations
by Aaron Rubinstein July 30, 2009

July 30, 2009

Hello, I'm trying to test for the presence of a specific namespace declaration in my document root but the namespace declarations don't seem to appear in the root.attrib dictionary. Here is an example of my doc root: <mods:mods version="3.3" xmlns:mods="http://www.loc.gov/mods/v3" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.loc.gov/mods/v3 http://www.loc.gov/standards/mods/v3/mods-3-3.xsd" xmlns:xlink="http://www.w3.org/1999/xlink"> Does lxml provide a way to parse the namespace declarations? Thanks for your help!

2 1

[lxml-dev] Weakref support?
by Christian Zagrodnick July 27, 2009

July 27, 2009

Hoi, would it be possible to add weakref support to lxml trees (objectify in particular)? http://docs.python.org/extending/newtypes.html#weakref-support Regards, -- Christian Zagrodnick · cz(a)gocept.com gocept gmbh & co. kg · forsterstraße 29 · 06112 halle (saale) · germany http://gocept.com · tel +49 345 1229889 4 · fax +49 345 1229889 1 Zope and Plone consulting and development

2 5

[lxml-dev] docinfo.doctype doesn't include internal entities?
by Sidnei da Silva July 24, 2009

July 24, 2009

Hi there, I am looking for a way to output internal entities that have been parsed from the original document when writing out a tree, but apparently this is not exposed in any attribute. Here's an example: {{{ import lxml.etree document = """<?xml version="1.0"?> <!DOCTYPE application [ <!ENTITY nbsp "\ "> ]> <application> </application> """ tree = lxml.etree.fromstring(document) print tree.getroottree().docinfo.doctype }}} I would expect this to output: {{{ <!DOCTYPE application [ <!ENTITY nbsp "\ "> ]> }}} But instead it gives me: {{{ <!DOCTYPE application> }}} Is it a bug or I'm not looking at the right place? -- Sidnei da Silva

3 2

Re: [lxml-dev] About the position of html parsing by HTML Target parser
by Nicholas Dudfield July 22, 2009

July 22, 2009

Wow, someone else with this requirement. I was meaning to post to the list about this. I'm using lxml to implement a XPath / CSS selection plugin for a python extensible editor. I'd like to have a mapping of view buffer regions to xml nodes. The workaround I used to get the exact character position was to use the feed interface, a character at a time and manually monitor bytestream position. It's fairly slow though. I'd like to implement this in CYthon or use whatever underlying facility there is to speed it up. You can see some screen casts at this forum thread which should make it more obvious what I mean re: css / xpath document selections: http://www.sublimetext.com/forum/viewtopic.php?f=5&t=547 Cheers.

3 7

[lxml-dev] Compile for Linux-PowerPC Problems
by Hilton Shumway July 22, 2009

July 22, 2009

Hello, I'm trying to get lxml to compile on my g3 iBook with Xubuntu Jaunty without success. I get quite a bit of errors compiling. I pastebined a selection of them at http://omploader.org/vMjBzNw They are all quite similar to those ones there. Does anyone know what might be the issue? Hilton Send me all the forwards/chain mails you want. No guaranties I will freak out, cry, continue, or otherwise do anything with (or even read) them though. A selected quote: A wise man will make more opportunities than he finds. - Sir Francis Bacon A random quote: Joan Crawford - "I, Joan Crawford, I believe in the dollar. Everything I earn, I spend." - http://www.brainyquote.com/quotes/authors/j/joan_crawford.html

1 0

[lxml-dev] lxml.objectify.deannotate refuses to clean nil nodes
by Robert Pierce July 20, 2009

July 20, 2009

The nil node <Fubar/> is not deannotated as I would expect in the following snippet. I could not find a reference to this behaviour in the archives or documentation. Is this a design feature for which there is a work around, or a bug? I'm using lxml-2.2-py2.5-linux-i686. Thanks! #### CODE #### import lxml.etree import lxml.objectify x = lxml.objectify.fromstring('<root><Bar/></root>') x.Foo = '' x.Fubar = None lxml.objectify.deannotate(x) lxml.etree.cleanup_namespaces(x) print lxml.etree.tostring(x) #### END CODE ### <root><Bar/><Foo></Foo><Fubar xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xsi:nil="true"/></root>

4 15