Mailman 3 October 2011 - lxml - The Python XML Toolkit

new on the list want to search the archive
by Richard Vézina 17 Oct '11

17 Oct '11

Hello, I am new hear... I developping a wordml export function... I would not ask question already answer in the past but the archive of the list seems to be not accessible except from here : https://mailman-mail5.webfaction.com/pipermail/lxml/ How to search the mailing list ?? For now I am trying to figure how I can generate a element with more then one namespace as the wordDocument node of the wordml 2003 has multiple namespace... So far I did this : W = ElementMaker(namespace=\ "http://schemas.microsoft.com/office/word/2003/wordml"\ ,nsmap={'w' : "http://schemas.microsoft.com/office/word/2003/wordml "}) DOC = W.wordDocument word_doc = DOC( ... ) wd = etree.tostring(word_doc, pretty_print=True, xml_declaration=True, encoding='UTF-8', standalone="yes") new_word_doc = etree.parse(StringIO(wd)) new_word_doc.getroot().addprevious(etree.ProcessingInstruction('mso-application', 'progid="Word.Document"')) print(etree.tostring(new_word_doc, pretty_print=True, xml_declaration=True, encoding='UTF-8', standalone="yes")) That give me that : <?xml version='1.0' encoding='UTF-8' standalone='yes'?> <?mso-application progid="Word.Document"?> <w:wordDocument xmlns:w=" http://schemas.microsoft.com/office/word/2003/wordml"> <w:body> <w:p> <w:r> <w:t>Paragraphe 1 test</w:t> </w:r> </w:p> <w:tbl> <w:tr> <w:tc> <w:p> <w:r> <w:t>L1C1</w:t> </w:r> </w:p> </w:tc> <w:tc> <w:p> <w:r> <w:t>L1C2</w:t> </w:r> </w:p> </w:tc> </w:tr> </w:tbl> </w:body> </w:wordDocument> But I need to have my wordDocument node to look like this : <w:wordDocument xmlns:aml="http://schemas.microsoft.com/aml/2001/core" xmlns:dt="uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" xmlns:ve=" http://schemas.openxmlformats.org/markup-compatibility/2006" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:v="urn:schemas-microsoft-com:vml" xmlns:w10="urn:schemas-microsoft-com:office:word" xmlns:w=" http://schemas.microsoft.com/office/word/2003/wordml" xmlns:wx=" http://schemas.microsoft.com/office/word/2003/auxHint" xmlns:wsp=" http://schemas.microsoft.com/office/word/2003/wordml/sp2" xmlns:sl=" http://schemas.microsoft.com/schemaLibrary/2003/core" w:macrosPresent="no" w:embeddedObjPresent="no" w:ocxPresent="no" xml:space="preserve"> The tutorial about the namespace is pretty short so... I can't figure out if I can do it or if I have to consider the other namespace has attributes like explained here : http://stackoverflow.com/questions/863183/python-adding-namespaces-in-lxml Thank you mailing list. ;-) Richard

2 1

User-Agent HTTP header when parsing a URL
by Simon Sapin 17 Oct '11

17 Oct '11

Hi list, I use lxml.html.parse to parse HTTP (or other) URLs. It seems that lxml currently does not send any User-Agent header when doing an HTTP request. I looked at the API documentation for parse() and HTMLParser but could not find anything related to HTTP. Is it possible to set a User-Agent or other HTTP headers in requests made by lxml? I understand that lxml’s focus is not on HTTP so I should use something else to do fancy requests. However, lxml already detects the content encoding from the "charset" parameter of the Content-Type response header, which is quite handy. Best regards, -- Simon Sapin

2 1

Generating python data structtures from xml (again)
by Evgeny Turnaev 12 Oct '11

12 Oct '11

It is seems this question was asked before: i found discussion here: https://mailman-mail5.webfaction.com/pipermail/lxml/2008-January/003243.html The question is: how can i generate python data structure with lxml.objectify and XML Schema without manually specifying attributes or types in xml. It seems this was asked before and only possible to do this with AttributeBasedElementClassLookup and specifying attributes in xml. Is this still so in current development version? Should i abandon any hope this will be implemented? -- -------------------------------------------- Турнаев Евгений Викторович +7 906 875 09 43 --------------------------------------------

3 2

html5parser namespace trouble
by Henrik Zagerholm 11 Oct '11

11 Oct '11

Hello list, I'm trying to use the html5parser module in lxml.html but all tags are getting namespaced. soup = lxml.html.html5parser.fromstring("<div>Fooo</div>") lxml.html.tostring(soup) <html:div xmlns:html="http://www.w3.org/1999/xhtml">Fooo</html:div> If I use the html5lib directly I can avoid this by doing: parser = html5lib.HTMLParser(tree=html5lib.treebuilders.getTreeBuilder("lxml"), namespaceHTMLElements=False) soup = parser.parse("<div>Fooo</div>") BUT I can't seem to pass the namespaceHTMLElements=False argument to lxml.html.html5parser methods so how do I avoid all namespacing when parsing html5 with lxml.html.html5parser?? Cheers, Henrik

2 2

Mapping Python classes by XML Schema type
by F. Oliver Gathmann 10 Oct '11

10 Oct '11

Dear list, I would like to map XML Schema types to Python classes with lxml.objectify. I think a code sample will best illustrate what I am attempting to do: ======================================================== from StringIO import StringIO from lxml import etree from lxml import objectify xml_schema=\ """<?xml version="1.0" encoding="utf-8" ?> <schema targetNamespace="http://company.com/organization" elementFormDefault="qualified" xmlns="http://www.w3.org/2001/XMLSchema" xmlns:o="http://company.com/organization" > <complexType name="OrganizationType" > <sequence> <element name="name" type="string" minOccurs="1" maxOccurs="1" > </element> </sequence> </complexType> <element name="organization" type="o:OrganizationType" > </element> </schema> """ xml = \ """<?xml version="1.0" encoding="utf-8" ?> <o:organization xmlns:o="http://company.com/organization" > <o:name>Test.org</o:name> </o:organization> """ class MyOrganization(objectify.ObjectifiedDataElement): pass org_type = objectify.PyType('OrganizationType', None, MyOrganization) org_type.xmlSchemaTypes = ('OrganizationType',) org_type.register() xml_schema_stream = StringIO(xml_schema) doc = etree.parse(xml_schema_stream) schema = etree.XMLSchema(doc) parser = objectify.makeparser(schema=schema) xml_stream = StringIO(xml) tree = objectify.parse(xml_stream, parser) root = tree.getroot()[0] assert isinstance(root, MyOrganization) ======================================================== The above does not work; I tried various ways of specifying the name of the XML Schema Type ("o:OrganizationType" and "{http://company.com/organization}OrganizationType") and also experimented with supplying xsi:type information in the <o:organization> tag, all to no avail. Is there something obvious I am missing here or is the PyType mechanism just not cut out for this line of work?! I'd be very grateful for any comments, Regards, Oliver

2 2

lxml - The Python XML Toolkit October 2011