Mailman 3 May 2011 - lxml - The Python XML Toolkit

Unable to generate JavaScript using XSLT
by Martin Aspeli 16 May '11

16 May '11

Hi, I have an XML file format and an XSLT format to turn it into a JavaScript file (see below). This works on the command line: ==== $ xsltproc corejet-to-jit.xsl catalogue.xml // corejet-output.js, generated from Corejet Requirements Catalogue var custom_color_for = function(num_passing, num_pending, total) { var weighted = ( num_passing + (0.3 * num_pending) ) / total; var red = (255 * weighted) / 100; var green = (255*(100-weighted)) / 100; if (total==0) { red = 0; green = 0; } return 'rgb('+red+','+green+',0)'; } var metadata = { 'project': 'Test project', 'testTime': '2011-01-02T12:05:00' } var json = { 'id': 'root', 'name': 'Test project', 'data': {}, 'children': [ { 'id': 'epic-E1', 'name': 'First epic', 'data': { '$area': 6 * 10, '$color': custom_color_for(1, 0, 2) }, 'children': [ { 'id': 'story-S1', 'name': 'S1', 'data': { 'title': 'First story', '$area': 3 * 10, '$color': custom_color_for(1, 0, 2) }, 'children': [ { 'id': 'scenario-First scenario', 'name': '', 'data': { 'title': 'First scenario', '$color': '#0a0' , '$area': (3 / 2) * 10, }, 'children': [], }, { 'id': 'scenario-Second scenario', 'name': '', 'data': { 'title': 'Second scenario', '$color': '#a00' , '$area': (3 / 2) * 10, }, 'children': [], }, ] }, { 'id': 'story-S2', 'name': 'S2', 'data': { 'title': 'Second story', '$area': 3 * 10, '$color': custom_color_for(0, 0, 0) }, 'children': [ ] }, ] }, { 'id': 'epic-E2', 'name': 'Second epic', 'data': { '$area': 0 * 10, '$color': custom_color_for(0, 0, 0) }, 'children': [ ] }, ] }; ==== However, I can't apply the transform (or at least read the results) using lxml: >>> from lxml import etree >>> input = etree.parse(open('catalogue.xml')) >>> xslt = etree.parse(open('corejet-to-jit.xsl')) >>> output = input.xslt(xslt) >>> etree.tostring(output, pretty_print=True) is None True >>> output.getroot() is None True Why is this? Does it have to do with the slightly unorthodox XSL? Martin catalogue.xml: <requirementscatalogue project="Test project" extractTime="2011-01-02T12:01:00" testTime="2011-01-02T12:05:00"> <epic id="E1" title="First epic"> <story id="S1" title="First story" points="3" requirementStatus="open" priority="high"> <scenario name="First scenario" testStatus="pass"> <given>something</given> <when>something happens</when> <then>do something</then> <then>and something else</then> </scenario> <scenario name="Second scenario" testStatus="mismatch"> <given>something</given> <when>something happens</when> <then>do something</then> <then>and something else</then> </scenario> </story> <story id="S2" title="Second story" points="3" requirementStatus="closed" requirementResolution="fixed" priority="high"/> </epic> <epic id="E2" title="Second epic"/> </requirementscatalogue> corejet-to-jit.xsl: <?xml version="1.0" encoding="UTF-8"?> <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0"> <xsl:output omit-xml-declaration="yes"/> <xsl:template match="//requirementscatalogue"> // corejet-output.js, generated from Corejet Requirements Catalogue var custom_color_for = function(num_passing, num_pending, total) { var weighted = ( num_passing + (0.3 * num_pending) ) / total; var red = (255 * weighted) / 100; var green = (255*(100-weighted)) / 100; if (total==0) { red = 0; green = 0; } return 'rgb('+red+','+green+',0)'; } var metadata = { 'project': '<xsl:value-of select="@project"/>', 'testTime': '<xsl:value-of select="@testTime"/>' } var json = { 'id': 'root', 'name': '<xsl:value-of select="@project"/>', 'data': {}, 'children': [ <xsl:apply-templates select="epic"/> ] }; </xsl:template> <xsl:template match="epic"> { 'id': 'epic-<xsl:value-of select="@id"/>', 'name': '<xsl:value-of select="@title"/>', 'data': { '$area': <xsl:value-of select="sum(child::story/@points)"/> * 10, <xsl:variable name="num_passing"><xsl:value-of select="count(story/scenario[@testStatus='pass'])"/></xsl:variable> <xsl:variable name="num_pending"><xsl:value-of select="count(story/scenario[@testStatus='pending'])"/></xsl:variable> <xsl:variable name="total_scenarios"><xsl:value-of select="count(story/scenario)"/></xsl:variable> '$color': custom_color_for(<xsl:number value="$num_passing"/>, <xsl:number value="$num_pending"/>, <xsl:number value="$total_scenarios"/>) }, 'children': [ <xsl:apply-templates select="story"/> ] }, </xsl:template> <xsl:template match="story"> { 'id': 'story-<xsl:value-of select="@id"/>', 'name': '<xsl:value-of select="@id"/>', 'data': { 'title': '<xsl:value-of select="@title"/>', '$area': <xsl:value-of select="@points"/> * 10, <xsl:variable name="num_passing"><xsl:value-of select="count(scenario[@testStatus='pass'])"/></xsl:variable> <xsl:variable name="num_pending"><xsl:value-of select="count(scenario[@testStatus='pending'])"/></xsl:variable> <xsl:variable name="total_scenarios"><xsl:value-of select="count(scenario)"/></xsl:variable> '$color': custom_color_for(<xsl:number value="$num_passing"/>, <xsl:number value="$num_pending"/>, <xsl:number value="$total_scenarios"/>) }, 'children': [ <xsl:apply-templates select="scenario"/> ] }, </xsl:template> <xsl:template match="scenario"> { 'id': 'scenario-<xsl:value-of select="@name"/>', 'name': '', 'data': { 'title': '<xsl:value-of select="@name"/>', '$color': <xsl:choose> <xsl:when test="@testStatus='pass'"> '#0a0' </xsl:when> <xsl:when test="@testStatus='pending'"> '#aa0' </xsl:when> <xsl:otherwise> '#a00' </xsl:otherwise> </xsl:choose>, '$area': (<xsl:value-of select="../@points"/> / <xsl:value-of select="count(../scenario)"/>) * 10, }, 'children': [], }, </xsl:template> </xsl:stylesheet>

2 3

Resolvers and encoding
by Laurence Rowe 16 May '11

16 May '11

Is there a way to specify the encoding of a resolved string or file? I'm seeing my UTF-8 data being interpreted as Latin1. Laurence

1 0

Adding namespaces to xml using the xml schema
by Jaime Fernández 14 May '11

14 May '11

We receive xml documents without namespaces but we need some mechanism to add the appropriate namespaces to the xml. We know the xml schema associated to the non-namespace xml document and it could be the means to enrich the original document with namespaces. So, if we receive the following document: <test> <child1> <child2>...</child2> </child1> </test> We should transform it into: <s:test xmlns:s="http://..." xmlns:t="http://..."> <s:child1> <t:child2>...</t:child2> </s:child1> </s:test> I have a very poor knowledge of XML in python, although I've used lxml for validations. I've considered 2 approaches to add the namespaces: a) Analyse the schema and the xml, matching the elements, to add the namespaces. I'm not sure if there's any support for it in python, but it could be very hard to implement it. b) Use some objetify approach Any suggestion? Thanks in advance, Jaime

3 3

how to get attribute-values in a quick way
by Markus Feldmann 05 May '11

05 May '11

Hi All, i am new to this language, i tried a bit but didnt get it to work. Here my code: def oeffneDatei(self, pfad = "daten.xml"): """Beschreibung""" try: datei = file(pfad, 'r') domDoc = etree.parse(datei) datei.close() return domDoc except: print 'Datei '+pfad+' konnte nicht gefunden werden. Es wurde eine neue erstellt!' self.erstelleDatei() def ladeEinstellungen(self, bezeichnung="Einstellung1"): """Beschreibung""" for attribute in self.domDoc.findall("gruppe").items(): print attribute # return attribute, attribute.get('client'), attribute.get('server') My xml file contains the needed informations: <?xml version="1.0" ?> <gruppe bezeichnung="Einstellung1" server="feld-server" client="feld-bertlap"> <eintrag bezeichnung="Eigene Dateien"> <benutzer user1="markus" user2="maria" user3="bernard" user4="kaiserbert"/> <Frage prevalue="von /home/" postvalue="/eigenedateien/"/> <exclude option="--exclude" arg="__thereIsNothingToExcludeInThisSourceButINeedAnEmptyExclude__"/> <client version="1" val1="/home/" val2="/eigenedateien/"/> <server version="1" val1="@" val2=":/home/" val3="/eigenedateien/"/> </eintrag> <eintrag bezeichnung="Mozilla Firefox"> <benutzer user1="markus" user2="maria" user3="bernard" user4="kaiserbert"/> <frage prevalue="von /home/" postvalue="/.mozilla/firefox/"/> <exclude option="--exclude" arg="__thereIsNothingToExcludeInThisSourceButINeedAnEmptyExclude__"/> <client version="1" val1="/home/" val2="/.mozilla/firefox/"/> <server version="1" val1="@" val2=":/home/" val3="/mozilla/firefox/"/> </eintrag> </gruppe>

6 11

how to get element with attribute-value xyz
by Markus Feldmann 05 May '11

05 May '11

Hi All, I try to get my root element, named "gruppe", which have a specific attribute, called bezeichnung="Einstellung1", but it doesn't work. I suppose i know where my mistake is, but dont know how to correct this. Here is my code: class Backup (object): """Auf jedem Rechner muss eine xml-Datei, die Programm-Einstellungen und die zu sichernden Quellen/Ziele enthaelt, existieren.""" def __init__(self, interface = "Text"): """Beschreibung""" self.xmlDatei = 'daten.xml' self.benutzer_passwoerter = {} self.treeDoc, self.gruppe, self.CLIENT, self.SERVER = self.ladeEinstellungen() if interface == "Text": self.starteTextModus() def ladeEinstellungen(self, bezeichnung="Einstellung1"): """Beschreibung""" treeDoc = etree.parse(self.xmlDatei) return treeDoc, treeDoc.getroot('//gruppe[@'+bezeichnung+']'), treeDoc.xpath('//gruppe[@Einstellung1]/@*') Here is my XML code: <?xml version="1.0" ?> <gruppe bezeichnung="Einstellung1" server="feld-server" client="feld-bertlap"> <eintrag bezeichnung="Eigene Dateien"> <benutzer user1="markus" user2="maria" user3="bernard" user4="kaiserbert"/> <Frage prevalue="von /home/" postvalue="/eigenedateien/"/> <exclude option="--exclude" arg="__thereIsNothingToExcludeInThisSourceButINeedAnEmptyExclude__"/> <client version="1" val1="/home/" val2="/eigenedateien/"/> <server version="1" val1="@" val2=":/home/" val3="/eigenedateien/"/> </eintrag> <eintrag bezeichnung="Mozilla Firefox"> <benutzer user1="markus" user2="maria" user3="bernard" user4="kaiserbert"/> <frage prevalue="von /home/" postvalue="/.mozilla/firefox/"/> <exclude option="--exclude" arg="__thereIsNothingToExcludeInThisSourceButINeedAnEmptyExclude__"/> <client version="1" val1="/home/" val2="/.mozilla/firefox/"/> <server version="1" val1="@" val2=":/home/" val3="/mozilla/firefox/"/> </eintrag> </gruppe> Further on my return operation in ladeEinstellungen() does not fit the variables in line: self.treeDoc, self.gruppe, self.CLIENT, self.SERVER = self.ladeEinstellungen() Any idea what is wrong? regards Markus

3 4

Declare doctype when parsing fragment
by Henrik Zagerholm 02 May '11

02 May '11

Hello list, I'm using lxml to parse and rebuild some XHTML/HTML pages. I have a problem that the parser strips out all html entities if I do not specify a doctype. I know now that I can use the load_dtd when parsing a full document but how do I do that with the fragment parser? How can I specify a DTD when using lxml.html.fragment_fromstring()? Cheers, Henrik

1 0