Mailman 3 November 2008 - lxml - The Python XML Toolkit

[lxml-dev] lxml XSD Schema validation problem
by Richard Smith 06 Nov '08

06 Nov '08

Hi guys, I'm getting an error using the lxml objectification API and XSD Validation. Am using lxml and from distribution on standard hardy lib versions. Here's the boilerplate version info from the FAQ: lxml.etree: (2, 1, 2, 0) libxml used: (2, 6, 31) libxml compiled: (2, 6, 31) libxslt used: (1, 1, 22) libxslt compiled: (1, 1, 22) The code I'm testing with is as follows: ############################ >8 ############################ #!/usr/bin/python from lxml import objectify from lxml import etree SCHEMA_FILE = 'nvdcve.xsd' DATA_FILE = 'nvdcve-recent.xml' schema_file = open(SCHEMA_FILE) data_file = open(DATA_FILE) schema = etree.XMLSchema(file=schema_file) parser = objectify.makeparser(schema=schema) tree = objectify.parse(data_file, parser) ############################ 8< ############################ The XSD I'm validating against is the XSD provided by NIST for CVE posts and the XML doc is the recent NVDs: http://nvd.nist.gov/schema/nvdcve.xsd http://nvd.nist.gov/download/nvdcve-recent.xml The error I'm getting from lxml is: lxml.etree.XMLSyntaxError: Element '{http://nvd.nist.gov/feeds/cve/1.2}ref', attribute 'url': [facet 'pattern'] The value 'http://www.securitytracker.com/id?1021107' is not accepted by the pattern '(news|(ht|f)tp(s)?)://.+'. The problem is that on every implementation of regex patterns I can think of (Python, Perl, egrep etc) the regex validates... Indeed on my win32 xml editors (LiquidXML and OxygenXML) the data validates with no problems. $ egrep "(news|(ht|f)tp(s)?)://.+" nvdcve-recent.xml | wc -l 497 pcretest comes back fine too: $ pcretest PCRE version 7.4 2007-09-21 re> #(news|(ht|f)tp(s)?)://.+# data> http://www.securitytracker.com/id?1021107 0: http://www.securitytracker.com/id?1021107 1: http 2: ht Is this a libxml2 problem, my code or, dare I say, an evil bug? Thanks -- Richard

2 2

[lxml-dev] lxml Mac installation idea
by Ian Bicking 04 Nov '08

04 Nov '08

So... I hear that lxml installs better on a Mac if it's built along with libxml2/libxslt. That's not what everyone would do, so I was unclear how to enable something like that, and if setup.py would be the right place. A number of attempts to get stuff setup have been tried before external to lxml (like buildouts and now staticlxml). While it's kind of lame, I wonder if enabling this static installation via an environmental variable would be reasonable? It would be easier to apply in a number of circumstances. I imagine it would mean something like, on installation, if a variable like LXML_INSTALL_STATIC (or INSTALL_LIBXML2 or something) was set, it'd download the libxml2 and libxslt libraries, run configure/make/make install with a prefix inside the lxml source directory itself, then build lxml using that library. Another option would be simply a different tarball that contains the libxml2/libxslt source, and its setup.py would always build those. It could be versioned like 2.1static or something, which should keep it from being implicitly used by easy_install, etc. (since 2.1static is considered an earlier version than 2.1). This might be more reasonable? staticlxml is kind of weird, because installing staticlxml installs lxml, which can confuse tools. Maybe the two versions could be arranged with some svn:externals, or just as a build script of some sort (e.g., drop a marker file in the source to make it "static", and have setup.py look for that file and change the sdist/install commands appropriately). One nuisance with any attempt to fix this is that I don't think either myself nor Stefan have ready access to a Mac to test this stuff... are there any Macs we can ssh into for testing? (Obviously patches are also welcome, but this Mac thing has caused so many support problems for me that I really want to get it resolved.) -- Ian Bicking : ianb(a)colorstudy.com : http://blog.ianbicking.org

5 8

Re: [lxml-dev] [XML-SIG] Messages when installing xml
by Stefan Behnel 03 Nov '08

03 Nov '08

Hi, first of all: is there any reason you are not using the latest binary packages of lxml 2.1? Also: the mailing list of lxml is a better place to ask these questions than the more general XML-SIG list. Colin J. Williams wrote: > The log of my install is below: > > Building lxml version 2.2.alpha1-59220. > Building with Cython 0.9.8.1.1. > ERROR: 'xslt-config' is not recognized as an internal or external command, > operable program or batch file. > > ** make sure the development packages of libxml2 and libxslt are installed ** You need to install libxml2 and libxslt and add the xslt-config script that ships with libxslt to your program search path when building lxml. > [...] > building 'lxml.etree' extension > C:\MinGW\bin\gcc.exe -mno-cygwin -mdll -O -Wall -IC:\python25\include > -IC:\python25\PC -c src/lxml\lxml.etree.c -o > build\temp.win32-2.5\Release\src\lxml\lxml.etree.o -w It's generally recommended to build lxml statically against libxml2/libxslt on Windows. There are some build instructions on the web page. Stefan

1 0