Mailman 3 December 2013 - lxml - The Python XML Toolkit

iterparse with HTML
by Moritz Emanuel Beber 20 Dec '13

20 Dec '13

Dear list, The last message concerning this issue was in 2011: http://comments.gmane.org/gmane.comp.python.lxml.devel/6235 Using lxml version 3.2.4 the etree.iterparse still does not use recovery mode even when the argument html=True is passed. So I assume nothing has changed since then? Best, Moritz

2 10

lxml.etree.XMLSyntaxError: Char 0x0 out of allowed range...
by Jose Soares 19 Dec '13

19 Dec '13

Hi all, I don't know if I found a bug because I got the following message: tree = etree.fromstringlist(result) File "lxml.etree.pyx", line 2763, in lxml.etree.fromstringlist (src/lxml/lxml.etree.c:52950) File "parser.pxi", line 1166, in lxml.etree._FeedParser.close (src/lxml/lxml.etree.c:76950) File "parser.pxi", line 556, in lxml.etree._ParserContext._handleParseResult (src/lxml/lxml.etree.c:71680) File "parser.pxi", line 645, in lxml.etree._handleParseResult (src/lxml/lxml.etree.c:72614) File "parser.pxi", line 585, in lxml.etree._raiseParseError (src/lxml/lxml.etree.c:71955) lxml.etree.XMLSyntaxError: Char 0x0 out of allowed range, line 1, column 3 the variable result contains the following (I can't see any strange character here): <?xml version="1.0" encoding="UTF-8"?><RISPOSTA><HEADER><ESECUTORE>DB LOCALE</ESECUTORE><SERVIZIO>Ricerca impresa per codice fiscale</SERVIZIO><ESITO>OK</ESITO></HEADER><DATI><LISTA_IMPRESE totale="1"><ESTREMI_IMPRESA elemento="1"><DENOMINAZIONE>PIPPO SOCIETA' AGRICOLA</DENOMINAZIONE><CODICE_FISCALE>022</CODICE_FISCALE><PARTITA_IVA>022</PARTITA_IVA><FORMA_GIURIDICA><C_FORMA_GIURIDICA>SE</C_FORMA_GIURIDICA><DESCRIZIONE>SOCIETA' SEMPLICE</DESCRIZIONE></FORMA_GIURIDICA><DATI_ISCRIZIONE_RI><NUMERO_RI>20049349</NUMERO_RI><DATA>20040401</DATA><SEZIONI><SEZIONE><C_SEZIONE>S</C_SEZIONE><DESCRIZIONE>SOCIETA SEMPLICE</DESCRIZIONE><DT_ISCRIZIONE>20040401</DT_ISCRIZIONE></SEZIONE><SEZIONE><C_SEZIONE>G</C_SEZIONE><DESCRIZIONE>IMPRESA AGRICOLA</DESCRIZIONE><DT_ISCRIZIONE>20040401</DT_ISCRIZIONE></SEZIONE></SEZIONI></DATI_ISCRIZIONE_RI><DATI_ISCRIZIONE_REA><NREA>226863</NREA><CCIAA>PR</CCIAA><FLAG_SEDE>SI</FLAG_SEDE><DATA>20040331</DATA><DT_ULT_AGGIORNAMENTO>20121123</DT_ULT_AGGIORNAMENTO><C_FONTE>RI</C_FONTE></DATI_ISCRIZIONE_REA></ESTREMI_IMPRESA></LISTA_IMPRESE></DATI></RISPOSTA> Thanks for any help os: Linux dev 2.6.32-5-amd64 #1 SMP Thu Nov 3 03:41:26 UTC 2011 x86_64 GNU/Linux lxml version: lxml-2.3.3-py2.6-linux-x86_64.egg j

3 4

Charset issue with etree
by Alexandre Delanoë 16 Dec '13

16 Dec '13

Hello, parsing HTML files with etree.HTMLParser is just fine for UTF-8 files saved from my Linux OS. But for ISO-8859-2 files saved from others OS, I get a charset issue. I have to convert files into utf-8 with such command : "iconv -f latin1 -t utf8". I would like to do it only with Python. Do you already have a function to detect encoding and change it automatically ? Something like: ------------------------------------------------------------------------ import chardet import glob files = glob.glob('*html') for filename in files: encoding = chardet.detect(filename)['encoding'] if encoding != 'utf-8': filename.decode(encoding,'replace').encode('utf-8') ------------------------------------------------------------------------ Since the last line of the example above is not resolving my issue do you have some good practices to advice, maybe specific to lxml ? I have seen some links on the web but I can hardly find a nice solution for such issue. Thanks for your help, -- Alexandre Delanoë

2 3

lxml 3.3.0 beta 1 released
by Stefan Behnel 12 Dec '13

12 Dec '13

Hi all, I just released the first beta of lxml 3.3.0. I consider it pretty much ready, so the final release shouldn't wait too long. Please give it all the testing you can afford, especially for the new iterparse() code. The documentation is here: http://lxml.de/ Download: http://lxml.de/files/lxml-3.3.0beta1.tgz Signature: http://lxml.de/files/lxml-3.3.0beta1.tgz.asc Changelog: http://lxml.de/3.3/changes-3.3.0beta1.html Github: https://github.com/lxml/lxml/commit/91f5e8b3c7bbc3051cb78d242a63164c1f2e38ba This release was built using Cython 0.19.2. If you are interested in commercial support or customisations for the lxml package, please contact me directly. Have fun, Stefan 3.3.0beta1 (2013-12-12) ======================= Features added -------------- * New option ``handle_failures`` in ``make_links_absolute()`` and ``resolve_base_href()`` (lxml.html) that enables ignoring or discarding links that fail to parse as URLs. * New parser classes ``XMLPullParser`` and ``HTMLPullParser`` for incremental parsing, as implemented for ElementTree in Python 3.4. Bugs fixed ---------- * LP#1255132: crash when trying to run validation over non-Element (e.g. comment or PI). * Error messages in the log and in exception messages that originated from libxml2 could accidentally be picked up from preceding warnings instead of the actual error. * The ``ElementMaker`` in lxml.objectify did not accept a dict as argument for adding attributes to the element it's building. This works as in lxml.builder now. * LP#1228881: ``repr(XSLTAccessControl)`` failed in Python 3. * Raise ``ValueError`` when trying to append an Element to itself or to one of its own descendants, instead of running into an infinite loop. * LP#1206077: htmldiff discarded whitespace from the output. * Compressed plain-text serialisation to file-like objects was broken. * lxml.html.formfill: Fix textarea form filling. The textarea used to be cleared before the new content was set, which removed the name attribute. Other changes ------------- * Some basic API classes use freelists internally for faster instantiation. This can speed up some ``iterparse()`` scenarios, for example. * ``iterparse()`` was rewritten to use the new ``*PullParser`` classes internally.

1 0