Mailman 3 October 2015 - lxml - The Python XML Toolkit

[lxml-dev] lxml has its page on launchpad
by Stefan Behnel 10 Apr '23

10 Apr '23

Hi all, I added the lxml project to launchpad, the Ubuntu Bug-Tracker. It also has a FAQ engine and a couple of other goodies. https://launchpad.net/lxml It's easy to sign up for launchpad, BTW, no 90%-footnotes-contract. Have fun, Stefan

9 9

[lxml-dev] Checking whether a node is a comment/element
by Geoffrey Sneddon 09 Apr '23

09 Apr '23

Hi, What's the best way to check whether a given node is a comment or an element? For the former, I'm currently using isinstance(node, etree._Comment), which is rather obviously sub-optimal. -- Geoffrey Sneddon <http://gsnedders.com/>

6 6

[lxml-dev] Reparenting a node
by Lawrence Oluyede 30 Jan '23

30 Jan '23

I have a doc A and a doc B, I'd like to put a node extracted from A in the document B but I always get a ValueError: ValueError: Element is not a child of this node. I didn't find any "setparent" in the API. How can I do this? -- Lawrence, oluyede.org - neropercaso.it "It is difficult to get a man to understand something when his salary depends on not understanding it" - Upton Sinclair

3 2

[lxml-dev] lxml 2.0.5 released
by Stefan Behnel 11 Jan '23

11 Jan '23

Hi all, lxml 2.0.5 is on PyPI. This is a bug-fix-only release of the stable 2.0 series. Have fun, Stefan 2.0.5 (2008-05-01) Bugs fixed * Resolving to a filename in custom resolvers didn't work. * lxml did not honour libxslt's second error state "STOPPED", which let some XSLT errors pass silently. * Memory leak in Schematron with libxml2 >= 2.6.31.

3 4

[lxml-dev] Building LXML Trunk
by Sidnei da Silva 30 Aug '22

30 Aug '22

Hi, I've tried to build lxml from trunk today, on Win32. Got the following error: src\lxml\etree.c(880) : error C2059: syntax error : ')' src\lxml\etree.c(881) : error C2059: syntax error : ')' src\lxml\etree.c(882) : error C2059: syntax error : ')' src\lxml\etree.c(883) : error C2059: syntax error : ')' Any clue? Smells like a Pyrex issue? -- Sidnei da Silva Enfold Systems http://enfoldsystems.com Fax +1 832 201 8856 Office +1 713 942 2377 Ext 214

4 4

Update Install Docu on Website for OSX
by Henrik Genssen 15 Oct '15

15 Oct '15

Hi, installing on at least OS X 10.10.5 with pip 6.1.1 works the following way for me (the one on the website did not succeed): sudo pip install lxml --install-option --static-deps regards Hinnack

1 0

Re: [lxml] debugging seg fault in lxml.html.fromstring in pypy
by Jeff Doran 10 Oct '15

10 Oct '15

Some more observations on my problem: 1. My Seg Faults consistently arise from accessing the lxml.form.fields which is a FieldsDict. Even just printing the form.fields values without setting any new values will cause Seg Faults. 2. A FieldsDict inherits from collections.abc.MutableMapping. 3. Abstract Base Classes use weak references and FieldsDict has one thing in it, a weak reference. 4. I'm getting memory free'd twice errors which is what one might expect from a weak reference. 5. The memory managment and garbage collection in pypy is different from Cython and does not use reference counting. I suspect an lxml memory bug is lurking and I wish I could be more precise. - Jeff

2 2

Simple PyPy Seg Fault in lxml tests
by Jeff Doran 08 Oct '15

08 Oct '15

I'm running the lxml test suite under PyPy which I installed from here, https://bitbucket.org/squeaky/portable-pypy/downloads/pypy-2.6.1-linux_x86_… . I've downloaded the current lxml src from https://github.com/lxml/lxml. I built lxml using 'python setup.py build --with-cython' >From ..lxml/src/lxml I run: nosetests -v --pdb --nocapture Comparing with ElementTree 1.3.0 Comparing with cElementTree 1.3.0 TESTED VERSION: 3.5.0.beta1 Python: (major=2, minor=7, micro=10, releaselevel='final', serial=42) lxml.etree: (3, 5, 0, -99) libxml used: (2, 8, 0) libxml compiled: (2, 8, 0) libxslt used: (1, 1, 26) libxslt compiled: (1, 1, 26) lxml.html.tests.test_autolink.test_suite ... ok lxml.html.tests.test_basic.test_suite ... ok test_allow_tags (lxml.html.tests.test_clean.CleanerTest) ... ok test_clean_invalid_root_tag (lxml.html.tests.test_clean.CleanerTest) ... ok test_safe_attrs_excluded (lxml.html.tests.test_clean.CleanerTest) ... ok test_safe_attrs_included (lxml.html.tests.test_clean.CleanerTest) ... ok lxml.html.tests.test_clean.test_suite ... ok lxml.html.tests.test_diff.test_suite ... ok test_body (lxml.html.tests.test_elementsoup.SoupParserTestCase) ... ok test_broken_attribute (lxml.html.tests.test_elementsoup.SoupParserTestCase) ... fish: Job 1, “nosetests -v --pdb --nocapture” terminated by signal SIGSEGV (Address boundary error) ```

1 0

Seg Fault in login.form in PyPy
by Jeff Doran 07 Oct '15

07 Oct '15

I have a repeatable test to create a Segmentation Fault error using lxml.forms running under PyPy. Merely accessing the form.fields attribute is sufficient. If there is anything more I can do to help with this bug, just let me know. Thanks. - Jeff ----------------------- My test output: ----------------------- test_receipt (bias.tests.crawler.test_pacer_new.TestPacerShowReceiptProperty) ... Python : (major=2, minor=7, micro=10, releaselevel='final', serial=42) lxml.etree : (3, 5, 0, -99) libxml used : (2, 8, 0) libxml compiled : (2, 8, 0) libxslt used : (1, 1, 26) libxslt compiled : (1, 1, 26) first collection ('login_form name = $s, value = %s', 'login', '') ('login_form name = $s, value = %s', 'key', None) ('login_form name = $s, value = %s', 'clcode', None) ('login_form name = $s, value = %s', 'redaction', None) ('login_form name = $s, value = %s', 'button1', 'Login') ('login_form name = $s, value = %s', 'reset ', 'Reset') second collection fish: Job 1, “nosetests --pdb --nocapture -v -x bias” terminated by signal SIGSEGV (Address boundary error) ----------------------- My code ----------------------- def login(self, rd=None): import gc if self._logged_in: return True login_url = urljoin(self._base_url, self.LOGIN_URL) log.debug("Logging in...") login_page = self._visit(login_url) log.debug("Got login form, pausing...") login_info = html.fromstring(login_page.text) login_form = login_info.forms[0] #print ("login %s, key %s, clcode %s", self.user_name, self.user_password, self.CLIENT_CODE) print "login_form = \n%s", html.tostring(login_form, pretty_print=True) gc.collect() print "first collection" #return True # THIS WORKS form_fields = login_form.fields for field in form_fields.inputs: print ("login_form name = $s, value = %s", field.name, field.value) gc.collect() print "second collection" form_fields['login'] = self.user_name form_fields['key'] = self.user_password form_fields['clcode'] = self.CLIENT_CODE gc.collect() print "third collection" return True # THIS DOES NOT WORK ----------------------- The login form (granted it's ugly, but it's a real govt. site that works fine under CPython) ----------------------- login_form = %s <form name="GetPass" enctype="multipart/form-data" method="POST" action="/cgi-bin/login.pl">  <title></title> <basefonf size="2"><font face="arial,helvetica"> <font color="#0000cc" size="5"> <b>CM/ECF Filer or PACER Login</b> </font> <br><br><table width="100%" border="0"><tr> <td> <p><font face="arial,helvetica" size="+1"><b>Notice</b></font><br> This is a <b>Restricted Web Site</b> for Official Court Business only. Unauthorized entry is prohibited and subject to prosecution under Title 18 of the U.S. Code. All activities and access attempts are logged. </p> <p>  </p> <p><font face="arial,helvetica" size="+1"><b>Instructions for filing:</b></font><br> Enter your CM/ECF filer login and password if you are electronically filing something with the court. </p> <p> </p> <p><font face="arial,helvetica" size="+1"><b>If you received this login page as a result of a link from a Notice of Electronic Filing email:</b></font><br> Enter your CM/ECF filer login and password. The system prompts customers for a CM/ECF login and password when attempting to view certain types of documents. </p> <p> </p> <p><font face="arial,helvetica" size="+1"><b>If you have trouble viewing a document:</b></font><br> After successful entry of your CM/ECF login, you should be able to view the document. If you receive the message "You do not have permission to view this document," viewing the document is restricted to attorneys of record in the case and the system does not recognize you as such. If the login prompt appears again, after you have entered your CM/ECF login and password, it means that the "free look" link has expired. You will need to enter your PACER login and password to view the document. </p> <p> </p> <p><font face="arial,helvetica" size="+1"><b>Instructions for viewing filed documents and case information:</b></font><br> If you do not need filing capabilities, enter your PACER login and password. If you do not have a PACER login, you may register online at <a href="http://pacer.psc.uscourts.gov">http://pacer.psc.uscourts.gov.</a> </p> <p> </p> </td> </tr></table> <p> </p> <table border="0" cellpadding="6" cellspacing="0"><tr> <td bgcolor="#cccccc"> <font face="arial,helvetica" size="2"> <b>Authentication</b> </font> <table bgcolor="#ffffcc" border="0" cellpadding="4" cellspacing="0"> <tr> <td> <font face="arial,helvetica" size="2"> Login: </font> </td> <td> <input type="text" size="20" maxlength="256" name="login" onkeypress="enter_to_focus(event,document.forms[0].key)" value=""> </td> </tr> <tr> <td> <font face="arial,helvetica" size="2"> Password: </font> </td> <td> <input type="password" size="8" maxlength="8" name="key" onkeypress="enter_to_submit(event)"> </td> </tr> <tr> <td> <font face="arial,helvetica" size="2"> client code: </font> </td> <td> <input type="text" size="32" maxlength="32" name="clcode" onkeypress="enter_to_submit(event)"> </td> </tr> </table> </td> <td>  <b>IMPORTANT NOTICE OF REDACTION RESPONSIBILITY:</b> All filers must redact: Social Security or taxpayer-identification numbers; dates of birth; names of minor children; financial account numbers; and, in criminal cases, home addresses, in compliance with <a href=" http://pacer.psc.uscourts.gov/privacy/cv.html">Fed. R. Civ. P. 5.2</a> or <a href="http://pacer.psc.uscourts.gov/privacy/cr.html">Fed. R. Crim. P. 49.1</a>. This requirement applies to all documents, including attachments. <br><br><input type="CHECKBOX" name="redaction" value="on"> I understand that, if I file, I must comply with the redaction rules. I have read this notice. </td> </tr></table></font> <script language="JavaScript"> clearAllCookies(); </script><table> <td><input name="button1" value="Login" type="submit"></td> <td></td> <td><input name="reset " type="RESET" value="Reset"></td> </table></basefonf> </form>

1 0

Re: [lxml] debugging seg fault in lxml.html.fromstring in pypy
by Jeff Doran 06 Oct '15

06 Oct '15

And maybe the final observation: 6. This causes an immediate Seg Fault: login_info = html.fromstring(login_page.text) login_form = login_info.forms[0] form_fields = login_form.fields gc.collect()

1 0