Mailman 3 July 2023 - lxml - The Python XML Toolkit

Re: Schematron schema license issue
by Holger.Joukl＠LBBW.de July 12, 2023

July 12, 2023

Hi, > [...] > A bug was filed a while back by the SUSE Python stack maintainer for this problem[4], but there hasn't been any activity there. > > Basically, has anyone looked into this yet to see if the issue can be resolved? I would really like to have the schematron stuff > back in lxml in Fedora/RHEL and would rather not have it stripped from SUSE distributions too. > Really unfortunate. > [...] > [4] https://bugs.launchpad.net/lxml/+bug/2024343 Commented on the issue[4] but not of much help, I fear. :-( Best, Holger Landesbank Baden-Wuerttemberg Anstalt des oeffentlichen Rechts Hauptsitze: Stuttgart, Karlsruhe, Mannheim, Mainz HRA 12704 Amtsgericht Stuttgart HRA 4356, HRA 104 440 Amtsgericht Mannheim HRA 40687 Amtsgericht Mainz Die LBBW verarbeitet gemaess Erfordernissen der DSGVO Ihre personenbezogenen Daten. Informationen finden Sie unter https://www.lbbw.de/datenschutz.

1 0

Schematron schema license issue
by Neal Gompa July 11, 2023

July 11, 2023

Hey folks, I come from the kiwi project, where we recently encountered that we could no longer use schematron from lxml in Fedora. Some digging led to the identification that it was stripped from Fedora[1] and RHEL[2] due to the license being unclear and potentially non-Free[3]. A bug was filed a while back by the SUSE Python stack maintainer for this problem[4], but there hasn't been any activity there. Basically, has anyone looked into this yet to see if the issue can be resolved? I would really like to have the schematron stuff back in lxml in Fedora/RHEL and would rather not have it stripped from SUSE distributions too. Thanks in advance and best regards, Neal [1]: https://src.fedoraproject.org/rpms/python-lxml/c/9d95f5a04edc386313fa854541… [2]: https://gitlab.com/redhat/centos-stream/rpms/python3.11-lxml/-/commit/7f6d5… [3]: https://gitlab.com/fedora/legal/fedora-license-data/-/issues/154 [4]: https://bugs.launchpad.net/lxml/+bug/2024343 -- 真実はいつも一つ！/ Always, there's only one truth!

1 0

Time-out? Wrong code?
by codecomplete＠free.fr July 9, 2023

July 9, 2023

Hello, I'm no lxml expert, so it could be a newbie error…but the following web scrawler script sometimes breaks (see "BUG") while trying to find the number of provinces/properties, even after two one-second sleeps: ========== import requests from lxml import html import re import math import time def grab_properties(): properties = soup.xpath("//div[contains(@class,'gallery')]/a/@href") for property in properties: print(property) response = requests.get(property) coords = pattern_coords.search(response.text) #raw HTML since data in JSON if coords: lat,lon=coords.group(1),coords.group(2) print(f"{lat}\t{lon}") pattern_count = re.compile("(\d+) Propertie") #ignore trailing s for singular/plural pattern_coords = re.compile("latitude:(.+?),longitude:([^}]+)") #JSON provinces = ["a", "b", "c"] for province in provinces: time.sleep(1) #added but still no cigar url = f"https://www.acme.com/{province}/" print("======== ",url) response = requests.get(url) soup = html.fromstring(response.text) #BUG time-out? count = soup.xpath("//div[contains(@class,'properties-count')]/text()") print(count) count = pattern_count.search(count[0]) if count: print("Number of locations:",count) locations = soup.xpath("//div[contains(@class,'other-location-box')]/a/@href") for location in locations: time.sleep(1) #added but still no cigar print(location) response = requests.get(location) soup = html.fromstring(response.text) #BUG time-out? count = soup.xpath("//div[contains(@class,'properties-count')]/text()") print(count) count = pattern_count.search(count[0]) if not count: print("Number of properties not found") break #next location else: print("Number of properties found",count.group(1)) #grab what's in current, first page grab_properties() #If > 30, must update URL and loop through pages by groups of 30 count = int(count.group(1)) for index in range (2,math.ceil(count/30)+1): time.sleep(1) #added but still no cigar url = f"{location}p/{index}/" #new URL response = requests.get(url) soup = html.fromstring(response.text) grab_properties() ========== Am I using the wrong syntax to grab the numbers? Thank you.

2 2

lxml children vs. descendant not working correctly (I think)
by wayneb＠mac.com July 2, 2023

July 2, 2023

Here's a bit of code I was trying to parse: <div data-flag="TODO"> <p>This content is flagged as <code>TODO</code>. It gets a background colour (red, in this case) and the label <code>TODO</code> is rendered into the document margin.</p> </div> I was using .//div/child::* What I got back was a list of three items: <p><code><code> those aren't the children of div! Those are the descendant elements of div. I decided to test this using .//div/descendant::* which gave me the proper: <p><code><code> elements. To further confirm this I used other parsers and they provided the proper child (p in this case). How do we go about getting this fixed in lxml?

2 1