lxml - The Python XML Toolkit

Download

lxml@python.org

October 2024

3 participants
2 discussions

Optimizing lxml for Handling Large XML Files: Tips and Experiences
by Lily Parker Oct. 30, 2024

Oct. 30, 2024

I've been using lxml to process large XML files recently, and I'm looking for ways to optimize performance. Specifically, I'm trying to filter specific nodes from large datasets and manage memory usage more effectively. I'd appreciate any tips or best practices from your experiences. Are there any techniques you use to enhance performance, or potential pitfalls I should watch out for? Thanks in advance for your insights!

2 1

GitHub lxml build scripts - helpful to others?
by abepolk＠gmail.com Oct. 9, 2024

Oct. 9, 2024

Hi all, I was interested in learning more about lxml. So, I wrote a couple of shell scripts that build lxml statically, and non-statically, and posted them on GitHub. Specifically, they are (I believe) the minimal code required to build lxml from source remotely on a freshly created Google Cloud Platform Cloud Compute VM, on a Debian Linux system. I used the documentation some. However, I had to add -fPIC in a static build command, and set the environmental variable LD_LIBRARY_PATH to use lxml when built non-statically. I also used -i and build_ext (instead of build) when building lxml statically, and this was not in the docs. My question is: would any of this help other lxml users and/or be worth putting in the documentation? Either way is fine - let me know! I'm happy to write up a PR for the docs if that's helpful too. See https://github.com/abepolk/lxml-scripts. Best, Abe Polk

1 0