Mailman 3 October 2011 - lxml - The Python XML Toolkit

Re: [lxml] 回复： install lxml
by Stefan Behnel Oct. 24, 2011

Oct. 24, 2011

水静流深, 24.10.2011 07:31: > The latest version is lxml 2.3.1, released 2011-09-25, > 1.download it > 2.extract it ,put it in the /home/user/Python-3.2.2/libxml2-2.7.8 > 3.cd /home/user/Python-3.2.2/libxml2-2.7.8 > 4. ./configure > 5.make > 6.sudo make install Not libxml2. lxml. > when i finished > ~$ python3.2 > Python 3.2.2 (default, Oct 24 2011, 10:33:35) > [GCC 4.5.2] on linux2 > Type "help", "copyright", "credits" or "license" for more information. >>>> import lxml > Traceback (most recent call last): > File "<stdin>", line 1, in<module> > ImportError: No module named lxml > > there is still the problem!! You can get a binary build for Windows from PyPI: http://pypi.python.org/pypi/lxml/2.3 Stefan

1 0

Re: [lxml] getroot() problem
by Stefan Behnel Oct. 24, 2011

Oct. 24, 2011

水静流深, 24.10.2011 03:06: > there is no problem to parse : > > http://finance.yahoo.com/q/op?s=A+Options' > > why i can not parse > > http://frux.wikispaces.com/ ?? > > IOError: Error reading file 'b'http://frux.wikispaces.com/'': b'failed to load e > xternal entity "http://frux.wikispaces.com/"' Maybe a network problem on your side? Can you open that page in a browser? Stefan

1 0

Re: [lxml] python32 +lxml to parse html
by Stefan Behnel Oct. 24, 2011

Oct. 24, 2011

水静流深, 24.10.2011 02:33: > code 1 can run in python2.6 > code1 is the following > #coding:utf-8 > import urllib > import lxml.html > down='http://frux.wikispaces.com/' > root=urllib.urlopen(down).read() > root=lxml.html.fromstring(root) > file=root.xpath('//a') > for i in file: > str1=i.text_content() > if str1.find('pdf')>-1 : > str2='http://frux.wikispaces.com/file/view/'+str1 > print str2 > > i usr command : 2to3-3.2 ~/xml.py -w to get code2 > code2 is the following > #coding:utf-8 > import urllib.request, urllib.parse, urllib.error > import lxml.html > down='http://frux.wikispaces.com/' > root=urllib.request.urlopen(down).read() > root=lxml.html.fromstring(root) > file=root.xpath('//a') > for i in file: > str1=i.text_content() > if str1.find('pdf')>-1 : > str2='http://frux.wikispaces.com/file/view/'+str1 > print(str2) > > what is the matter? I don't know. Maybe you want to tell us? Is there a problem with the above? Is there anything not working? Do you get an error message? Is this related to your other e-mail about the network access problem? Stefan

1 0

回复： install lxml
by 水静流深 Oct. 24, 2011

Oct. 24, 2011

The latest version is lxml 2.3.1, released 2011-09-25, 1.download it 2.extract it ,put it in the /home/user/Python-3.2.2/libxml2-2.7.8 3.cd /home/user/Python-3.2.2/libxml2-2.7.8 4. ./configure 5.make 6.sudo make install when i finished ~$ python3.2 Python 3.2.2 (default, Oct 24 2011, 10:33:35) [GCC 4.5.2] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import lxml Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: No module named lxml there is still the problem!! ------------------ 原始邮件 ------------------ 发件人: "Terry Reedy"<tjreedy(a)udel.edu>; 发送时间: 2011年10月24日(星期一) 中午12:58 收件人: "python-list"<python-list(a)python.org>; 抄送: "lxml"<lxml(a)lxml.de>; 主题: Re: install lxml On 10/24/2011 12:02 AM, 水静流深 wrote: > there are two python versions in my computer, > python2.7 is the default,python3.2 is the second install. > for python2.7 > ~$python > Python 2.7.1+ (r271:86832, Apr 11 2011, 18:05:24) > [GCC 4.5.2] on linux2 > Type "help", "copyright", "credits" or "license" for more information. > >>> import lxml > >>> > > for python3.2 > ~$python3.2 > Python 3.2.2 (default, Oct 24 2011, 10:33:35) > [GCC 4.5.2] on linux2 > Type "help", "copyright", "credits" or "license" for more information. > >>> import lxml > Traceback (most recent call last): > File "<stdin>", line 1, in <module> > ImportError: No module named lxml > > i want to install lxml in python3.2. > how can i do? Put a 3.2 version of lxml in the 3.2 Lib/site-packages directory. -- Terry Jan Reedy -- http://mail.python.org/mailman/listinfo/python-list

1 0

回复： getroot() problem
by 水静流深 Oct. 23, 2011

Oct. 23, 2011

in my computer,there two os , 1.xp+python32 import lxml.html sfile='http://finance.yahoo.com/q/op?s=A+Options' root=lxml.html.parse(sfile).getroot() it is ok import lxml.html sfile='http://frux.wikispaces.com/' root=lxml.html.parse(sfile).getroot() there is problem Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Python32\lib\site-packages\lxml\html\__init__.py", line 692, in parse return etree.parse(filename_or_url, parser, base_url=base_url, **kw) File "lxml.etree.pyx", line 2942, in lxml.etree.parse (src/lxml/lxml.etree.c:5 4187) File "parser.pxi", line 1528, in lxml.etree._parseDocument (src/lxml/lxml.etre e.c:79485) File "parser.pxi", line 1557, in lxml.etree._parseDocumentFromURL (src/lxml/lx ml.etree.c:79768) File "parser.pxi", line 1457, in lxml.etree._parseDocFromFile (src/lxml/lxml.e tree.c:78843) File "parser.pxi", line 997, in lxml.etree._BaseParser._parseDocFromFile (src/ lxml/lxml.etree.c:75698) File "parser.pxi", line 564, in lxml.etree._ParserContext._handleParseResultDo c (src/lxml/lxml.etree.c:71739) File "parser.pxi", line 645, in lxml.etree._handleParseResult (src/lxml/lxml.e tree.c:72614) File "parser.pxi", line 583, in lxml.etree._raiseParseError (src/lxml/lxml.etr ee.c:71927) IOError: Error reading file 'b'http://frux.wikispaces.com/'': b'failed to load e xternal entity "http://frux.wikispaces.com/"' 2. ubuntu11.04+python2.6 import lxml.html sfile='http://frux.wikispaces.com/' root=lxml.html.parse(sfile).getroot() it is ok it is so strange thing for me to understand ------------------ 原始邮件 ------------------ 发件人: "Dave Angel"<d(a)davea.name>; 发送时间: 2011年10月24日(星期一) 上午9:22 收件人: "1248283536"<1248283536(a)qq.com>; 抄送: "lxml"<lxml(a)lxml.de>; "python-list"<python-list(a)python.org>; 主题: Re: getroot() problem On 10/23/2011 09:06 PM, 水静流深 wrote: > C:\Documents and Settings\peng>cd c:\python32 > > > > C:\Python32>python > > Python 3.2.2 (default, Sep 4 2011, 09:51:08) [MSC v.1500 32 bit (Intel)] on win > > 32 > > Type "help", "copyright", "credits" or "license" for more information. > >>>> import lxml.html > >>>> sfile='http://finance.yahoo.com/q/op?s=A+Options' > >>>> root=lxml.html.parse(sfile).getroot() > there is no problem to parse : > > > http://finance.yahoo.com/q/op?s=A+Options' > > > > > why i can not parse > > http://frux.wikispaces.com/ ?? > >>>> import lxml.html > >>>> sfile='http://frux.wikispaces.com/' > >>>> root=lxml.html.parse(sfile).getroot() > > Traceback (most recent call last): > > File "<stdin>", line 1, in<module> > > File "C:\Python32\lib\site-packages\lxml\html\__init__.py", line 692, in parse > > > > return etree.parse(filename_or_url, parser, base_url=base_url, **kw) > > File "lxml.etree.pyx", line 2942, in lxml.etree.parse (src/lxml/lxml.etree.c:5 > > 4187) > > File "parser.pxi", line 1528, in lxml.etree._parseDocument (src/lxml/lxml.etre > > e.c:79485) > > File "parser.pxi", line 1557, in lxml.etree._parseDocumentFromURL (src/lxml/lx > > ml.etree.c:79768) > > File "parser.pxi", line 1457, in lxml.etree._parseDocFromFile (src/lxml/lxml.e > > tree.c:78843) > > File "parser.pxi", line 997, in lxml.etree._BaseParser._parseDocFromFile (src/ > > lxml/lxml.etree.c:75698) > > File "parser.pxi", line 564, in lxml.etree._ParserContext._handleParseResultDo > > c (src/lxml/lxml.etree.c:71739) > > File "parser.pxi", line 645, in lxml.etree._handleParseResult (src/lxml/lxml.e > > tree.c:72614) > > File "parser.pxi", line 583, in lxml.etree._raiseParseError (src/lxml/lxml.etr > > ee.c:71927) > > IOError: Error reading file 'b'http://frux.wikispaces.com/'': b'failed to load e > > xternal entity "http://frux.wikispaces.com/"' > >>> > Double-spacing makes your message much harder to read. I can only comment in a general way, in any case. most html is mal-formed, and not legal html. Although I don't have any experience with parsing it, I do with xml which has similar problems. The first thing I'd do is to separate the loading of the byte string from the website, from the parsing of those bytes. Further, I'd make a local copy of those bytes, so you can do testing repeatably. For example, you could run wget utility to copy the bytes locally and create a file. -- DaveA

1 0

install lxml
by 水静流深 Oct. 23, 2011

Oct. 23, 2011

there are two python versions in my computer, python2.7 is the default,python3.2 is the second install. for python2.7 ~$python Python 2.7.1+ (r271:86832, Apr 11 2011, 18:05:24) [GCC 4.5.2] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import lxml >>> for python3.2 ~$python3.2 Python 3.2.2 (default, Oct 24 2011, 10:33:35) [GCC 4.5.2] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> import lxml Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: No module named lxml i want to install lxml in python3.2. how can i do?

1 0

the problem to install lxml in xp+python27?
by 水静流深 Oct. 23, 2011

Oct. 23, 2011

C:\Python27>cd c:\python27\scripts C:\Python27\Scripts>easy_install --allow-hosts=lxml.de,*.python.org lxml==2.2.2 Searching for lxml==2.2.2 Reading http://pypi.python.org/simple/lxml/ Link to http://codespeak.net/lxml ***BLOCKED*** by --allow-hosts Reading http://lxml.de/ Link to http://codespeak.net/svn/lxml/branch/lxml-1.2#egg=lxml-1.2bugfix ***BLOC KED*** by --allow-hosts Link to https://github.com/lxml/lxml/tarball/master#egg=lxml-dev ***BLOCKED*** b y --allow-hosts Link to https://github.com/lxml/lxml/tarball/lxml-2.3#egg=lxml-2.3bugfix ***BLOC KED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/branch/lxml-1.3#egg=lxml-1.3bugfix ***BLOC KED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/branch/lxml-2.2#egg=lxml-2.2bugfix ***BLOC KED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/branch/lxml-2.0#egg=lxml-2.0bugfix ***BLOC KED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/branch/lxml-1.1#egg=lxml-1.1bugfix ***BLOC KED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/branch/lxml-2.1#egg=lxml-2.1bugfix ***BLOC KED*** by --allow-hosts Link to https://github.com/lxml/lxml-maintenance/tarball/lxml-2.2#egg=lxml-2.2bu gfix ***BLOCKED*** by --allow-hosts Link to http://codespeak.net/svn/lxml/trunk#egg=lxml-dev ***BLOCKED*** by --allo w-hosts Best match: lxml 2.2.2 Downloading http://lxml.de/files/lxml-2.2.2.tgz Processing lxml-2.2.2.tgz Running lxml-2.2.2\setup.py -q bdist_egg --dist-dir c:\docume~1\peng\locals~1\te mp\easy_install-0atz4j\lxml-2.2.2\egg-dist-tmp-7iodda Building lxml version 2.2.2. NOTE: Trying to build without Cython, pre-generated 'src/lxml/lxml.etree.c' need s to be available. ERROR: 'xslt-config' 不是内部或外部命令，也不是可运行的程序或批处理文件。 ** make sure the development packages of libxml2 and libxslt are installed ** Using build configuration of libxslt warning: no files found matching 'lxml.etree.c' under directory 'src\lxml' warning: no files found matching 'lxml.objectify.c' under directory 'src\lxml' warning: no files found matching 'lxml.etree.h' under directory 'src\lxml' warning: no files found matching 'lxml.etree_api.h' under directory 'src\lxml' warning: no files found matching 'etree_defs.h' under directory 'src\lxml' warning: no files found matching 'pubkey.asc' under directory 'doc' warning: no files found matching 'tagpython*.png' under directory 'doc' error: Setup script exited with error: Unable to find vcvarsall.bat

1 0

getroot() problem
by 水静流深 Oct. 23, 2011

Oct. 23, 2011

C:\Documents and Settings\peng>cd c:\python32 C:\Python32>python Python 3.2.2 (default, Sep 4 2011, 09:51:08) [MSC v.1500 32 bit (Intel)] on win 32 Type "help", "copyright", "credits" or "license" for more information. >>> import lxml.html >>> sfile='http://finance.yahoo.com/q/op?s=A+Options' >>> root=lxml.html.parse(sfile).getroot() there is no problem to parse : http://finance.yahoo.com/q/op?s=A+Options' why i can not parse http://frux.wikispaces.com/ ?? >>> import lxml.html >>> sfile='http://frux.wikispaces.com/' >>> root=lxml.html.parse(sfile).getroot() Traceback (most recent call last): File "<stdin>", line 1, in <module> File "C:\Python32\lib\site-packages\lxml\html\__init__.py", line 692, in parse return etree.parse(filename_or_url, parser, base_url=base_url, **kw) File "lxml.etree.pyx", line 2942, in lxml.etree.parse (src/lxml/lxml.etree.c:5 4187) File "parser.pxi", line 1528, in lxml.etree._parseDocument (src/lxml/lxml.etre e.c:79485) File "parser.pxi", line 1557, in lxml.etree._parseDocumentFromURL (src/lxml/lx ml.etree.c:79768) File "parser.pxi", line 1457, in lxml.etree._parseDocFromFile (src/lxml/lxml.e tree.c:78843) File "parser.pxi", line 997, in lxml.etree._BaseParser._parseDocFromFile (src/ lxml/lxml.etree.c:75698) File "parser.pxi", line 564, in lxml.etree._ParserContext._handleParseResultDo c (src/lxml/lxml.etree.c:71739) File "parser.pxi", line 645, in lxml.etree._handleParseResult (src/lxml/lxml.e tree.c:72614) File "parser.pxi", line 583, in lxml.etree._raiseParseError (src/lxml/lxml.etr ee.c:71927) IOError: Error reading file 'b'http://frux.wikispaces.com/'': b'failed to load e xternal entity "http://frux.wikispaces.com/"' >>>

1 0

python32 +lxml to parse html
by 水静流深 Oct. 23, 2011

Oct. 23, 2011

code 1 can run in python2.6 code1 is the following #coding:utf-8 import urllib import lxml.html down='http://frux.wikispaces.com/' root=urllib.urlopen(down).read() root=lxml.html.fromstring(root) file=root.xpath('//a') for i in file: str1=i.text_content() if str1.find('pdf') >-1 : str2='http://frux.wikispaces.com/file/view/'+str1 print str2 i usr command : 2to3-3.2 ~/xml.py -w to get code2 code2 is the following #coding:utf-8 import urllib.request, urllib.parse, urllib.error import lxml.html down='http://frux.wikispaces.com/' root=urllib.request.urlopen(down).read() root=lxml.html.fromstring(root) file=root.xpath('//a') for i in file: str1=i.text_content() if str1.find('pdf') >-1 : str2='http://frux.wikispaces.com/file/view/'+str1 print(str2) what is the matter?

1 0

status mac binaries for 2.3.1
by "Pascal Oberndörfer" Oct. 18, 2011

Oct. 18, 2011

Gents, Just a short note, that I will gladly supply the mac binaries again. But unfortunately I won't have access to my "build machine" before first week of December. So unless somebody else steps in, I'll have to ask for some patience. Thanks! Pascal

1 0