[pypy-dev] Scrapy fails in PyPy

[Alex Gaynor]

Out of curiosity Stefan, if we had an alternate C-API with similar methods
(e.g. PyPyList_Append or so), but different signatures and memory model,
how hard do you think it would be to have Cython support this?

Alex


On Wed, Dec 12, 2012 at 11:35 PM, Stefan Behnel <stefan_ml at behnel.de> wrote:

> Maciej Fijalkowski, 12.12.2012 20:10:
> > On Wed, Dec 12, 2012 at 7:06 PM, Joe Hillenbrand wrote:
> >> I was able to fix the issue with scrapy.
> >>
> >>
> https://github.com/joehillen/scrapy/commit/8778af5c5be50a5d746751352f8d710d1f24681c
> >>
> >> Unfortunately, scrapy takes twice as long in PyPy than in CPython. I
> suspect
> >> this is because lxml is twice as slow in PyPy vs CPython, which I found
> in
> >> lxml's benchmarks.
> >>
> >> Should lxml be added to the set of speed tests?
> >
> > no. lxml uses cpyext (CPython extension compatibility) that is and
> > will forever be slow.
>
> Well, I don't think it would be hard for any PyPy core developer to make it
> twice as fast. Shouldn't be more than a day's work.
>
> Stefan
>
>
> _______________________________________________
> pypy-dev mailing list
> pypy-dev at python.org
> http://mail.python.org/mailman/listinfo/pypy-dev
>



-- 
"I disapprove of what you say, but I will defend to the death your right to
say it." -- Evelyn Beatrice Hall (summarizing Voltaire)
"The people's good is the highest law." -- Cicero
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pypy-dev/attachments/20121212/e6e0f5d4/attachment.html>