Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it. Looking forward to use pypy again and we are going to get into tech empower benchmarks . Regards Phyo. On Fri, Jun 16, 2023 at 12:10 PM Matti Picus <matti.picus@gmail.com> wrote:
PyPy v7.3.12, which includes python 2.7, 3.9, 3.10 had been released. Please try it out.
Matti _______________________________________________ pypy-dev mailing list -- pypy-dev@python.org To unsubscribe send an email to pypy-dev-leave@python.org https://mail.python.org/mailman3/lists/pypy-dev.python.org/ Member address: phyo.arkarlwin@gmail.com
On 16/6/23 09:50, Phyo Arkar Lwin wrote:
Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it.
Looking forward to use pypy again and we are going to get into tech empower benchmarks .
Regards
Phyo.
There is support in PyO3 for PyPy. Cryptography uses PyO3 and ships a PyPy wheel. Perhaps a github issue on the relevant project's repo would be a better place to discuss this. I see this litestar issue [0] points to orjson, which led me to this issue in orjson [1], which was closed by adding this to their FAQ [2]: "Will it support PyPy? Probably not." On the other hand, taht was three years ago and the maintainer did express a willingness for other contributors to work on support for PyPy. Do you know what exactly doesn't work and what is the failure? I see there is support in litestar for using alternative json libraries, and truthfully PyPy has a pretty good reader built in, and PyPy works best when it does not have to call out to non-python modules. Matti [0] https://github.com/litestar-org/litestar/issues/851 [1] https://github.com/ijl/orjson/issues/90 [2] https://github.com/ijl/orjson#will-it-support-pypy
Thanks a lot , i haven't tried with pypy with litestar 2.0-dev which we have moved to msgpack. I will test it this evening and let you know. On Fri, Jun 16, 2023 at 3:26 PM Matti Picus <matti.picus@gmail.com> wrote:
On 16/6/23 09:50, Phyo Arkar Lwin wrote:
Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it.
Looking forward to use pypy again and we are going to get into tech empower benchmarks .
Regards
Phyo.
There is support in PyO3 for PyPy. Cryptography uses PyO3 and ships a PyPy wheel. Perhaps a github issue on the relevant project's repo would be a better place to discuss this.
I see this litestar issue [0] points to orjson, which led me to this issue in orjson [1], which was closed by adding this to their FAQ [2]: "Will it support PyPy? Probably not." On the other hand, taht was three years ago and the maintainer did express a willingness for other contributors to work on support for PyPy. Do you know what exactly doesn't work and what is the failure? I see there is support in litestar for using alternative json libraries, and truthfully PyPy has a pretty good reader built in, and PyPy works best when it does not have to call out to non-python modules.
Matti
[0] https://github.com/litestar-org/litestar/issues/851
[1] https://github.com/ijl/orjson/issues/90
[2] https://github.com/ijl/orjson#will-it-support-pypy
_______________________________________________ pypy-dev mailing list -- pypy-dev@python.org To unsubscribe send an email to pypy-dev-leave@python.org https://mail.python.org/mailman3/lists/pypy-dev.python.org/ Member address: phyo.arkarlwin@gmail.com
I had tried , and it fails at msgspec dependency - which is build using gcc . I had opened a bug in their repo but it is working fine on cpython. https://github.com/jcrist/msgspec/issues/443 On Fri, Jun 16, 2023 at 3:43 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
Thanks a lot , i haven't tried with pypy with litestar 2.0-dev which we have moved to msgpack. I will test it this evening and let you know.
On Fri, Jun 16, 2023 at 3:26 PM Matti Picus <matti.picus@gmail.com> wrote:
On 16/6/23 09:50, Phyo Arkar Lwin wrote:
Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it.
Looking forward to use pypy again and we are going to get into tech empower benchmarks .
Regards
Phyo.
There is support in PyO3 for PyPy. Cryptography uses PyO3 and ships a PyPy wheel. Perhaps a github issue on the relevant project's repo would be a better place to discuss this.
I see this litestar issue [0] points to orjson, which led me to this issue in orjson [1], which was closed by adding this to their FAQ [2]: "Will it support PyPy? Probably not." On the other hand, taht was three years ago and the maintainer did express a willingness for other contributors to work on support for PyPy. Do you know what exactly doesn't work and what is the failure? I see there is support in litestar for using alternative json libraries, and truthfully PyPy has a pretty good reader built in, and PyPy works best when it does not have to call out to non-python modules.
Matti
[0] https://github.com/litestar-org/litestar/issues/851
[1] https://github.com/ijl/orjson/issues/90
[2] https://github.com/ijl/orjson#will-it-support-pypy
_______________________________________________ pypy-dev mailing list -- pypy-dev@python.org To unsubscribe send an email to pypy-dev-leave@python.org https://mail.python.org/mailman3/lists/pypy-dev.python.org/ Member address: phyo.arkarlwin@gmail.com
Unfortunately https://github.com/jcrist/msgspec/issues/22 , it dosen't support pypy. On Sat, Jun 17, 2023 at 2:56 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
I had tried , and it fails at msgspec dependency - which is build using gcc . I had opened a bug in their repo but it is working fine on cpython.
https://github.com/jcrist/msgspec/issues/443
On Fri, Jun 16, 2023 at 3:43 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
Thanks a lot , i haven't tried with pypy with litestar 2.0-dev which we have moved to msgpack. I will test it this evening and let you know.
On Fri, Jun 16, 2023 at 3:26 PM Matti Picus <matti.picus@gmail.com> wrote:
On 16/6/23 09:50, Phyo Arkar Lwin wrote:
Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it.
Looking forward to use pypy again and we are going to get into tech empower benchmarks .
Regards
Phyo.
There is support in PyO3 for PyPy. Cryptography uses PyO3 and ships a PyPy wheel. Perhaps a github issue on the relevant project's repo would be a better place to discuss this.
I see this litestar issue [0] points to orjson, which led me to this issue in orjson [1], which was closed by adding this to their FAQ [2]: "Will it support PyPy? Probably not." On the other hand, taht was three years ago and the maintainer did express a willingness for other contributors to work on support for PyPy. Do you know what exactly doesn't work and what is the failure? I see there is support in litestar for using alternative json libraries, and truthfully PyPy has a pretty good reader built in, and PyPy works best when it does not have to call out to non-python modules.
Matti
[0] https://github.com/litestar-org/litestar/issues/851
[1] https://github.com/ijl/orjson/issues/90
[2] https://github.com/ijl/orjson#will-it-support-pypy
_______________________________________________ pypy-dev mailing list -- pypy-dev@python.org To unsubscribe send an email to pypy-dev-leave@python.org https://mail.python.org/mailman3/lists/pypy-dev.python.org/ Member address: phyo.arkarlwin@gmail.com
This is not something I plan on supporting in a volunteer-only basis (if someone wanted to pay for this, I _might_ be willing to expand support).
A few reasons:
* `msgspec` is heavily tied to the CPython c-api for performance. PyPy does support a subset of the CPython c-api, but it does so in a way that is not very performant, and isn't 100% compatible. We _could_ add shims everywhere that's needed to make `msgspec` PyPy compatible, but that would muddy up the code, increasing our maintenance burden. * Due to how PyPy's c-api layer works, performance on PyPy would be worse
Sorry if it gets a bit spammy in release thread . Making separate thread via https://github.com/jcrist/msgspec/issues/22 megspec author saids : than on CPython. Whether this matters is application dependent.
* CPython is getting faster, reducing the advantages of PyPy * Other "fast" libraries (e.g. asyncpg, orjson, ...) also don't support PyPy, and people generally seem fine with that.
Due to how PyPy's c-api layer works, performance on PyPy would be worse
Some of the author's claims seem to be outdated. Since information regarding pypy is a bit outdated can you chime in a bit. For example than on CPython. Whether this matters is application dependent. I think that has improved a lot in the past year right?
PyPy does support a subset of the CPython c-api, b
If we know which parts are missing , can those be supported by pypy? Regards, Phyo. On Sat, Jun 17, 2023 at 3:20 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
Unfortunately https://github.com/jcrist/msgspec/issues/22 , it dosen't support pypy.
On Sat, Jun 17, 2023 at 2:56 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
I had tried , and it fails at msgspec dependency - which is build using gcc . I had opened a bug in their repo but it is working fine on cpython.
https://github.com/jcrist/msgspec/issues/443
On Fri, Jun 16, 2023 at 3:43 PM Phyo Arkar Lwin <phyoakl@hexcode.tech> wrote:
Thanks a lot , i haven't tried with pypy with litestar 2.0-dev which we have moved to msgpack. I will test it this evening and let you know.
On Fri, Jun 16, 2023 at 3:26 PM Matti Picus <matti.picus@gmail.com> wrote:
On 16/6/23 09:50, Phyo Arkar Lwin wrote:
Hi guys , grats! Long time i haven't use pypy. Question , does pypy support pyo3 now ? There are a lot of rust-python binded libs now and i cannot use them , when i tried last year. I am contribution to development of litestar framework which use rusted python libs , which i coin't get pypy to run with it.
Looking forward to use pypy again and we are going to get into tech empower benchmarks .
Regards
Phyo.
There is support in PyO3 for PyPy. Cryptography uses PyO3 and ships a PyPy wheel. Perhaps a github issue on the relevant project's repo would be a better place to discuss this.
I see this litestar issue [0] points to orjson, which led me to this issue in orjson [1], which was closed by adding this to their FAQ [2]: "Will it support PyPy? Probably not." On the other hand, taht was three years ago and the maintainer did express a willingness for other contributors to work on support for PyPy. Do you know what exactly doesn't work and what is the failure? I see there is support in litestar for using alternative json libraries, and truthfully PyPy has a pretty good reader built in, and PyPy works best when it does not have to call out to non-python modules.
Matti
[0] https://github.com/litestar-org/litestar/issues/851
[1] https://github.com/ijl/orjson/issues/90
[2] https://github.com/ijl/orjson#will-it-support-pypy
_______________________________________________ pypy-dev mailing list -- pypy-dev@python.org To unsubscribe send an email to pypy-dev-leave@python.org https://mail.python.org/mailman3/lists/pypy-dev.python.org/ Member address: phyo.arkarlwin@gmail.com
participants (2)
-
Matti Picus -
Phyo Arkar Lwin