Thank you for the suggestion. Using the —no-native option, both the test script and my original numerical integration script run under vmprof on pypy. Kris On Mon, Nov 19, 2018 at 1:12 PM Ronan Lamy <ronan.lamy@gmail.com> wrote:

Le 17/11/18 à 15:39, Kris Kuhlman a écrit :

...

I am using pypy to run numerical integration calculations with the arbitrary precision library mpmath (http://mpmath.org).

I am using pypy2-v6.0.0-osx64 and version 1.0 of mpmath (from github). I install mpmath with pypy and use the native (python only) version; I am not using the gmp backend.

I have noticed that sometimes seemingly small changes in my scripts result in big changes in runtime with pypy, and I was wondering if there were some jit options or settings I could change to improve things. Following advice from the pypy website, I tried using vmprof to profile one of my scripts.

I installed vmprof into pypy using pip, starting with "pypy -m ensurepip".

First I tried to run one of my scripts with vmprof, which typically take <10 minutes to run, but it ran for a few hours and so I eventually killed it (it doesn't respond to ^C, so I have to put it into the background and kill it explicitly with the kill command).

Then I tried just a small test script like the following:

cat -> test.py import mpmath as mp print mp.pi ^D

This runs fine from pypy as:

$pypy test.py

...

3.14159265358979

but running this same script using vmprof and pypy as

pypy -m vmprof -o output.log test.py

uses 4GB of ram, 100% processor, and if left running will generate a output.log file of growing size (so I kill it).

If I run the following:

cat -> test2.py

x = 3.14159

print x

^D

vmprof runs quickly and generates a small output.log file (~400kb). As an aside, if I try to use the --web option, it hangs on "Uploading to http://vmprof.com..." If I try to go to this website in my browser there is an error page about bad gateway from Cloudflare.

I seem to be able to use mpmath with pypy just fine, but the combination of pypy, mpmath, and vmprof seems to not work.

Any suggestions? I am not an experienced vmprof user.

I tried your test script on Linux and everything works as expected locally. So I guess the issue is specific to OS X, or to your own system.

Try using the --no-native option, as in 'pypy -m vmprof -o output.log --no-native test.py'. That should disable most of the platform-specific code, and it doesn't lose much information on pypy anyway.

Thank you for the suggestion. Using the —no-native option, both the test script and my original numerical integration script run under vmprof on pypy. Kris On Mon, Nov 19, 2018 at 1:12 PM Ronan Lamy <ronan.lamy@gmail.com> wrote:

Le 17/11/18 à 15:39, Kris Kuhlman a écrit :

...

I am using pypy to run numerical integration calculations with the arbitrary precision library mpmath (http://mpmath.org).

I am using pypy2-v6.0.0-osx64 and version 1.0 of mpmath (from github). I install mpmath with pypy and use the native (python only) version; I am not using the gmp backend.

I have noticed that sometimes seemingly small changes in my scripts result in big changes in runtime with pypy, and I was wondering if there were some jit options or settings I could change to improve things. Following advice from the pypy website, I tried using vmprof to profile one of my scripts.

I installed vmprof into pypy using pip, starting with "pypy -m ensurepip".

First I tried to run one of my scripts with vmprof, which typically take <10 minutes to run, but it ran for a few hours and so I eventually killed it (it doesn't respond to ^C, so I have to put it into the background and kill it explicitly with the kill command).

Then I tried just a small test script like the following:

cat -> test.py import mpmath as mp print mp.pi ^D

This runs fine from pypy as:

$pypy test.py

...

3.14159265358979

but running this same script using vmprof and pypy as

pypy -m vmprof -o output.log test.py

uses 4GB of ram, 100% processor, and if left running will generate a output.log file of growing size (so I kill it).

If I run the following:

cat -> test2.py

x = 3.14159

print x

^D

vmprof runs quickly and generates a small output.log file (~400kb). As an aside, if I try to use the --web option, it hangs on "Uploading to http://vmprof.com..." If I try to go to this website in my browser there is an error page about bad gateway from Cloudflare.

I seem to be able to use mpmath with pypy just fine, but the combination of pypy, mpmath, and vmprof seems to not work.

Any suggestions? I am not an experienced vmprof user.

I tried your test script on Linux and everything works as expected locally. So I guess the issue is specific to OS X, or to your own system.

Try using the --no-native option, as in 'pypy -m vmprof -o output.log --no-native test.py'. That should disable most of the platform-specific code, and it doesn't lose much information on pypy anyway.