0) Get the GNU software environment set up:  “module swap PrgEnv-cray PrgEnv-gnu” .  This will be necessary later.

1)  Install the Anaconda python distribution (https://store.continuum.io/cshop/anaconda/) for 64-bit Linux systems.  Refresh your path so the Anaconda python’s in your path.

2)  Download mpi4py from https://bitbucket.org/mpi4py/mpi4py/, or grab it from my home directory on Blue Waters (~bwoshea/mpi4py-1.3.1.tar.gz).

3)  Once you’ve unpacked it in your home directory, edit the file mpi.cfg, which is in the top-level mpi4py directory, and add the following chunk of text at the end of the file:

[cray]

mpicc = cc

mpicxx = CC

extra_link_args = -shared

then, in the top-level mpi4py directory, type:

python setup.py build --mpi=cray

python setp.py install

At this point, you should have a functional version of mpi4py that uses the cray MPI libraries.  

4)  You can then install yt via source in your home directory:

hg clone https://bitbucket.org/yt_analysis/yt

hg update yt

python setup.py develop

And it should work, though you’re going to need to modify your LD_LIBRARY_PATH to point to your anaconda /lib directory.  You can verify that yt and mpi4py are playing nicely together by running the scripts hw_MPI.py and yt_parallel_test.py, both of which are sitting in my home directory.  (Note that you can do this via batch script or through the interactive queue, both with aprun - you can’t just do it from the login node.)

5) and, optionally, if you want to install Rockstar using yt from source, you do the following:

hg clone http://bitbucket.org/MatthewTurk/rockstar

cd rockstar

hg pull

hg up -C tip

make lib

and *then* make a file called rockstar.cfg that has a single line of text: the path of the rockstar source code directory.  At that point, you need to run “python setup.py develop” again, and yt will recognize that rockstar has been installed and play nicely with it.  You will likely also have to modify your LD_LIBRARY_PATH to point at your rockstar directory so it can find the rockstar library (librockstar.so).