[Neuroimaging] ANN: Cloudknot 0.1

Ariel Rokem arokem at gmail.com
Fri Nov 17 11:19:52 EST 2017


Hi everyone,

Not a neuroimaging-specific tool, but might still be of interest to folks
on this list: we are happy to announce the first release of *Cloudknot*, a
software library that makes it easy to run your existing Python code at
scale using AWS Batch.

Documentation is here: https://richford.github.io/cloudknot/

The source code is available on Github: https://github.com/ric
hford/cloudknot

And there are few example use-cases (including analysis of MRI data!) here:
https://github.com/richford/cloudknot/tree/master/examples

To use it install with `pip install cloudknot`. A minimal example looks
like this:

```
import cloudknot as ck

def my_awesome_func(b):
    """Here is a function I want to run on AWS Batch"""
    # Always import dependencies within the function
    import numpy as np

    x = np.random.normal(0, b, 1024)
    A = np.random.normal(0, b, (1024, 1024))

    return np.dot(A, x)

# Create a `Knot`, the primary object in cloudknot (docs
<https://richford.github.io/cloudknot/documentation.html#knot>)
knot = ck.Knot(name='my_awesome_func', func=my_awesome_func)

# Submit 20 jobs (each one will run on AWS batch and then send the results
back here)
result_futures = knot.map(range(1, 20))
```

We welcome any feedback you have!

Cheers,

Ariel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/neuroimaging/attachments/20171117/7a694314/attachment.html>


More information about the Neuroimaging mailing list