[Neuroimaging] ANN: Cloudknot 0.1
Ariel Rokem
arokem at gmail.com
Fri Nov 17 11:19:52 EST 2017
Hi everyone,
Not a neuroimaging-specific tool, but might still be of interest to folks
on this list: we are happy to announce the first release of *Cloudknot*, a
software library that makes it easy to run your existing Python code at
scale using AWS Batch.
Documentation is here: https://richford.github.io/cloudknot/
The source code is available on Github: https://github.com/ric
hford/cloudknot
And there are few example use-cases (including analysis of MRI data!) here:
https://github.com/richford/cloudknot/tree/master/examples
To use it install with `pip install cloudknot`. A minimal example looks
like this:
```
import cloudknot as ck
def my_awesome_func(b):
"""Here is a function I want to run on AWS Batch"""
# Always import dependencies within the function
import numpy as np
x = np.random.normal(0, b, 1024)
A = np.random.normal(0, b, (1024, 1024))
return np.dot(A, x)
# Create a `Knot`, the primary object in cloudknot (docs
<https://richford.github.io/cloudknot/documentation.html#knot>)
knot = ck.Knot(name='my_awesome_func', func=my_awesome_func)
# Submit 20 jobs (each one will run on AWS batch and then send the results
back here)
result_futures = knot.map(range(1, 20))
```
We welcome any feedback you have!
Cheers,
Ariel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/neuroimaging/attachments/20171117/7a694314/attachment.html>
More information about the Neuroimaging
mailing list