Matt,
Hm, at the risk of replying to my own message, we might be able to do this by using a memmap onto the disk. But then we'd be assuming homogenous clusters, which honestly, I think we should just go ahead and assume. But I'd rather keep things off the disk if at all possible. I suppose when we're dealing with arrays of this size, though, it does become a bit prohibitive...
Pardon my ignorance, but how is the Alltoallv used? In Parallel HOP, I communicate arrays that are large fractions of a GB in size with no problem using un-pickled methods. I looked and it appears that Alltoallv is a not pickling comm, is this correct?
_______________________________________________________ sskory@physics.ucsd.edu o__ Stephen Skory http://physics.ucsd.edu/~sskory/ _.>/ _Graduate Student ________________________________(_)_\(_)_______________