Hi Britton,
On Mon, May 12, 2014 at 2:16 PM, Britton Smith
Hey all,
I'm working on changing how HaloCatalog objects loop over halos from a model where every processor has to hold the entire halo list to a model in which we loop over "io" chunks. This will make the HaloCatalog scale much better to extremely large catalogs. My understanding was that an "io" chunk was essentially one file on disk. However, when I try to get io chunks from any one of the various halo catalog frontends, there seems to only ever be a single chunk that contains everything, regardless of how many files on disk the data is spread over. Is there a way to change this so that an io chunk represents the data from a single file?
That sounds like a bug; IO should be single file at a time. Can you show me how you're checking? -Matt
Britton
_______________________________________________ yt-dev mailing list yt-dev@lists.spacepope.org http://lists.spacepope.org/listinfo.cgi/yt-dev-spacepope.org