I have one huge data to load, so I need to train it incrementally.

So I load data segment by segment and train segment by segment like: MiniBatchKMeans.

In that condition, how to tune parameters? tune the first part of data or every part of data?