Dear all,
here is a draft of my proposal on improving online learning for linear models with softmax and AdaGrad.