I do have several questions: - Did the hyper-ensemble paper forced the networks to start form the same initialization point? I looked into the paper in ref[12] for this information but couldn't tell. If so, then the work will need a more justification with the difference w.r.t hyper-ensemble. - In page 5, starting from line 172 it was not clear why o(mk) became o(k^2), can you elaborate more on this? - From table#1 and table#2 it seems that hyper-ens, str hyper ens and deep ens are quite close to each other in nll,acc,ece ranges. What's exactly the range if improvement of using str-hyper-ens over the others? - In tables#1,2 what is the meaning of the numbers in brackets (1),(4)? - I understand that the empirical evaluation is expensive, but reporting results on other deep models such as VGG, ResNet, DenseNet for a small subset of the settings will clear any doubts regards that the method only works best for wide-resnet. - On the same point of wide-resnet as in lines 269-272 for using two deep ensembles, what are the results of this comparison for wideresnet?
- In page 5, starting from line 172 it was not clear why o(mk) became o(k^2), can you elaborate more on this?