- The evaluation results reported in table 1 are based on only three trials for each case. While this is fine, statistically this is not significant, and thus it does not make sense to report the deviations. That is why that in many cases the deviation is 0. Due to this reason, statements such as “our performance is at least two standard deviation better than the next best baseline” do not make sense. - In the reported ablation studies in Table 2, for CUB and SOP datasets, the complete loss function performed even worse than those with some terms missing. That does not appear to make sense. Why?
- In the reported ablation studies in Table 2, for CUB and SOP datasets, the complete loss function performed even worse than those with some terms missing. That does not appear to make sense. Why?