Does the intervention affect the outcome of the papers?.
Table notes: The impact of the intervention on the final outcome of papers. For Row 2, we use 1,140 papers for which (i) the discussion was initiated, and (ii) the discussion initiator was a reviewer (and not the area chair). For Row 4, we use papers with discussion. For all other rows, we use all papers including those with no discussion. Bootstrapped confidence intervals are constructed for the difference of the relevant quantities between conditions. The Overall, we find no evidence of herding in the discussion phase of ICML 2020 peer review. We provide supporting information about the analysis in 