and Questions: 1) Can the results be improved so that ProxSVRG+ becomes better than SCSG for all minibatch sizes b? 2) How does the PL condition you use compare with the PL conditions proposed in âGlobal Convergence of Arbitrary-Block Gradient Methods for Generalized Polyak-Åojasiewicz Functionsâ, arXiv:1709.03014 ? 3) Line 114: Is the assumption really necessary? Why? Or just sufficient? 4) I think the paper would benefit if some more experiments were included in the supplementary, on some other problems and with other datasets. Otherwise the robustness/generalization of the observations drawn from the included experiments is unclear. Small issues: 1) Lines 15-16: The sentence starting with âBesidesâ is not grammatically correct. 2) Line 68: What is a âsuper constantâ? 3) Line 75: âmatchesâ -> âmatchâ 4) Page 3: âorcaleâ â âoracleâ (twice) 5) Caption of Table 1: âare definedâ -> âare givenâ 6) Eq (3): use full stop 7) Line 122: The sentence is not grammatically correct. 8) Line 200: ârestatedâ -> ârestartedâ 9) Paper [21]: accents missing for one authorâs name ***** I read the rebuttal and the other reviews, and am keeping my score.
2) How does the PL condition you use compare with the PL conditions proposed in âGlobal Convergence of Arbitrary-Block Gradient Methods for Generalized Polyak-Åojasiewicz Functionsâ, arXiv:1709.03014 ?