The classical analyses for non-private SCO depend crucially on making only one pass over the dataset.
a single pass noisy SGD is not sufficiently accurate as we need a non-trivial amount of noise in each step to carry out the privacy analysis.