CLN: simplify groupby wrapping
This is the last of the groupby cleanup I have lined up.  @rhshadrach im hoping more progress can be made in simplifying the wrapping and apply/agg try/excepts but don't see an immediate way forward.
Thanks @jbrockmendel 