REF: remove group_selection_context
cc @rhshadrach 
We already have `obj = self._obj_with_exclusions` in a few places.  Can we do a one-and-for-all bikeshed on this topic separately? Thanks @jbrockmendel 