This business of one being holy  and a holier Church seems to be misinterpreted. To me it should be seen as God within each individual and in our Church.  It has nothing to do with what one can do  by ones self to appear holy and  that goes for the Church also.  It has every thing to do with recognizing the diverse gifts God has given each of us and how we as individuals recognize, accept gracefully and with humility, and use  these gifts to help our fellow humans to be the best they can be with out imposing the  idea they must become what you wish them to become.  
Those wishing for a smaller, holier Church appear to secretly thing they are the giver of these gifts instead of being a conduit from which these gifts pass.  Is it any wonder that The People of God looked at these prelates and shake  their heads in total dismay!