REF: share common code in ArrayManager.get_numeric_data/get_bool_data
See https://github.com/pandas-dev/pandas/pull/39719/files#r578859353 @jreback
Merging, so I can update https://github.com/pandas-dev/pandas/pull/39719/ to use it (failures are unrelated)