CLN: avoid values_from_object in Series
xref #32422, #32419
thanks @jbrockmendel another problem with this PR is that you enabled "mean" for Period dtype (but only for DataFrames), while we had long discussions before (when initially adding mean support for datetimelikes) that ended in not supporting mean for period (-> https://github.com/pandas-dev/pandas/pull/24757/) Opened a PR for that in the mean time: https://github.com/pandas-dev/pandas/pull/33758