CLN/REF: Split up / clean Categorical constructor tests
LGTM pending green (the failure is unrelated, but id rather be patient all the same) @jbrockmendel Looks like we're green after fixing CI, thanks for the review thanks @dsaxton 