Backport PR #36385 on branch 1.1.x (BUG: Always cast to Categorical in lexsort_indexer)
Backport PR #36385: BUG: Always cast to Categorical in lexsort_indexer
failure unrelated. see https://github.com/pandas-dev/pandas/pull/36396#issuecomment-695195148