Backport PR #31423 on branch 1.0.x (PERF: postpone imports in Index constructor)
Backport PR #31423: PERF: postpone imports in Index constructor
The CI failure was an HTTP error for conda. OK to ignore I think.

Merging ones travis finishes.