Group tests in multiprocessing workers by test file
By grouping tests by test file, we make sure that all the tests in `test_load.py` are sent to the same worker.

Therefore, the fixture `hf_token` will be called only once (and from the same worker).

Related to: #3200.
Fix #3219.