Allow numpy-2.1 and test it without audio extra
Allow numpy-2.1 and test it without audio extra.

This PR reverts:
- #7114

Note that audio extra tests can be included again with numpy-2.1 once next numba-0.61.0 version is released.