This paper builds a corresponding micro-displacement test system based on an ensemble nitrogen-vacancy (NV) color center magnetometer by combining the correlation between a magnetic flux concentrator, a permanent magnet, and micro-displacement. By comparing the measurement results obtained with and without the magnetic flux concentrator, it can be seen that the resolution of the system under the magnetic flux concentrator can reach 25 nm, which is 24 times higher than without the magnetic flux concentrator. The effectiveness of the method is proven. The above results provide a practical reference for high-precision micro-displacement detection based on the diamond ensemble.