In this paper, the development law of residual deformation of coal gangue subgrade filler is analyzed through large scale triaxial test, and the residual deformation model of coal gangue mainly sandstone and limestone is established. The purpose is to provide research basis for the applicability of coal gangue as subgrade filler. The results show that the deformation of coal gangue filler increases first and then tends to be constant under cyclic load of multiple vibration times. It is found that the Shenzhujiang residual deformation model cannot accurately predict the deformation law, and the corresponding modification is made to the residual deformation model of coal gangue filling body. Finally, according to the calculation of grey correlation degree, the influence degree of main factors of coal gangue filler on its residual deformation is sorted. Combined with the actual engineering situation represented by these main factors, it can be analyzed that the effect of packing particle density on residual deformation is greater than that of packing particle size composition.