Ground-penetrating radar (GPR) is an effective geophysical electromagnetic method for underground target detection. However, the target response is usually overwhelmed by strong clutter, thus damaging the detection performance. To account for the nonparallel case of the antennas and the ground surface, a novel GPR clutter-removal method based on weighted nuclear norm minimization (WNNM) is proposed, which decomposes the B-scan image into a low-rank clutter matrix and a sparse target matrix by using a non-convex weighted nuclear norm and assigning different weights to different singular values. The WNNM method’s performance is evaluated using both numerical simulations and experiments with real GPR systems. Comparative analysis with the commonly used state-of-the-art clutter removal methods is also conducted in terms of the peak signal-to-noise ratio (PSNR) and the improvement factor (IF). The visualization and quantitative results demonstrate that the proposed method outperforms the others in the nonparallel case. Moreover, it is about five times faster than the RPCA, which is beneficial for practical applications.