Crop-specific, high-resolution phosphorus rate information is essential for sustainable agricultural fertilizer management in China. However, substantial uncertainties exist in the current phosphorus fertilizer dataset because of only coarse national statistics used in dataset development and no crop-specific information provided. This study harmonized provincial and county-level phosphorus and component fertilizer statistics and crop distribution data to generate 1 km gridded maps of phosphorus rate for rice, wheat and maize in the years of 2004–2016 (CN-P). CN-P provides a comparable estimate on phosphorus rate for each crop over 2004–2016, and demonstrates an improved spatial heterogeneity. Existing dataset developed using national statistics tends to smooth out the variability within country and significantly underestimates actual phosphorus rate. CN-P shows that, during 2004–2016, wheat received the most phosphorus rate (8.7 g P2O5m−2), while maize showed the rapidest increasing trend (2.36% yr−1). The CN-P dataset has the potential to be widely applied in modeling studies on sustainable agricultural fertilizer management strategies and phosphorus pollution.