Grain legumes are key components of sustainable production systems in sub-Saharan Africa, but wide-spread nutrient deficiencies severely restrict yields. Whereas legumes can meet a large part of their nitrogen (N) requirement through symbiosis with N2-fixing bacteria, elements such as phosphorus (P), potassium (K) and secondary and micronutrients may still be limiting and require supplementation. Responses to P are generally strong but variable, while evidence for other nutrients tends to show weak or highly localised effects. Here we present the results of a joint statistical analysis of a series of on-farm nutrient addition trials, implemented across four legumes in four countries over two years. Linear mixed models were used to quantify both mean nutrient responses and their variability, followed by a random forest analysis to determine the extent to which such variability can be explained or predicted by geographic, environmental or farm survey data. Legume response to P was indeed variable, but consistently positive and we predicted application to be profitable for 67% of farms in any given year, based on prevailing input costs and grain prices. Other nutrients did not show significant mean effects, but considerable response variation was found. This response heterogeneity was mostly associated with local or temporary factors and could not be explained or predicted by spatial, biophysical or management factors. An exception was K response, which displayed appreciable spatial variation that could be partly accounted for by spatial and environmental covariables. While of apparent relevance for targeted recommendations, the minor amplitude of expected response, the large proportion of unexplained variation and the unreliability of the predicted spatial patterns suggests that such data-driven targeting is unlikely to be effective with current data.