Methods, systems, and apparatus, including computer programs encoded on computer storage medium, for training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels. The method includes actions of obtaining a set of training data that includes a plurality of training items, wherein each training item is associated with a respective label from the predetermined set of multiple labels; and modifying the training data to generate regularizing training data, comprising: for each training item, determining whether to modify the label associated with the training item, and changing the label associated with the training item to a different label from the predetermined set of labels, and training the neural network on the regularizing data.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A method of training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the method comprising: obtaining a set of training data that includes a plurality of training items, wherein each training item is associated with an initial target label distribution that assigns a respective target score to each label in the predetermined set of labels; modifying the training data to generate regularizing training data that regularizes the training of the neural network, comprising, for each training item, modifying the initial target label distribution to generate a modified target label distribution by combining the initial target label distribution with a smoothing label distribution; and training the neural network on the regularizing training data. 2. The method of claim 1, wherein combining the initial target label distribution with a smoothing label distribution includes: calculating a weighted sum of the initial target label distribution and the smoothing label distribution. 3. The method of claim 1, wherein, for each training item: the target score for a known label for the training item is assigned a predetermined positive value in the initial target distribution for the training item, and the target score for each label other than the known label is set to 0 in the initial target distribution. 4. The method of claim 1, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein each smoothing score is the same predetermined value. 5. The method of claim 1, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein the smoothing scores are non-uniform. 6. A system for training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the system comprising: obtaining a set of training data that includes a plurality of training items, wherein each training item is associated with an initial target label distribution that assigns a respective target score to each label in the predetermined set of labels; modifying the training data to generate regularizing training data that regularizes the training of the neural network, comprising, for each training item, modifying the initial target label distribution to generate a modified target label distribution by combining the initial target label distribution with a smoothing label distribution; and training the neural network on the regularizing training data. 7. The system of claim 6, wherein combining the initial target label distribution with a smoothing label distribution includes: calculating a weighted sum of the initial target label distribution and the smoothing label distribution. 8. The system of claim 6, wherein, for each training item: the target score for a known label for the training item is assigned a predetermined positive value in the initial target distribution for the training item, and the target score for each label other than the known label is set to 0 in the initial target distribution. 9. The system of claim 6, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein each smoothing score is the same predetermined value. 10. The system of claim 6, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein the smoothing scores are non-uniform. 11. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations for training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the operations comprising: obtaining a set of training data that includes a plurality of training items, wherein each training item is associated with an initial target label distribution that assigns a respective target score to each label in the predetermined set of labels; modifying the training data to generate regularizing training data that regularizes the training of the neural network, comprising, for each training item, modifying the initial target label distribution to generate a modified target label distribution by combining the initial target label distribution with a smoothing label distribution; and training the neural network on the regularizing training data. 12. The system of claim 11, wherein combining the initial target label distribution with a smoothing label distribution includes: calculating a weighted sum of the initial target label distribution and the smoothing label distribution. 13. The system of claim 11, wherein, for each training item: the target score for a known label for the training item is assigned a predetermined positive value in the initial target distribution for the training item, and the target score for each label other than the known label is set to 0 in the initial target distribution. 14. The system of claim 11, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein each smoothing score is the same predetermined value. 15. The system of claim 11, wherein the smoothing label distribution includes a respective smoothing score for each label in the predetermined set of labels, and wherein the smoothing scores are non-uniform. 16. A method of training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the method comprising: obtaining a set of training data that includes a plurality of training items, wherein each training item is associated with a respective label from the predetermined set of multiple labels; and modifying the training data to generate regularizing training data that regularizes the training of the neural network, comprising: for each training item, determining whether or not to modify the label associated with the training item; and in response to determining to modify the label associated with the training item, changing the label associated with the training item to a different label from the predetermined set of labels; and training the neural network on the regularizing training data. 17. The method claim 16, wherein changing the label associated with training item to a different label from the predetermined set of labels includes: changing the label from a label that correctly describes the training item to a label that incorrectly describes the training item. 18. The method of claim 16, wherein the different label is randomly selected from the predetermined set of labels. 19. The method of claim 16, wherein the label includes a training label distribution that includes a score for the training item for each label in a predetermined set of labels associated with a set of training images. 20. The method of claim 19, wherein changing the label associated with the training item to a different label from the predetermined set of labels includes changing the distribution of scores in a training data item's training label distribution from a distribution of scores representing a correct label to a distribution of scores representing an incorrect label. 21. The method of claim 16, wherein determining whether or not to modify the label associated with the training item is based on a predetermined probability. 22. The method of claim 21, wherein the predetermined probability is 10%. 23. A method of training a neural network, wherein the neural network is configured to receive an input data item and to process the input data item to generate a respective score for each label in a predetermined set of multiple labels, the method comprising: receiving a request to train the neural network to optimize a loss function comprising a first error term; and training the neural network to optimize a regularized loss function, the regularized loss function comprising the first error term and a regularizing error term that penalizes the neural network based on the error between a predicted distribution and a smoothing distribution. 24. The method of claim 23, wherein the smoothing distribution is a uniform distribution. 25. The method of claim 23, wherein the smoothing distribution is a distribution that was used prior to the predicted distribution.