A system and method of training an artificial neural network. The method comprises determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network, and scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network. Each scaled activation value is determined using a scaling factor associated with a corresponding one of the plurality of nodes. Each scaling factor is determined based on a rank of the corresponding node. The method further comprises updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A method of training an artificial neural network, the method comprising: determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network; scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network, each scaled activation value determined using a scaling factor associated with a corresponding one of the plurality of nodes, each scaling factor being determined based on a rank of the corresponding node; and updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network. 2. The method according to claim 1, wherein the rank of each of the plurality of the nodes is determined according to the activation value of the node. 3. The method according to claim 1, wherein the plurality of the nodes are ranked from a highest activation value to a lowest activation value, the node having the highest activation value being assigned lowest rank, and the node having the lowest activation value being assigned highest rank. 4. The method according to claim 1, wherein the plurality of the nodes are ranked from a highest activation value to a lowest activation value, the node having the highest activation value being assigned lowest rank, and the node having the lowest activation value being assigned highest rank, wherein the scaling factor for the node with lowest rank is a lowest scaling factor, and the scaling factor for the node with highest rank is a highest scaling factor. 5. The method according to claim 1, wherein the plurality of the nodes are ranked from a highest activation value to a lowest activation value, the node having the highest activation value being assigned lowest rank, and the node having the lowest activation value being assigned highest rank, wherein nodes with activation values between the highest activation value and the lowest activation value have scaling factors between the highest scaling factor and the lowest scaling factor. 6. The method according to claim 1, wherein the scaling factor varies monotonically according to the rank of the associated node. 7. The method according to claim 1, wherein the scaling factor associated with one of the plurality of nodes has a different value to the scaling factors associated with other nodes in the plurality of nodes. 8. The method according to claim 1, wherein the scaling factor associated with one of the plurality of the nodes is repeated in at least one scaling factor associated with another node in the plurality of the nodes. 9. The method according to claim 1, wherein the training data is additional training data and training the artificial neural network relates to incremental learning by the artificial neural network. 10. The method according to claim 1, further comprising determining a sparsity penalty value based on relative ranking of the activation values of the plurality of the nodes. 11. The method according to claim 1, further comprising determining a sparsity penalty value using the scaled activation values, and updating the weights relates to the sparsity penalty value. 12. The method according to claim 1, further comprising determining a sparsity penalty value using the scaled activation values, determining a derivative of the sparsity penalty value and updating the weights based on the determined derivative. 13. The method according to claims 1, further comprising sorting the activation values of the plurality of the nodes in the portion of the artificial neural network in order of decreasing value, and determining the rank of each node in an incrementing sequence. 14. The method according to claim 1, further comprising normalising the determined activation values of the plurality of the nodes using a mean of the determined activation values of the nodes, and determining the rank of the nodes using the normalised activation values, 15. A computer readable medium having a computer program stored thereon for training an artificial neural network, said program comprising: code for determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network; code for scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network, each scaled activation value determined using a scaling factor associated with a corresponding one of the plurality of nodes, each scaling factor being determined based on a rank of the corresponding node; and code for updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network. 16. An apparatus for training an artificial neural network, the apparatus comprising: means for determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network; means for scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network, each scaled activation value determined using a scaling factor associated with a corresponding one of the plurality of nodes, each scaling factor being determined based on a rank of the corresponding node; and means for updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network. 17. A system for training an artificial neural network, the system comprising: a memory for storing data and a computer program; a processor coupled to the memory for executing said computer program, said computer program comprising instructions for: determining an activation value for each node in a set of nodes of the artificial neural network, the activation values being determined by applying training data to the artificial neural network; scaling the determined activation values for each of a plurality of the nodes in a portion of the artificial neural network, each scaled activation value determined using a scaling factor associated with a corresponding one of the plurality of nodes, each scaling factor being determined based on a rank of the corresponding node; and updating weights associated with each of the plurality of nodes in the portion of the artificial neural network using the determined scaled activation values to train the neural network.