A machine learning method includes installing a plurality of model replicas for training on a plurality of computer learning nodes; receiving training data at a each model replica and updating parameters for the model replica after trailing; sending the parameters to other model replicas with a communication batch size; evaluating received parameters from other model replicas; and dynamically adjusting the communication batch size to balance computation and communication overhead and ensuring convergence even with a mismatch in processing abilities on different computer learning nodes.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A machine learning method, comprising: installing a plurality of model replicas for training on a plurality of computer learning nodes; receiving training data at a each model replica and updating parameters for the model replica after trailing; sending the parameters to other model replicas with a communication batch size; evaluating received parameters from other model replicas; and dynamically adjusting the communication batch size to balance computation and communication overhead and ensuring convergence even with a mismatch in processing abilities on different computer learning nodes. 2. The method of claim 1, comprising sending iteration counts and counting the model updates that arrive at each model replica, and if a model replica notices too few replicas, the model replica increases the communication batch size in increments, and if the model replica notices other model replicas have higher iteration counts as compared to its iteration count, the model replica increases model update transmission frequency as other computer learning nodes merge their updates. 3. The method of claim 1, comprising balancing computation and communication in distributed machine learning. 4. The method of claim 1, comprising adjusting the communication batch sizes to automatically balance processor and network loads. 5. The method of claim 1, comprising ensuring accurate convergence and high accuracy machine learning models by adjusting training sizes with communication batch sizes. 6. The method of claim 1, comprising training a plurality of model replicas train in parallel using parameter updates. 7. The method of claim 1, wherein the model replicas train and compute new model weights. 8. The method of claim 1, comprising sending or receiving parameters from all other model replicas and applying the parameters to the current model replica model. 9. The method of claim 1, comprising training on data captured by sensors coupled to an actuator. 10. The method of claim 9, wherein the actuator comprises motor or engine to move a physical object. 11. A machine learning system, comprising: a plurality of computer learning nodes running a plurality of model replicas for training, each including a processor and a data storage device; code for receiving training data at a first model replica and updating parameters for the model replica after trailing; code for sending the parameters to other model replicas with a communication batch size; code for evaluating received parameters from other model replicas; and code for adjusting the communication batch size to balance computation and communication overhead and ensuring convergence even with a mismatch in processing abilities on different computer learning nodes. 12. The system of claim 11, comprising code for sending iteration counts and counting the model updates that arrive at each model replica, and if a model replica notices too few replicas, the model replica increases the communication batch size in increments, and if the model replica notices other model replicas have higher iteration counts as compared to its iteration count, the model replica increases model update transmission frequency as other computer learning nodes merge their updates. 13. The system of claim 11, comprising code for balancing computation and communication in distributed machine learning. 14. The system of claim 11, comprising code for adjusting the communication batch sizes to automatically balance processor and network loads. 15. The system of claim 11, comprising code for ensuring accurate convergence and high accuracy machine learning models by adjusting training sizes with communication batch sizes. 16. The system of claim 11, comprising code for training a plurality of model replicas train in parallel using parameter updates. 17. The system of claim 11, wherein the model replicas train and compute new model weights. 18. The system of claim 11, comprising sending or receiving parameters from all other model replicas and applying the parameters to the current model replica model.