A method for improving performance of a trained machine learning model includes adding a second classifier with a second objective function to a first classifier with a first objective function. Rather than minimizing a function of errors for the first classifier, the second objective function is used to directly reduce the number errors of the first classifier.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A method for improving performance of a trained machine learning model, comprising: adding a second classifier with a second objective function to a first classifier with a first objective function, the second objective function being used to directly reduce errors of the first classifier. 2. The method of claim 1, in which the first objective function is differentiable. 3. The method of claim 1, in which the second objective function is non-differentiable. 4. The method of claim 1, in which the second objective function is a function of a difference between errors of the first classifier and the second classifier. 5. The method of claim 1, further comprising determining the second objective function based at least in part on a mixture of probabilities from a higher complexity model. 6. The method of claim 1, further comprising adding the second classifier without retraining the first classifier. 7. The method of claim 1, further comprising adding the second classifier externally to the first classifier. 8. The method of claim 1, further comprising assigning weights to features produced by a model, which is trained by the first classifier, to an identity value. 9. The method of claim 8, further comprising assigning weights to features produced by a probability vector of a high complexity model to zero. 10. The method of claim 1, further comprising assigning weights to features produced by a probability vector of the second classifier. 11. The method of claim 1, further comprising assigning weights to features produced by a probability vector of a high complexity model to zero. 12. The method of claim 11, further comprising assigning weights to features produced by a probability vector of the second classifier. 13. The method of claim 1, further comprising scaling probability vectors generated by a higher complexity model by a fixed temperature T. 14. An apparatus for improving performance of a trained machine learning model, comprising: a memory; and at least one processor coupled to the memory, the at least one processor configured to add a second classifier with a second objective function to a first classifier with a first objective function, the second objective function being used to directly reduce errors of the first classifier. 15. The apparatus of claim 14, in which the first objective function is differentiable. 16. The apparatus of claim 14, in which the second objective function is non-differentiable. 17. The apparatus of claim 14, in which the second objective function is a function of a difference between errors of the first classifier and the second classifier. 18. The apparatus of claim 14, in which the at least one processor is further configured to determine the second objective function based at least in part on a mixture of probabilities from a higher complexity model. 19. The apparatus of claim 14, in which the at least one processor is further configured to add the second classifier without retraining the first classifier. 20. The apparatus of claim 14, in which the at least one processor is further configured to add the second classifier externally to the first classifier. 21. The apparatus of claim 14, in which the at least one processor is further configured to assign weights to features produced by a model, which is trained by the first classifier, to an identity value. 22. The apparatus of claim 21, in which the at least one processor is further configured to assign weights to features produced by a probability vector of a high complexity model to zero. 23. The apparatus of claim 14, in which the at least one processor is further configured to assign weights to features produced by a probability vector of the second classifier. 24. The apparatus of claim 14, in which the at least one processor is further configured to assign weights to features produced by a probability vector of a high complexity model to zero. 25. The apparatus of claim 24, in which the at least one processor is further configured to assign weights to features produced by a probability vector of the second classifier. 26. The apparatus of claim 14, in which the at least one processor is further configured to scale probability vectors generated by a higher complexity model by a fixed temperature T. 27. An apparatus for improving performance of a trained machine learning model, comprising: means for adding a second classifier with a second objective function to a first classifier with a first objective function, the second objective function being used to directly reduce errors of the first classifier; and means for outputting a feature vector from the second classifier based at least in part on an input received via the trained machine learning model. 28. A non-transitory computer-readable medium having encoded thereon program code for improving performance of a trained machine learning model, the program code being executed by a processor and comprising program code to add a second classifier with a second objective function to a first classifier with a first objective function, the second objective function being used to directly reduce errors of the first classifier.