By way of example, the technology disclosed by this document may be implemented in a method that includes receiving stored sensor data describing characteristics of a vehicle in motion at a past time and extracting features for prediction and features for recognition from the stored sensor data. The features for prediction may be input into a prediction network, which may generate a predicted label for a past driver action based on the features for prediction. The features for recognition may be input into a recognition network, which may generate a recognized label for the past driver action based on the features for recognition. In some instances, the method may include training prediction network weights of the prediction network using the recognized label and the predicted label.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A computer-implemented method comprising: receiving, by one or more computing devices, stored sensor data, the stored sensor data describing characteristics of a vehicle in motion at a past time; extracting, by the one or more computing devices, features for prediction and features for recognition from the stored sensor data; inputting, by the one or more computing devices, the features for prediction into a prediction network; generating, by the one or more computing devices, a predicted label for a past driver action based on the features for prediction using the prediction network; inputting, by the one or more computing devices, the features for recognition into a recognition network; generating, by the one or more computing devices, a recognized label for the past driver action based on the features for recognition using the recognition network; and training, by the one or more computing devices, one or more prediction network weights of the prediction network using the recognized label and the predicted label. 2. The computer-implemented method of claim 1, wherein the prediction network includes one or more recurrent neural networks. 3. The computer-implemented method of claim 1, further comprising: receiving, by the one or more computing devices, current sensor data from one or more sensors, the one or more computing devices being electronically communicatively coupled to the one or more sensors, the current sensor data including data describing characteristics of the vehicle in motion at a present time; extracting, by the one or more computing devices, a current set of features for prediction from the current sensor data; inputting, by the one or more computing devices, the current set of features for prediction into the prediction network; and generating, by the one or more computing devices, a predicted future driver action using the one or more prediction network weights, the current set of features for prediction, and the prediction network. 4. The computer-implemented method of claim 1, wherein generating the predicted label for the past driver action based on the features for prediction using the prediction network includes inputting, by the one or more computing devices, the features for prediction into a backward sequence processor, and inputting, by the one or more computing devices, the features for prediction into a forward sequence processor. 5. The computer-implemented method of claim 4, wherein generating the predicted label for the past driver action based on the features for prediction using the prediction network includes fusing, by the one or more computing devices, an output of the backward sequence processor with an output of the forward sequence processor using a temporal fusion processor, and mapping, by the one or more computing devices, an output of the temporal fusion processor to the predicted label for the past driver action using a classifier. 6. The computer-implemented method of claim 5, wherein fusing the output of the backward sequence processor with the output of the forward sequence processor includes generating, by the temporal fusion processor operable on the one or more computing devices, a temporal representation using a temporal sequence of the output of the backward sequence processor and a temporal sequence of the output of the forward sequence processor. 7. The computer-implemented method of claim 1, wherein generating the recognized label for the past driver action includes inputting, by the one or more computing devices, the features for recognition into one or more pre-trained driver action recognition models. 8. The computer-implemented method of claim 1, wherein training the one or more prediction network weights of the prediction network includes determining an error between the recognized label and the predicted label, and inputting the error into a truncated back-propagation through time algorithm. 9. A computer system comprising: one or more computer processors; and one or more non-transitory memories storing instructions that, when executed by the one or more computer processors, cause the computer system to perform operations comprising: receiving stored sensor data, the stored sensor data describing characteristics of a vehicle in motion at a past time; extracting features for prediction and features for recognition from the stored sensor data; inputting the features for prediction into a prediction network; generating a predicted label for a past driver action based on the features for prediction using the prediction network; inputting the features for recognition into a recognition network; generating a recognized label for the past driver action based on the features for recognition using the recognition network; and training one or more prediction network weights of the prediction network using the recognized label and the predicted label. 10. The computer system of claim 9, wherein the prediction network includes one or more recurrent neural networks. 11. The computer system of claim 9, wherein the operations further comprise: receiving current sensor data from one or more sensors, the computer system being electronically communicatively coupled to the one or more sensors, the current sensor data including data describing characteristics of the vehicle in motion at a present time; extracting a current set of features for prediction from the current sensor data; inputting the current set of features for prediction into the prediction network; and generating a predicted future driver action using the one or more prediction network weights, the current set of features for prediction, and the prediction network. 12. The computer system of claim 9, wherein generating the predicted label for the past driver action based on the features for prediction using the prediction network includes inputting the features for prediction into a backward sequence processor, and inputting the features for prediction into a forward sequence processor. 13. The computer system of claim 12, wherein generating the predicted label for the past driver action based on the features for prediction using the prediction network includes fusing an output of the backward sequence processor with an output of the forward sequence processor using a temporal fusion processor, and mapping an output of the temporal fusion processor to the predicted label for the past driver action using a classifier. 14. The computer system of claim 13, wherein fusing the output of the backward sequence processor with the output of the forward sequence processor includes generating, by the temporal fusion processor, a temporal representation using a temporal sequence of the output of the backward sequence processor and a temporal sequence of the output of the forward sequence processor. 15. The computer system of claim 9, wherein generating the recognized label for the past driver action includes inputting, by the one or more computing devices, the features for recognition into one or more pre-trained driver action recognition models. 16. The computer system of claim 9, wherein training the one or more prediction network weights of the prediction network includes determining an error between the recognized label and the predicted label, and inputting the error into a truncated back-propagation through time algorithm. 17. A computer system comprising: one or more sensors providing sensor data; one or more non-transitory computer memories for storing and providing access to data; one or more computer processors coupled to the non-transitory computer memories to store and receive data; a feature extraction processor storable by the one or more non-transitory computer memories and executable by the one or more computer processors, the feature extraction processor configured to extract features for recognition from the sensor data and transmit the features for recognition to an action recognition processor; the feature extraction processor configured to extract features for prediction from the sensor data and transmit the features for prediction to an action prediction processor; the action recognition processor storable by the one or more non-transitory computer memories and executable by the one or more computer processors, the action recognition processor configured to generate, by a recognition network, a recognized label for a past user action based on the features for recognition and transmit the recognized label to a training processor; the action prediction processor storable by the one or more non-transitory computer memories and executable by the one or more computer processors, the action prediction processor configured to generate, by a prediction network, a predicted label for the past user action based on the features for prediction and transmit the predicted label to the training processor; and the training processor storable by the one or more non-transitory computer memories and executable by the one or more computer processors; the training processor configured to train, by a training network, one or more prediction network weights of the action prediction processor using the recognized label and the predicted label. 18. The computing system of claim 17, wherein the prediction network includes one or more recurrent neural networks. 19. The computing system of claim 17, wherein the prediction network includes a forward sequence processor, a backward sequence processor, and a temporal fusion processor. 20. The computing system of claim 19, wherein each one of the forward sequence processor, the backward sequence processor, and the temporal fusion processor includes a plurality recurrent neural network cells.