Systems and methods are provided for automatically scoring a constructed response. The constructed response is processed to generate a plurality of numerical vectors that is representative of the constructed response. A model is applied to the plurality of numerical vectors. The model includes an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the model via a first plurality of connections. Each of the connections has a first weight. An intermediate layer of nodes is configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the connections having a second weight. An output layer is connected to the intermediate layer via a third plurality of connections, each of the connections having a third weight. The output layer is configured to generate a score for the constructed response.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A computer-implemented method of constructing a model to automatically score a constructed response, the method comprising: specifying a model associated with a given item, the model comprising an input layer configured to receive a plurality of numerical vectors that is representative of a constructed response, the input layer being connected to a following layer of the model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, a first intermediate layer of nodes configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein each node of the first intermediate layer generates an output based on a weighted summation of received inputs, and an output layer connected to the first intermediate layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the first intermediate layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights; receiving multiple reference responses for the given item, each reference response having been given a reference score, the reference responses spanning a range of reference scores; processing the multiple reference responses to generate, for each reference response, a plurality of numerical vectors that is representative of the reference response; training the model with a processing system using the numerical vectors representative of the reference responses and the reference scores to determine values for each of the first, second, and third weights; and configuring the model with the determined values of the first, second, and third weights to receive a plurality of numerical vectors that is representative of an actual constructed response to be scored so as to generate a score for the actual constructed response. 2. The computer-implemented method of claim 1, wherein the model comprises a convolutional neural network. 3. The computer-implemented method of claim 2, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the model further comprising: a second intermediate layer of nodes, the second intermediate layer including multiple sets of nodes, wherein each set of nodes of the second intermediate layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 4. The computer-implemented method of claim 3, wherein the model comprises: a third intermediate layer configured to store a third numerical vector, the third numerical vector being based on a convolution of the second numerical vectors generated by the second intermediate layer of nodes, wherein the third intermediate layer comprises the layer that immediately precedes the first intermediate layer in the model, the inputs received at the first intermediate layer comprising portions of the third numerical vector. 5. The computer-implemented method of claim 1 comprising: prior to the training of the model using the reference responses: receiving a reference response for the given item that has not been given a reference score; processing the reference response to generate a plurality of numerical vectors that is representative of the reference response; and training at least a portion of the model with the plurality of numerical vectors that is representative of the reference response to estimate values of the first weights, the training being an unsupervised training based on a denoising auto-encoder or restricted Boltzmann machine. 6. A system for constructing a model to automatically score a constructed response, the system comprising: a processing system; and computer-readable memory in communication with the processing system encoded with instructions for commanding the processing system to execute steps comprising: specifying a model associated with a given item, the model comprising an input layer configured to receive a plurality of numerical vectors that is representative of a constructed response, the input layer being connected to a following layer of the model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, a first intermediate layer of nodes configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein each node of the first intermediate layer generates an output based on a weighted summation of received inputs, and an output layer connected to the first intermediate layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the first intermediate layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights; receiving multiple reference responses for the given item, each reference response having been given a reference score, the reference responses spanning a range of reference scores; processing the multiple reference responses to generate, for each reference response, a plurality of numerical vectors that is representative of the reference response; training the model using the numerical vectors representative of the reference responses and the reference scores to determine values for each of the first, second, and third weights; and configuring the model with the determined values of the first, second, and third weights to receive a plurality of numerical vectors that is representative of an actual constructed response to be scored so as to generate a score for the actual constructed response. 7. The system of claim 6, wherein the model comprises a convolutional neural network. 8. The system of claim 7, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the model further comprising: a second intermediate layer of nodes, the second intermediate layer including multiple sets of nodes, wherein each set of nodes of the second intermediate layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 9. The system of claim 8, wherein the model comprises: a third intermediate layer configured to store a third numerical vector, the third numerical vector being based on a convolution of the second numerical vectors generated by the second intermediate layer of nodes, wherein the third intermediate layer comprises the layer that immediately precedes the first intermediate layer in the model, the inputs received at the first intermediate layer comprising portions of the third numerical vector. 10. The system of claim 6, wherein the processing system is configured to execute steps comprising: prior to the training of the model using the reference responses: receiving a reference response for the given item that has not been given a reference score; processing the reference response to generate a plurality of numerical vectors that is representative of the reference response; and training at least a portion of the model with the plurality of numerical vectors that is representative of the reference response to estimate values of the first weights, the training being an unsupervised training based on a denoising auto-encoder or restricted Boltzmann machine. 11. A non-transitory computer-readable storage medium for constructing a model to automatically score a constructed response, the computer-readable storage medium comprising computer executable instructions which, when executed, cause a processing system to execute steps including: specifying a model associated with a given item, the model comprising an input layer configured to receive a plurality of numerical vectors that is representative of a constructed response, the input layer being connected to a following layer of the model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, a first intermediate layer of nodes configured to receive inputs from an immediately-preceding layer of the model via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein each node of the first intermediate layer generates an output based on a weighted summation of received inputs, and an output layer connected to the first intermediate layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the first intermediate layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights; receiving multiple reference responses for the given item, each reference response having been given a reference score, the reference responses spanning a range of reference scores; processing the multiple reference responses to generate, for each reference response, a plurality of numerical vectors that is representative of the reference response; training the model using the numerical vectors representative of the reference responses and the reference scores to determine values for each of the first, second, and third weights; and configuring the model with the determined values of the first, second, and third weights to receive a plurality of numerical vectors that is representative of an actual constructed response to be scored so as to generate a score for the actual constructed response. 12. The non-transitory computer-readable storage medium of claim 11, wherein the model comprises a convolutional neural network. 13. The non-transitory computer-readable storage medium of claim 12, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the model further comprising: a second intermediate layer of nodes, the second intermediate layer including multiple sets of nodes, wherein each set of nodes of the second intermediate layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 14. The non-transitory computer-readable storage medium of claim 13, wherein the model comprises: a third intermediate layer configured to store a third numerical vector, the third numerical vector being based on a convolution of the second numerical vectors generated by the second intermediate layer of nodes, wherein the third intermediate layer comprises the layer that immediately precedes the first intermediate layer in the model, the inputs received at the first intermediate layer comprising portions of the third numerical vector. 15. The non-transitory computer-readable storage medium of claim 11, wherein the computer executable instructions cause the processing system to execute steps including: prior to the training of the model using the reference responses: receiving a reference response for the given item that has not been given a reference score; processing the reference response to generate a plurality of numerical vectors that is representative of the reference response; and training at least a portion of the model with the plurality of numerical vectors that is representative of the reference response to estimate values of the first weights, the training being an unsupervised training based on a denoising auto-encoder or restricted Boltzmann machine. 16. A computer-implemented method of automatically scoring a constructed response generated by a user, the method comprising: receiving a constructed response generated by a user, the constructed response being based on a given item; parsing the constructed response with a processing system to identify in the constructed response a plurality of multi-character sequences; processing the plurality of multi-character sequences with the processing system to generate a plurality of numerical vectors that is representative of the constructed response; and applying a convolutional neural network model associated with the given item to the plurality of numerical vectors to determine a score for the constructed response, the convolutional neural network model including an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the convolutional neural network model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, wherein at least a subset of the connections have a same first weight, a convolution layer including a plurality of nodes, each node of the convolution layer receiving input from an immediately-preceding layer of the convolutional neural network model, a hidden layer of nodes configured to receive inputs from the convolution layer via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein at least a subset of the second plurality of connections have a same second weight, and wherein each node of the hidden layer generates an output based on a weighted summation of received inputs, and an output layer connected to the hidden layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the hidden layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights. 17. The computer-implemented method of claim 16, wherein each of the multi-character sequences has a same number of characters, the method further comprising: parsing each of the multi-character sequences to identify in the multi-character sequence a plurality of single characters; transforming each of the single characters into a numerical vector using an encoding algorithm; for each of the multi-character sequences, joining the numerical vectors for the associated single characters end-to-end, wherein the joining of the numerical vectors generates a second numerical vector associated with the multi-character sequence, the second numerical vectors comprising the plurality of numerical vectors that is representative of the constructed response. 18. The computer-implemented method of claim 16, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the convolutional neural network model further comprising: a second hidden layer of nodes, the second hidden layer including multiple sets of nodes, wherein each set of nodes of the second hidden layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 19. A system for automatically scoring a constructed response generated by a user, the system comprising: a processing system; and computer-readable memory in communication with the processing system encoded with instructions for commanding the processing system to execute steps comprising: receiving a constructed response generated by a user, the constructed response being based on a given item; parsing the constructed response to identify in the constructed response a plurality of multi-character sequences; processing the plurality of multi-character sequences to generate a plurality of numerical vectors that is representative of the constructed response; and applying a convolutional neural network model associated with the given item to the plurality of numerical vectors to determine a score for the constructed response, the convolutional neural network model including an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the convolutional neural network model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, wherein at least a subset of the connections have a same first weight, a convolution layer including a plurality of nodes, each node of the convolution layer receiving input from an immediately-preceding layer of the convolutional neural network model, a hidden layer of nodes configured to receive inputs from the convolution layer via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein at least a subset of the second plurality of connections have a same second weight, and wherein each node of the hidden layer generates an output based on a weighted summation of received inputs, and an output layer connected to the hidden layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the hidden layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights. 20. The system of claim 19, wherein each of the multi-character sequences has a same number of characters, and wherein the processing system is configured to execute steps comprising: parsing each of the multi-character sequences to identify in the multi-character sequence a plurality of single characters; transforming each of the single characters into a numerical vector using an encoding algorithm; for each of the multi-character sequences, joining the numerical vectors for the associated single characters end-to-end, wherein the joining of the numerical vectors generates a second numerical vector associated with the multi-character sequence, the second numerical vectors comprising the plurality of numerical vectors that is representative of the constructed response. 21. The system of claim 19, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the convolutional neural network model further comprising: a second hidden layer of nodes, the second hidden layer including multiple sets of nodes, wherein each set of nodes of the second hidden layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 22. A non-transitory computer-readable storage medium for automatically scoring a constructed response generated by a user, the computer-readable storage medium comprising computer executable instructions which, when executed, cause a processing system to execute steps including: receiving a constructed response generated by a user, the constructed response being based on a given item; parsing the constructed response to identify in the constructed response a plurality of multi-character sequences; processing the plurality of multi-character sequences to generate a plurality of numerical vectors that is representative of the constructed response; and applying a convolutional neural network model associated with the given item to the plurality of numerical vectors to determine a score for the constructed response, the convolutional neural network model including an input layer configured to receive the plurality of numerical vectors, the input layer being connected to a following layer of the convolutional neural network model via a first plurality of connections, each of the connections having an associated first weight and passing a portion of the plurality of numerical vectors to the following layer, wherein at least a subset of the connections have a same first weight, a convolution layer including a plurality of nodes, each node of the convolution layer receiving input from an immediately-preceding layer of the convolutional neural network model, a hidden layer of nodes configured to receive inputs from the convolution layer via a second plurality of connections, each of the second plurality of connections having an associated second weight, wherein at least a subset of the second plurality of connections have a same second weight, and wherein each node of the hidden layer generates an output based on a weighted summation of received inputs, and an output layer connected to the hidden layer via a third plurality of connections, each of the third plurality of connections having an associated third weight and passing one of the outputs from the hidden layer to the output layer, wherein the output layer is configured to generate a score for the constructed response based on the received outputs and the third weights. 23. The non-transitory computer-readable storage medium of claim 22, wherein each of the multi-character sequences has a same number of characters, and wherein the computer executable instructions cause the processing system to execute steps including: parsing each of the multi-character sequences to identify in the multi-character sequence a plurality of single characters; transforming each of the single characters into a numerical vector using an encoding algorithm; for each of the multi-character sequences, joining the numerical vectors for the associated single characters end-to-end, wherein the joining of the numerical vectors generates a second numerical vector associated with the multi-character sequence, the second numerical vectors comprising the plurality of numerical vectors that is representative of the constructed response. 24. The non-transitory computer-readable storage medium of claim 22, wherein the input layer comprises multiple sets of nodes, each set of nodes being configured to receive a numerical vector of the plurality of numerical vectors, each numerical vector of the plurality of numerical vectors being representative of a portion of the constructed response, the convolutional neural network model further comprising: a second hidden layer of nodes, the second hidden layer including multiple sets of nodes, wherein each set of nodes of the second hidden layer is (i) connected, directly or indirectly, to a set of nodes of the input layer, and (ii) configured to generate a second numerical vector based on the numerical vector received at the connected set of nodes of the input layer. 25. A computer-implemented method of automatically scoring a constructed response using a convolutional neural network, the method comprising: obtaining a constructed response; processing the constructed response with a processing system to generate a plurality of first vectors containing numeric values, the plurality of first vectors being representative of the constructed response; applying, using the processing system, a convolution layer of a convolutional neural network to the plurality of first vectors, the convolution layer including a first plurality of nodes that each receive input from the plurality of first vectors; applying, using the processing system, a hidden layer of the convolutional neural network to an output of the convolution layer in order to generate a plurality of second vectors, the hidden layer including a second plurality of nodes that each receive input from at least one of the first plurality of nodes; and applying, using the processing system, an output layer of the convolutional neural network to an output of a top-most hidden layer in order to generate a score for the constructed response. 26. The computer-implemented method of claim 25, wherein the constructed response is a textual response. 27. The computer-implemented method of claim 26, wherein the processing of the constructed response includes: parsing the constructed response with the processing system to identify in the constructed response a plurality of words; and transforming, using an encoding algorithm, each of the words into a vector containing numeric values. 28. The computer-implemented method of claim 25, wherein the constructed response is a spoken response. 29. The computer-implemented method of claim 28, wherein the processing of the constructed response includes: parsing the constructed response with the processing system to identify in the constructed response a plurality of acoustic frames; and transforming, using a signal processing algorithm, each of the acoustic frames into a vector containing numeric values. 30. The computer-implemented method of claim 25, wherein the plurality of second vectors are representative of one or more patterns included in the constructed response. 31. The computer-implemented method of claim 25, further comprising: applying, using the processing system, a second convolution layer of the convolutional neural network to the plurality of second vectors, the second convolution layer including a third plurality of nodes that each receive input from the plurality of second vectors. 32. The computer-implemented method of claim 25, wherein each node of the convolution layer applies a set of kernels that operate on the input received from the plurality of first vectors. 33. The computer-implemented method of claim 25, wherein at least a subset of the nodes of the convolution layer share weights for computing activations based on the input received from the plurality of first vectors. 34. A system for automatically scoring a constructed response using a convolutional neural network, the system comprising: a processing system; and computer-readable memory in communication with the processing system encoded with instructions for commanding the processing system to execute steps comprising: obtaining a constructed response; processing the constructed response to generate a plurality of first vectors containing numeric values, the plurality of first vectors being representative of the constructed response; applying a convolution layer of a convolutional neural network to the plurality of first vectors, the convolution layer including a first plurality of nodes that each receive input from the plurality of first vectors; applying a hidden layer of the convolutional neural network to an output of the convolution layer in order to generate a plurality of second vectors, the hidden layer including a second plurality of nodes that each receive input from at least one of the first plurality of nodes; and applying an output layer of the convolutional neural network to an output of a top-most hidden layer in order to generate a score for the constructed response. 35. A non-transitory computer-readable storage medium for automatically scoring a constructed response using a convolutional neural network, the computer-readable storage medium comprising computer executable instructions which, when executed, cause a processing system to execute steps including: obtaining a constructed response; processing the constructed response to generate a plurality of first vectors containing numeric values, the plurality of first vectors being representative of the constructed response; applying a convolution layer of a convolutional neural network to the plurality of first vectors, the convolution layer including a first plurality of nodes that each receive input from the plurality of first vectors; applying a hidden layer of the convolutional neural network to an output of the convolution layer in order to generate a plurality of second vectors, the hidden layer including a second plurality of nodes that each receive input from at least one of the first plurality of nodes; and applying an output layer of the convolutional neural network to an output of a top-most hidden layer in order to generate a score for the constructed response.