The present teaching relates to estimating one or more parameters on a system including a plurality of nodes. In one example, the system comprises: one or more learner nodes, each of which is configured for generating information related to a group of words for estimating the one or more parameters associated with a machine learning model; and a plurality of server nodes, each of which is configured for obtaining a plurality of sub-vectors each of which is a portion of a vector that represents a word in the group of words, updating the sub-vectors based at least partially on the information to generate a plurality of updated sub-vectors, and estimating at least one of the one or more parameters associated with the machine learning model based on the plurality of updated sub-vectors.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A system including a plurality of nodes, each of which has at least one processor, storage, and a communication platform connected to a network for estimating one or more parameters on the plurality of nodes, the system comprising: one or more learner nodes, each of which is configured for generating information related to a group of words for estimating the one or more parameters associated with a machine learning model; and a plurality of server nodes, each of which is configured for obtaining a plurality of sub-vectors each of which is a portion of a vector that represents a word in the group of words, updating the sub-vectors based at least partially on the information to generate a plurality of updated sub-vectors, and estimating at least one of the one or more parameters associated with the machine learning model based on the plurality of updated sub-vectors. 2. The system of claim 1, wherein the information related to the group of words includes a first index for a center word, and a second set of one or more indices for one or more positive context words of the center word. 3. The system of claim 2, wherein: the information related to the group of words further includes a random seed; and each of the plurality of server nodes is further configured for generating, based on the random seed and the first index, a third set of one or more indices for one or more negative words that are not semantically related to the center word. 4. The system of claim 3, wherein obtaining a sub-vector of each vector comprises: obtaining, based on the first index, a first sub-vector that is a portion of a first vector representing the center word; obtaining, based on the second set of one or more indices, a second set of one or more sub-vectors each of which is a portion of a second vector representing one of the one or more positive context words; and obtaining, based on the third set of one or more indices, a third set of one or more sub-vectors each of which is a portion of a third vector representing one of the one or more negative words. 5. The system of claim 4, wherein each of the plurality of server nodes is further configured for: calculating a plurality of partial dot products each of which is a dot product of two vectors, wherein the two vectors include the first sub-vector and one of the second and third sets of sub-vectors; and providing the plurality of partial dot products to at least one of the one or more learner nodes. 6. The system of claim 5, wherein: each of the at least one of the one or more learner nodes is configured for computing weights based at least partially on the plurality of partial dot products; and the sub-vectors are updated based at least partially on the weights. 7. The system of claim 1, further comprising a driver node configured for: receiving a request for estimating the one or more parameters associated with the machine learning model; obtaining a plurality of vectors each of which represents a word in the group of words; dividing each vector in the plurality of vectors into a plurality of sub-vectors; selecting, based on the request, the one or more learner nodes and the plurality of server nodes for training the machine learning model; and initializing at least some vectors in the plurality of vectors with random numbers. 8. A method implemented on at least one computing device each of which has at least one processor, storage, and a communication platform connected to a network for estimating one or more parameters on a node in a cluster of distributed nodes, the method comprising: receiving, at the node, information related to a group of words for estimating the one or more parameters associated with a machine learning model; obtaining, at the node, a plurality of sub-vectors each of which is a portion of a vector that represents a word in the group of words, wherein the vector includes one or more additional sub-vectors each of which is allocated to one of other nodes in the cluster; updating, at the node, the plurality of sub-vectors based at least partially on the information to generate a plurality of updated sub-vectors; and estimating, at the node, at least one of the one or more parameters of the machine learning model based on the plurality of updated sub-vectors. 9. The method of claim 8, wherein the information related to the group of words includes a first index for a center word, and a second set of one or more indices for one or more positive context words of the center word. 10. The method of claim 9, further comprising: generating, based on a random seed and the first index, a third set of one or more indices for one or more negative words that are not semantically related to the center word, wherein the information related to the group of words further includes the random seed. 11. The method of claim 10, wherein obtaining the plurality of sub-vectors comprises: obtaining, based on the first index, a first sub-vector that is a portion of a first vector representing the center word; obtaining, based on the second set of one or more indices, a second set of one or more sub-vectors each of which is a portion of a second vector representing one of the one or more positive context words; and obtaining, based on the third set of one or more indices, a third set of one or more sub-vectors each of which is a portion of a third vector representing one of the one or more negative words. 12. The method of claim 11, further comprising: calculating a plurality of partial dot products each of which is a dot product of two vectors, wherein the two vectors include the first sub-vector and one of the second and third sets of sub-vectors; and providing the plurality of partial dot products to at least one of the one or more learner nodes. 13. The method of claim 12, further comprising: deleting the information related to the group of words and the first index, the second, and third sets of indices; receiving the information including the random seed again from the learner node; regenerating the third set of one or more indices based on the random seed; and receiving weights from the learner node, wherein the weights are calculated by the learner node based at least partially on the plurality of partial dot products, wherein the plurality of sub-vectors are updated based at least partially on the weights. 14. The method of claim 8, wherein: the machine learning model is utilized to determine one or more advertisements based on a query; and the one or more advertisements are to be provided in response to the query. 15. An apparatus, implemented on a node in a cluster of distributed nodes, having at least one processor, storage, and a communication platform connected to a network for estimating one or more parameters on the node, comprising: a remote procedure call analyzer configured for receiving information related to a group of words for estimating the one or more parameters associated with a machine learning model; a word vector retriever configured for obtaining a plurality of sub-vectors each of which is a portion of a vector that represents a word in the group of words, wherein the vector includes one or more additional sub-vectors each of which is allocated to one of other nodes in the cluster; and a word vector updater configured for updating the plurality of sub-vectors based at least partially on the information to generate a plurality of updated sub-vectors and estimating at least one of the one or more parameters of the machine learning model based on the plurality of updated sub-vectors. 16. The apparatus of claim 15, wherein the information related to the group of words includes a first index for a center word, and a second set of one or more indices for one or more positive context words of the center word. 17. The apparatus of claim 16, further comprising: a negative example generator configured for generating, based on a random seed and the first index, a third set of one or more indices for one or more negative words that are not semantically related to the center word, wherein the information related to the group of words further includes the random seed. 18. The apparatus of claim 16, wherein obtaining the plurality of sub-vectors comprises: obtaining, based on the first index, a first sub-vector that is a portion of a first vector representing the center word; obtaining, based on the second set of one or more indices, a second set of one or more sub-vectors each of which is a portion of a second vector representing one of the one or more positive context words; and obtaining, based on the third set of one or more indices, a third set of one or more sub-vectors each of which is a portion of a third vector representing one of the one or more negative words. 19. The apparatus of claim 17, further comprising a partial dot product calculator configured for: calculating a plurality of partial dot products each of which is a dot product of two vectors, wherein the two vectors include the first sub-vector and one of the second and third sets of sub-vectors; and providing the plurality of partial dot products to at least one of the one or more learner nodes. 20. The apparatus of claim 19, wherein the remote procedure call analyzer is further configured for: deleting the information related to the group of words and the first index, the second, and third sets of indices; receiving the information including the random seed again from the learner node, wherein the third set of one or more indices are regenerated based on the random seed; and receiving weights from the learner node, wherein the weights are calculated by the learner node based at least partially on the plurality of partial dot products, wherein the plurality of sub-vectors are updated based at least partially on the weights. 21. A machine-readable tangible and non-transitory medium having information for estimating one or more parameters on a node in a cluster of distributed nodes, wherein the information, when read by the machine, causes the machine to perform the following: receiving, at the node, information related to a group of words for estimating the one or more parameters associated with a machine learning model; obtaining, at the node, a plurality of sub-vectors each of which is a portion of a vector that represents a word in the group of words, wherein the vector includes one or more additional sub-vectors each of which is allocated to one of other nodes in the cluster; updating, at the node, the plurality of sub-vectors based at least partially on the information to generate a plurality of updated sub-vectors; and estimating, at the node, at least one of the one or more parameters of the machine learning model based on the plurality of updated sub-vectors. 22. The system of claim 1, wherein: the machine learning model is utilized for determining one or more nearest words for a target word in the group of words, in terms of cosine distances of their respective vectors, based on a Locality Sensitive Hashing (LSH) table. 23. The system of claim 1, wherein the machine learning model is trained based on an algorithm with architecture of either skip-gram or continuous bag of words (CBOW).