Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for organizing trained and untrained neural networks. In one aspect, a neural network device includes a collection of node assemblies interconnected by between-assembly links, each node assembly itself comprising a network of nodes interconnected by a plurality of within-assembly links, wherein each of the between-assembly links and the within-assembly links have an associated weight, each weight embodying a strength of connection between the nodes joined by the associated link, the nodes within each assembly being more likely to be connected to other nodes within that assembly than to be connected to nodes within others of the node assemblies.
Please help me write a proper abstract based on the patent claims. CLAIM: 1. A neural network device implemented in hardware, in software, or in a combination thereof, comprising: a collection of node assemblies interconnected by between-assembly links, each node assembly itself comprising a network of nodes interconnected by a plurality of within-assembly links, wherein each of the between-assembly links and the within-assembly links have an associated weight, each weight embodying a strength of connection between the nodes joined by the associated link, the nodes within each assembly being more likely to be connected to other nodes within that assembly than to be connected to nodes within others of the node assemblies. 2. The neural network device of claim 1, wherein the weights associated with the between-assembly links embody training of the neural device to a particular purpose. 3. The neural network device of claim 2, wherein the within-assembly links embody the training of the neural device to the particular purpose to a lesser extent than the between-assembly links. 4. The neural network device of claim 1, wherein the nodes are connected and the node assemblies formed according to pairwise connectivity profiles. 5. The neural network device of claim 1, wherein the variance in average weight within each of the node assemblies generally decreases for node assemblies having higher numbers of links. 6. The neural network device of claim 1, wherein the average strength of interconnection with each respective node assembly asymptotically approaches a respective limit as the number of links within the respective node assembly exceeds the number of nodes within the respective node assembly. 7. The neural network device of claim 6, wherein the respective limits are substantially identical. 8. The neural network device of claim 1, wherein, for node assemblies having a number of within-assembly links that is smaller than a number of nodes within the same node assembly, magnitudes of the weights of the within-assembly links are associated with distinguishably discrete levels of a set of levels. 9. The neural network device of claim 8, wherein each discrete level is associated with a different number of nodes within the assembly. 10. The neural network device of claim 1, further comprising an adaptor component configured to change the magnitude of each weight of the within-assembly links based on a number of other nodes within the assembly of each within-assembly link. 11. The neural network device of claim 10, wherein the adaptor component is configured to change the magnitude of each weight before the neural network device is trained. 12. The neural network device of claim 1, wherein the neural network device is untrained. 13. The neural network device of claim 1, further comprising an adaptor component configured to change a probability of connection between nodes in each node assembly based on a number of nodes within the node assembly. 14. The neural network device of claim 13, wherein the adaptor component is configured to change the magnitude of each weight before the neural network device is trained. 15. The neural network device of claim 1, wherein the links comprise reciprocal links and non-reciprocal links. 16. The neural network device of claim 15, wherein the non-reciprocal links are about twice as common as the reciprocal links. 17. The neural network device of claim 1, wherein the nodes within each assembly are about twice as likely to be connected to other nodes within that assembly than to be connected to nodes within others of the node assemblies. 18. The neural network device of claim 1, wherein a number of node assemblies having between ten and 100 nodes is greater than a number of node assemblies having less than ten and more than 100 nodes. 19. The neural network device of claim 1, wherein there are between ten and 100 node assemblies.