title: community detection how to handle the huge edges
body: <p>I write a LPA algorithm to detect community, but when I try to construct the graph, I find that the edges is very huge (suppose 100K pepole see 1 movie, then I got 10^6 * 10^6 edges more than 100 billion), what should I do to deal with this, or JUST filtering the big collections?</p>