title: Is there a better way to collect twitter data?
body: <p>I am working on a community detection project with Twitter data where I need to create a network on the basis of relationships. I collected and filtered 200,000 UIDs. My next step involves creating a friend/follower network among them. </p>
  
  <p>I am using Ruby scripts and a Twitter gem to collect, process and store data. To overcome the API calls limit, I am using Apigee proxy so there is no issue of rate limiting for now. </p>
  
  <p>The call to get the relationship status between two UIDs is at: <a href="https://dev.twitter.com/docs/api/1/get/friendships/show" rel="noreferrer">https://dev.twitter.com/docs/api/1/get/friendships/show</a></p>
  
  <p>I need to speed up the process of collecting data. Currently I have many scripts running simultaneously in my terminal. I find this method very hard to manage and scale. Is there a faster, efficient and manageable way to do the same thing? OR Is there a completely different and better approach which I am missing?</p>