title: heavy iTunes Connect scraping
body: <p>I'm looking at different options to get the sales reports and other data out of the iTunes Connect website. Since Apple doesn't provide an API, all the solutions I found are based on scraping the page.</p>
  
  <p>As I need the information for a product that we offer, I'm not that happy to give all the iTunes accounts to a 3rd party service. This is why I want to scrape it myself or use a product that runs on our servers.</p>
  
  <p><strong>My questions are:</strong></p>
  
  <ul>
  <li>does someone have experience how frequent apple is changing the web front-end?</li>
  <li>has someone experience in maximum request from one server to the site? I'm afraid of being baned by apple.</li>
  <li>anything else I have to have in mind that will cause serious trouble?</li>
  </ul>
  
  <hr>
  
  <p>Just if someone is interested in the tools I looked at, here is a list:</p>
  
  <p>Services:</p>
  
  <ul>
  <li><a href="http://www.appfigures.com" rel="nofollow">http://www.appfigures.com</a> (has API)</li>
  <li><a href="http://www.itunesapis.com" rel="nofollow">http://www.itunesapis.com</a> </li>
  <li><a href="http://www.appannie.com/" rel="nofollow">http://www.appannie.com/</a></li>
  <li><a href="http://www.heartbeatapp.com" rel="nofollow">http://www.heartbeatapp.com</a></li>
  </ul>
  
  <p>Products:</p>
  
  <ul>
  <li><a href="http://www.appclix.com" rel="nofollow">http://www.appclix.com</a> (has a enterprise licence that runs on your own server, includes API. Tends to me more a mobile analytics tool in general)</li>
  <li><a href="http://www.ideaswarm.com/products/appviz/" rel="nofollow">http://www.ideaswarm.com/products/appviz/</a> (Mac enduser app)</li>
  </ul>
  
  <p>Open Source Tools:</p>
  
  <ul>
  <li><a href="http://code.google.com/p/appdailysales/" rel="nofollow">http://code.google.com/p/appdailysales/</a></li>
  <li><a href="http://metacpan.org/pod/WWW::iTunesConnect" rel="nofollow">http://metacpan.org/pod/WWW::iTunesConnect</a></li>
  <li><a href="http://www.rogueamoeba.com/utm/2009/05/04/itunesconnectarchiver/" rel="nofollow">http://www.rogueamoeba.com/utm/2009/05/04/itunesconnectarchiver/</a></li>
  <li><a href="http://github.com/kasatani/iphone-stats" rel="nofollow">http://github.com/kasatani/iphone-stats</a></li>
  <li><a href="http://bfoz.net/projects/itc/" rel="nofollow">http://bfoz.net/projects/itc/</a></li>
  <li><a href="http://sourceforge.net/projects/itunesanalytics/" rel="nofollow">http://sourceforge.net/projects/itunesanalytics/</a></li>
  </ul>
  
  <p><strong>UPDATE:</strong></p>
  
  <p>I started using Kirby's python script (<a href="https://github.com/kirbyt/appdailysales" rel="nofollow">https://github.com/kirbyt/appdailysales</a>) and it works very well.</p>