title: pandas dataframe creation from dict or list too slow, any suggestions?
body: <p>Hello I am trying to create a pandas dataframe from (a list of dicts or a dict of dicts) that has an eventual shape of 60,000 rows and 10,000~ columns</p>
  
  <p>Values of columns are 0 or 1 and really sparse. </p>
  
  <p>The list/dict object creation is fast, but when I do from_dict or from_records I get memory errors. I also tried appending to a dataframe periodically rather than at once and it still didn't work. I also tried changing all individual cells, with no avail. </p>
  
  <p>By the way I am building my python object from a 100 json files that I parse.</p>
  
  <p>How can I go from python objects to dataframes? Maybe I can also use something else. I eventually want to feed it to an sk-learn algorithm.</p>