title: How spark read a large file (petabyte) when file can not be fit in spark's main memory
body: <p>What will happen for large files in these cases?</p>
  
  <p>1) Spark gets a location from NameNode for data . Will Spark stop in this same time because data size is too long as per information from NameNode?</p>
  
  <p>2) Spark do partition of data as per datanode block size but all data can not be stored into main memory. Here we are not using StorageLevel. So what will happen here?</p>
  
  <p>3) Spark do partition the data, some data will store on main memory once this main memory store's data will process again spark will load other data from disc.</p>