title: Read part files from hdfs into data frame using pySpark
body: <p>I have multiple files stored in a hdfs location as follows</p>
  <blockquote>
  <p>/user/project/202005/part-01798</p>
  <p>/user/project/202005/part-01799</p>
  </blockquote>
  <p>There are 2000 such part files. Each file is of the format</p>
  <pre><code>{'Name':'abc','Age':28,'Marks':[20,25,30]} 
  {'Name':...} 
  </code></pre>
  <p>and so on . I have 2 questions</p>
  <pre><code>1) How to check whether these are multiple files or multiple partitions of the same file
  2) How to read these in a data frame using pyspark
  </code></pre>