title: pyspark.sql.utils.AnalysisException: u'Unable to infer schema for Parquet. It must be specified manually.;'
body: <p><strong><em>This has a different answer to those given in the post above</em></strong></p>
  
  <p>I am getting an error that reads</p>
  
  <pre><code>pyspark.sql.utils.AnalysisException: u'Unable to infer schema for Parquet. It must be specified manually.;'
  </code></pre>
  
  <p>when I try to read in a parquet file like such using Spark 2.1.0</p>
  
  <pre><code>data = spark.read.parquet('/myhdfs/location/')
  </code></pre>
  
  <p>I have checked and the file/table is not empty by looking at the impala table through the Hue WebPortal. Also, other files that I have stored in similar directories read absolutely fine. For the record, the file names contain hyphens but no underscores or full-stops/periods.</p>
  
  <p>Hence, none of the answers in the following post apply  <a href="https://stackoverflow.com/questions/44954892/unable-to-infer-schema-when-loading-parquet-file">Unable to infer schema when loading Parquet file</a></p>
  
  <p>Any ideas?</p>