title: ParserError: Error tokenizing data. C error: Calling read(nbytes) on source failed. Try engine='python'
body: <p>I get this error when I try to open the CSV file (occupies 500Mb):</p>
  
  <pre><code>ParserError: Error tokenizing data. C error: Calling read(nbytes) on source failed. Try engine='python'.
  </code></pre>
  
  <p>This is the code that I used to create the file that I now try to open. This code reads numerous files in the folder and merges them ina single pandas DataFrame. All of these files have the same number of columns, while different number of rows.</p>
  
  <pre><code>base_path = "C://Test"
  path, dirs, files = next(os.walk(base_path))
  
  df_main = pd.DataFrame
  for f in files:
      file_path = base_path+"/"+f
      df = pd.read_csv(file_path, sep=";", index_col=False)
      if df_main.empty:
          df_main = df
      else:
          df_main = pd.concat([df_main, df], ignore_index=True)
  </code></pre>