title: EM Dash in CSV causing issues with Pandas
body: <p>I  have encountered an issue with EM Dash in my csv raw data file that prevents Pandas from reading the CSV.</p>
  
  <p>I ran a few variations below</p>
  
  <pre><code>    datalocation = filepath
      df = pd.read_csv(datalocation)
  </code></pre>
  
  <p>Received the error: 'UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 4: ordinal not in range(128)'</p>
  
  <p>other variation includes</p>
  
  <pre><code>    df = pd.read_csv(datalocation, encoding='utf-8')
      df = pd.read_csv(datalocation, encoding='utf-16')
  </code></pre>
  
  <p>Received the error:'UnicodeDecodeError: 'utf8' codec can't decode byte 0xff in position 0: invalid start byte'</p>
  
  <pre><code>    df = pd.read_csv(datalocation, na_values=['—'])
  </code></pre>
  
  <p>Received the error:'line contains NULL byte'</p>
  
  <p>If it was successful, the dataframe should be similar to the sample table below.</p>
  
  <pre><code>+---------+------+----------+--------+
  | Country | Date | Delivery | Region |
  +---------+------+----------+--------+
  | a       | —    | 10       | foo    |
  | b       | —    | 30       | —      |
  | c       | 2    | —50      | foo—   |
  | —       | —    | 20       | —bar   |
  | a       | —    | 40       | bar—   |
  | —       | —    | —6—      | bar    |
  | b       | —    | 90—      | foo    |
  | c       | —    | 70       | bar    |
  | a       | —    | 80       | foo    |
  | c       | —    | 100      | foo—   |
  +---------+------+----------+--------+
  </code></pre>
  
  <p>After spending time researching the resources on SO, I understand that it has to do with some conflict across Unicode/UTF-8/ASCII. </p>
  
  <p>Is there a way to remove all the EM Dash's prior to running 'pd.read_csv'? Keep in mind, I don't know the precise cells of all the EM Dash's in the csv raw file.</p>