title: Extract Distinct Record in SSIS
body: <p>I am writing the SSIS package to import the data from *.csv files to the SQL 2008 DB.  The problem is that one of the file contains the duplicate records in the csv file and I want to extract only the distinct values from that source.  Please see the image below.</p>
  
  <h2><img src="https://i.stack.imgur.com/YNyOq.jpg" alt="Duplicate"></h2>
  
  <p>Unfortunately, the generated files are not under my control and it is owned by the third party and I could not change the way they generated.</p>
  
  <p>I did use the LookUp Component.  But it only checks the existing data against the incoming data.  It does not check the duplicate records in the incoming data.</p>