title: Remove duplicate data in a file
body: <p>I have a problem coming up with an algorithm. Will you, guys, help me out here?</p>
  
  <p>I have a file which is huge and thus can not be loaded at once. There exists duplicate data (generic data, might be strings). I need to remove duplicates.</p>