title: Remove the Junk charcters from hive tables or from unix
body: <p>We have the tables in hive like below and we are generating the flat files from hive data while we are generating we found that there was junk characteres with in the data like below we have many characters in many columns can any one help us to remove those junk characters from hive table or from unix file ?</p>
  
  <p>ÿ,ä,í,ã</p>
  
  <p>Here problem the same data need to send the downstream when they are loading in to there DB it shows as double dollar but we design code double dollar as column delimiter.</p>