title: spark-scala: download a list of URLs from a particular column
body: <p>I have <code>CSV</code> file which contains details of all the candidates who have applied for a particular positions.  </p>
  
  <p>Sample Data: (notice that all the resume URL are of different file types-pdf,docx,doc)</p>
  
  <pre><code>Name    age Resume_file
  A1      20  http://resumeOfcandidateA1.pdf
  A2      20  http://resumeOfcandidateA2.docx
  </code></pre>
  
  <p>I wish to download the contents of resume URL given in 3rd Column into my table. </p>
  
  <p>I tried using <code>“wget” + “pdftotext”</code> command to download the list of resumes but that did not help as for each URL it would create a different file in my cluster (outside the table) and linking it to the rest of the table was not possible due to lack of a unique criteria.</p>
  
  <p>I even tried using <code>scala.io.Source</code>, but this required  mentioning the link explicitly each time to download the contents and this too was outside the table.</p>