title: Bashscript with curl operation in parallel
body: <p>I have a list with urls which I like to load with CURL and do some operations on the result with a bash script.
  Since it are almost 100k requests I like to run this in parallel.
  I already looked into GNU parallel, but how am I going to glue all together? Thanks!</p>
  
  <p>The bashscript:</p>
  
  <pre><code>while read URL; do
  curl -L -H "Accept: application/unixref+xml" $URL &gt; temp.xml;
  
  YEAR=$(xmllint --xpath '//year' temp.xml);
  MONTH=$(xmllint --xpath '(//date/month)[1]' temp.xml);
  
  echo "$URL;$YEAR;$MONTH" &gt;&gt; results.csv;
  
  sed -i '1d' urls.txt;
  
  done &lt; urls.txt;
  </code></pre>