title: Spark/Scala parallel write to redis
body: <p>Is it possible to write to Redis in parallel from spark? </p>
  
  <p>(Or: how to write tens of thousands of keys/lists quickly from spark)</p>
  
  <p>Currently, I'm writing to Redis by key in sequence, and it's taking <em>forever</em>. I need to write about 90000 lists (of length 2-2000). Speed is extremely important. Currently, it's taking on the order of 1 hour. Tradition benchmarks of Redis claim thousands of Redis writes per second, but in my pipeline, I'm not anywhere near that. </p>
  
  <p>Any help is appreciated. </p>