title: Hadoop Capacity Scheduler and Spark
body: <p>If I define CapacityScheduler Queues in yarn as explained here</p>
  
  <p><a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html" rel="nofollow">http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/CapacityScheduler.html</a></p>
  
  <p>how do I make spark use this? </p>
  
  <p>I want to run spark jobs... but they should not take up all the cluster but instead execute on a CapacityScheduler which has a fixed set of resources allocated to it.</p>
  
  <p>Is that possible ... specifically on the cloudera platform (given that spark on cloudera runs on yarn?).</p>