title: Airflow and Spark/Hadoop - Unique cluster or one for Airflow and other for Spark/Hadoop
body: <p>I'm trying to figure out which is the best way to work with Airflow and Spark/Hadoop.
  I already have a Spark/Hadoop cluster and I'm thinking about creating another cluster for Airflow that will submit jobs remotely to Spark/Hadoop cluster.</p>
  
  <p>Any advice about it? Looks like it's a little complicated to deploy spark remotely from another cluster and that will create some file configuration duplication.</p>