<p>I am somewhat new to Kubernetes, and I am trying to learn about deploying airflow to Kubernetes.</p>
<p>My objective is to try to deploy an &quot;out-of-the-box&quot; (or at least closer to that) deployment for airflow on Kubernetes. I have created the Kubernetes cluster via Terraform (on EKS), and would like to deploy airflow to the cluster. I found that Helm can help me deploy airflow easier relative to other solutions.</p>
<p>Here is what I have tried so far (snippet and not complete code):</p>
<pre><code>provider &quot;kubernetes&quot; {
  host                   = data.aws_eks_cluster.cluster.endpoint
  cluster_ca_certificate = base64decode(data.aws_eks_cluster.cluster.certificate_authority.0.data)
  token                  = data.aws_eks_cluster_auth.cluster.token
  load_config_file       = false
}


provider &quot;helm&quot; {
  kubernetes {
    config_path = &quot;~/.kube/config&quot;
  }
}

data &quot;helm_repository&quot; &quot;airflow&quot; {
  name = &quot;airflow&quot;
  url  = &quot;https://airflow-helm.github.io/charts&quot;
}


resource &quot;helm_release&quot; &quot;airflow&quot; {
  name  = &quot;airflow-helm&quot;
  repository = data.helm_repository.airflow.metadata[0].name
  chart = &quot;airflow-chart&quot;
}
</code></pre>
<p>I am not necessarily fixed on using Terraform (I just thought it might be easier and wanted to keep state). So I am also happy to discover other solutions that will help me airflow with all the pods needed.</p>

<p>You can install it using Helm from official repository, but there are a lot of additional configuration to consider. The Airflow config is described in chart's <a href="https://github.com/airflow-helm/charts/blob/main/charts/airflow/values.yaml" rel="nofollow noreferrer"><code>values.yaml</code></a>. You can take a look on <a href="https://medium.com/clarityai-engineering/running-airflow-in-kubernetes-and-aws-lessons-learned-part-1-77be9556846c" rel="nofollow noreferrer">this article</a> to check example configuration.</p>
<p>For installation using terraform you can take a look <a href="https://medium.com/typeforms-engineering-blog/deploy-airflow-1-10-10-in-kubernetes-using-terraform-and-helm-2476f03f07d0" rel="nofollow noreferrer">into this article</a>, where both Terraform config and helm chart's values are described in detail.</p>
