<p>I'm current using <a href="https://airflow.apache.org/" rel="nofollow noreferrer">Apache Airflow</a> on Kubernetes (aws <a href="https://aws.amazon.com/eks/" rel="nofollow noreferrer">EKS</a>) to schedule batch processing jobs. For large infrequent jobs I'm using <a href="https://docs.aws.amazon.com/eks/latest/userguide/fargate.html" rel="nofollow noreferrer">EKS Fargate</a>.</p>
<p>According to the docs <a href="https://docs.aws.amazon.com/eks/latest/userguide/fargate-pod-configuration.html" rel="nofollow noreferrer">here</a>:</p>
<blockquote>
<p>When provisioned, each pod running on Fargate receives 20 GB of
container image layer storage. Pod storage is ephemeral.</p>
</blockquote>
<p>I am running workloads that require larger ephemeral storage than 20 GBs. Reading the docs <a href="https://docs.aws.amazon.com/AmazonECS/latest/APIReference/API_EphemeralStorage.html" rel="nofollow noreferrer">here</a> on ECS Fargate make me think it's possible (at least for ECS) to modify the initial ephemeral storage:</p>
<blockquote>
<p>The minimum supported value is 21 GiB and the maximum supported value
is 200 GiB.</p>
</blockquote>
<p>Lastly, I'm currently using <a href="https://airflow.apache.org/docs/apache-airflow/1.10.12/_api/airflow/contrib/operators/kubernetes_pod_operator/index.html" rel="nofollow noreferrer">KubernetesPodOperator</a> in airflow, which allows me to add annotations, labels, tags, resource limits...etc. when launching Fargate pods.</p>
<p>Is it possible to launch Fargate pods on EKS with larger default ephemeral storage? If so how?</p>

alt-f4
<p>It is not possible to use the Fargate extended ephemeral local storage option with EKS (it is only possible with ECS for now). An alternative you can explore (if you haven't done so already) is to mount an EFS volume to the Fargate pods. While EFS may have different performance characteristics than local ephemeral storage, EFS would allow you to mount the same volume to multiple pods (if that architecture is supported by and useful for your application).</p>
