<p>I've deployed an Airflow instance on Kubernetes using the <code>stable/airflow</code> helm chart. I slightly modified the <code>puckel/docker-airflow</code> image to be able to install the Kubernetes executor. All tasks are now being executed successfully on our Kubernetes cluster, but the logs of these tasks are nowhere to be found.</p>

<p>I would like to upload the logs to our Azure Blob Storage account. I've configured my environment variables like this:</p>

<pre><code>AIRFLOW__CORE__REMOTE_BASE_LOG_FOLDER="wasb-airflow"
AIRFLOW__CORE__REMOTE_LOG_CONN_ID="wasb_default"
AIRFLOW__CORE__REMOTE_LOGGING="True"
</code></pre>

<p>The <code>wasb_default</code> connection includes a login and password for the Azure Blob Storage account. I've tested this connection using a <code>WasbHook</code> and was able to delete a dummy file with success.</p>

<p>When I try to view the logs, this message is displayed:</p>

<pre><code>*** Log file does not exist: /usr/local/airflow/logs/example_python_operator/print_the_context/2019-11-29T15:42:25+00:00/1.log
*** Fetching from: http://examplepythonoperatorprintthecontext-4a6e6a1f11fd431f8c2a1dc081:8793/log/example_python_operator/print_the_context/2019-11-29T15:42:25+00:00/1.log
*** Failed to fetch log file from worker. HTTPConnectionPool(host='examplepythonoperatorprintthecontext-4a6e6a1f11fd431f8c2a1dc081', port=8793): Max retries exceeded with url: /log/example_python_operator/print_the_context/2019-11-29T15:42:25+00:00/1.log (Caused by NewConnectionError('&lt;urllib3.connection.HTTPConnection object at 0x7f34ecdbe990&gt;: Failed to establish a new connection: [Errno -2] Name or service not known'))
</code></pre>

<p>Any ideas on how to solve this problem?</p>

Wouter Goossens
<p>Found the solution. Increase the <code>AIRFLOW__WEBSERVER__LOG_FETCH_TIMEOUT_SEC</code> environment variable to something like 15.</p>
