title: How to output Airflow's scheduler log to stdout or S3 / GCS
body: <p>We're running Airflow cluster using <a href="https://github.com/puckel/docker-airflow" rel="nofollow noreferrer">puckel/airflow</a> docker image with docker-compose. Airflow's scheduler container outputs its logs to <code>/usr/local/airflow/logs/scheduler</code>.</p>
  <p>The problem is that the log files are not rotated and disk usage increases until the disk gets full. <a href="https://github.com/teamclairvoyant/airflow-maintenance-dags/blob/master/log-cleanup/airflow-log-cleanup.py" rel="nofollow noreferrer">Dag for cleaning up the log directory</a> is available but the DAG run on worker node and log directory on scheduler container is not cleaned up.</p>
  <p>I'm looking for the way to output scheduler log to stdout or S3/GCS bucket but unable to find out. Is there any to output the scheduler log to stdout or S3/GCS bucket?</p>