composer/WARN/2023_007
Cloud Composer Scheduler CPU limit exceeded
Product: Cloud Composer Rule class: WARN - Something that is possibly wrong
Description
Airflow scheduler’s CPU and memory metrics help you check whether the scheduler’s performance is a bottleneck in the overall Airflow performance.
Remediation
If Scheduler CPU usage exceeds 80% for longer than a few percent of the total time, you might want to:
Increase the DAG file parsing interval and increase the DAG directory listing interval Increase the number of schedulers. Increase the CPU of schedulers.