composer/_ Log Check Step
Base class for performing a log query and reporting results.
COMPOSER
All steps available in composer
composer/Check Auth
Check for Redis authentication failures.
composer/Check Celery Broker Publishing Timeouts
Check for Celery broker publishing timeouts.
composer/Check Deleted Airflow Scheduler Deployment
Check the deleted airflow-scheduler deployment via Cloud Logging.
composer/Check Ephemeral Storage
Check for worker pod evictions due to ephemeral storage exhaustion.
composer/Check Firewall
Check for Firewall rules blocking Redis traffic.
composer/Check Gcs Syncd Ephemeral Storage Limit
Check for gcs-syncd container hitting its ephemeral limit.
composer/Check Gke Preemption
Check if worker pods were preempted by GKE.
composer/Check Liveness Probes
Checks for failed Liveness probes on worker pods.
composer/Check Redis Oom
Check for Redis OOM on Container.
composer/Check Redis Oom Node
Check for Redis OOM on Node.
composer/Check Scheduler Exceeded Runs
Check the scheduler exceeded 5,000 runs via Cloud Logging.
composer/Check Scheduling Failures
Check for worker pods failing to schedule due to quota issues.
composer/Check Worker Oom
Check for Out-of-Memory (OOM) events in worker pods.
composer/Check Zombie Tasks
Check for Zombie tasks or SIGKILL signals in environment logs.
composer/Deleted Environment Service Account
Checks the deleted environment service account via Cloud Logging.
composer/Disabled Environment Service Account
Check the disabled/deleted environment service account via Cloud Logging.
composer/End Step
End step for the runbook.
composer/Gke Ip Exhaustion
Check if the GKE cluster has IP exhaustion.
composer/Infrastructure Checks
Composite step for GKE and Pod stability investigations.
composer/Log Check Step
Base class for performing a log query and reporting results for a given step.
composer/Monitoring Health Status
Check if Cloud Monitoring reports the environment as unhealthy.
composer/Monitoring Stability
Check the stability of the Composer environment’s Monitoring Pod via cloud logging.
composer/Plugins Directory Check
Check if the Composer environment’s plugins directory exists.
composer/Redis End
End step for Redis troubleshooting.
composer/Redis Troubleshooting Start
Validates environment existence and extracts GKE metadata.
composer/Runbook Airflow Worker Restart End
End step for Airflow worker restart runbook.
composer/Scheduler Cpu Utilization
Check the scheduler CPU utilization via Monitoring.
composer/Scheduler Health Check
Check the scheduler health via Monitoring.
composer/Scheduler Issues Start
Validates environment existence and extracts GKE metadata.
composer/Scheduler Liveness Probe Check
Check the liveness probe logs for the scheduler via Cloud Logging.
composer/Service Account Status
Check the status of the Composer environment’s service accounts.
composer/Shared Vpc Org Policy Constraint
Check the shared VPC org policy constraint via Cloud Logging.
composer/Snapshot Load Stability
Check the stability of the Composer environment’s Snapshot Load via cloud logging.
composer/Unhealthy Composer End
End of the runbook.
composer/Unhealthy Composer Start
Start step for the unhealthy Composer environment diagnostic tree.
composer/Web Server Cpu Utilization
Check the CPU utilization of the Composer environment’s web server.
composer/Worker Restart Start
Validates environment existence and extracts GKE metadata.