dataproc/Check Autoscaling Policy

Verify autoscaling policies.

Product: Cloud Dataproc
Step Type: AUTOMATED STEP

Description

None

Failure Reason

Autoscaling is enabled without graceful decommission timeout on cluster {cluster_name}

Failure Remediation

Enable graceful decommission timeout in the autoscaling policy to allow executors to fetch shuffle data before nodes are removed.