dataproc/Check Cluster Quota

Verify if the Dataproc cluster has quota issues.

Product: Cloud Dataproc
Step Type: START

Description

Checks if the Dataproc cluster had creation issues due to quota.

Failure Reason

The cluster {cluster_name} in project {project_id} could not be created due to insufficient quota in the project.

Failure Remediation

This issue occurs when the requested Dataproc cluster exceeds the project’s available quota for resources such as CPU, disk space, or IP addresses. To resolve this issue:

Request additional quota [1] via the Google Cloud console.
Create the cluster in a different project. [1] https://cloud.google.com/docs/quotas/view-manage#managing_your_quota_console

Success Reason

No issues with insufficient quota identified for cluster {cluster_name} in project {project_id}. If the intended cluster does not appear in the Dataproc UI, verify the provided cluster_name parameter.