dataproc/Check Cluster Quota

Verify if the Dataproc cluster has quota issues.

Product: Cloud Dataproc
Step Type: START

Description

Checks if the Dataproc cluster had creation issues due to quota.

Failure Reason

The cluster {cluster_name} in project {project_id} could not be created due to insufficient quota in the project.

Failure Remediation

This issue occurs when the requested Dataproc cluster exceeds the project’s available quota for resources such as CPU, disk space, or IP addresses. Solution: Request additional quota [1] from the Google Cloud console or use another project. [1] https://cloud.google.com/docs/quotas/view-manage#managing_your_quota_console

Success Reason

No issues with insufficient quota in project {project_id} has been identified for the ivestigated cluster {cluster_name}, please double-check if you have provided the right cluster_name parameter if the cluster you are trying to create doesn’t appear in Dataproc UI.