DATAPROC

Stackdriver Logging is enabled in the cluster

Cloud Monitoring agent is enabled.

Another dummy async rule

Dummy async rule

Dataproc is not using deprecated images

Dataproc Service Account permissions

Dataproc on GCE master VM is able to communicate with worker VM

Dataproc cluster initialization completed by the end of the timeout period.

Checking if any orphaned YARN application has been killed by dataproc agent in the cluster.

Dataproc cluster check IAM permission to launch cluster

Dataproc cluster firewall rules for connectivity between master and worker nodes established!

Dataproc cluster has sufficient quota

Dataproc cluster check permissions on shared Host VPC Project

Region has sufficient resources for user to create a cluster

Disk space of YARN NodeManagers is okay.

Dataproc cluster is in RUNNING state

Dataproc clusters are not failed to stop due to the local SSDs

Dataproc VM Service Account has necessary permissions

Job rate limit was not exceeded

Dataproc cluster is in RUNNING state

Concurrent Job limit was not exceeded

Master Node High System Memory Usage

HDFS NameNode Safemode is disabled.

HDFS can write file(s) to DataNode(s).