dataproc/WARN/2023_002
Master Node High System Memory Usage
Product: Cloud Dataproc
Rule class: WARN - Something that is possibly wrong
Description
By default, the Dataproc agent throttles job submission when memory use reaches 90% (0.9). When this limit is reached, new jobs cannot be scheduled. The amount of free memory needed to schedule another job on the cluster is not sufficient.
Remediation
When you create a cluster Increase the value of the dataproc:dataproc.scheduler.max-memory-used cluster property. For example, set it above the 0.90 default to 0.95. Setting the value to 1.0 disables master-memory-utilization job throttling.