dataproc/Check Sw Preemption

Verify if secondary worker preemption has happened.

Product: Cloud Dataproc
Step Type: COMPOSITE STEP

None

Found logs messages related to secondary worker preemption on the cluster: {cluster_name}.

This error occurs when secondary worker nodes are preempted. By default, Dataproc secondary workers are preemptible VMs. To resolve this issue:

Verify if the cluster uses secondary workers with preemptible instances.
Recreate the cluster configured with non-preemptible secondary workers to ensure secondary workers are not preempted [1]. [1] https://cloud.google.com/dataproc/docs/concepts/compute/secondary-vms#non-preemptible_workers

Didn’t find logs messages related to secondary worker preemption on the cluster: {cluster_name}.