DATAFLOW

All steps available in dataflow


dataflow/Batch Elapsed Time

Has step to check job elapsed time.

dataflow/Batch Failed Job Logs

Has common step to check job state is not failed.

dataflow/Batch Throughput

Has step to check job throughput is not stalled.

dataflow/Batch Worker Metrics

Has step to check job’s workers.

dataflow/Dataflow Permissions End

RUNBOOK COMPLETED.

dataflow/Dataflow Quotas

Has common step to check if any Dataflow quotas are being exceeded in the project.

dataflow/Dataflow Resource Permissions

Check the Dataflow Resource permissions.

dataflow/Dataflow User Account Permissions

Check the User account permissions.

dataflow/Dataflow Worker Service Account Permissions

Check the Dataflow Worker account permissions.

dataflow/Failed Batch Pipeline End

End of the runbook.

dataflow/Failed Batch Pipeline Start

Start step.

dataflow/Failed Streaming Pipeline End

End of the runbook.

dataflow/Failed Streaming Pipeline Start

Start step.

dataflow/Job Graph Is Constructed

Has common step to check if the job has an error in graph construction.

dataflow/Job Is Batch

Has step to check if the job is a batch job.

dataflow/Job Is Streaming

Has common step to check if the job is a streaming job.

dataflow/Job Log Errors

Has common step to check the job has fatal errors .

dataflow/Job Logs Visible

Has step to check if the project has logs exclusion filter for dataflow logs.

dataflow/Job State

Has common step to check job state is not failed.

dataflow/Slow Job Logs

Has common step to check the job has processing/throughput errors.

dataflow/Valid Sdk

Has common step to check if the job is running a valid SDK.