DATAFLOW

Cloud Dataflow

dataflow/ERR/2023_001

Dataflow service account has dataflow.serviceAgent role

dataflow/ERR/2023_002

Dataflow job does not fail during execution due to IP space exhaustion

dataflow/ERR/2023_003

Dataflow job does not fail during execution due to incorrect specification of subnet

dataflow/ERR/2023_004

Dataflow job does not fail during execution due to violating an organization policy constraint in project

dataflow/ERR/2023_005

Dataflow job does not fail during execution due to credential or permission issue

dataflow/ERR/2023_006

Dataflow job failure when the subnetwork does not have Private Google Access enabled

dataflow/ERR/2023_007

Streaming Dataflow job gets stuck when firewall rules are not configured

dataflow/ERR/2023_008

Dataflow worker service account has roles/dataflow.worker role

dataflow/ERR/2023_009

Splunk HEC endpoint uses a valid public SSL certificate, or a correct root-CA certificate is provided.

dataflow/ERR/2023_010

Dataflow job using streaming insert did not fail due to missing required field.

dataflow/ERR/2023_011

Dataflow job using streaming insert did not fail due to mismatched column type.

dataflow/ERR/2023_012

Dataflow job writing to spanner did not fail due to OOM.

dataflow/ERR/2023_013

Dataflow job reading from spanner did not fail due to deadline exceeded error.

dataflow/ERR/2024_001

Dataflow job is not facing GCE resource constraints.

dataflow/ERR/2024_002

Dataflow job is not returning KeyCommitTooLargeException errors.

dataflow/ERR/2024_003

Streaming Dataflow jobs are not using WRITE_TRUNCATE when working with unbounded PCollections.

dataflow/ERR/2024_004

The Dataflow job has the necessary GCS permissions for the temporary bucket.

dataflow/ERR/2024_005

Dataflow and its controller service account have the necessary permissions to interact with Pub/Sub topics.

dataflow/WARN/2023_001

Dataflow job does not have a hot key

dataflow/WARN/2023_002

Dataflow worker logs are Throttled

dataflow/WARN/2023_003

Dataflow job doen’t stuck at draining state for more than 3 hours

dataflow/WARN/2023_005

Dataflow job is using supported Apache Beam SDK version

dataflow/WARN/2023_006

A Dataflow job doesn’t stuck in the cancelling state

dataflow/WARN/2024_001

Dataflow job is not returning Operation ongoing or Processing Stuck logs.

dataflow/WARN/2024_002

Dataflow job using Streaming Appliance is not getting stuck due to Commit failed: computation doesn’t have the state family.