dataflow/ERR/2023_011
Dataflow job using streaming insert did not fail due to mismatched column type.
Product: Dataflow
Rule class: ERR - Something that is very likely to be wrong
Description
The Dataflow job writing to bigquery using streaming inserts can fail due to mismatched column type.
Remediation
As the error indicate, the BigQuery streaming insert request has wrong rows. BigQuery error messages
Review the mismatched columns to fix the pipeline code to put column values correctly. Mismatched column name can be found from the error message in the logs for the dataflow job. For eg - Cannot convert value to integer (bad value):str_for_int_column