You are testing a Dataflow pipeline at IngestIQ gcp video
data-engineer-pro video for you are testing a Dataflow pipeline at IngestIQ Corp. that processes and transforms text files . These files are gzip-compressed ,
Answer
Full Certification Question
You are testing a Dataflow pipeline at IngestIQ Corp. that processes and transforms text files . These files are gzip-compressed , and any errors encountered during processing are routed to a dead-letter queue . You’re also using SideInputs to perform a data join as part of the pipeline. However, you've observed that the pipeline is taking longer to complete than expected. What change should you make to help speed up the execution of your Dataflow job?