Scenario: You are implementing several batch jobs gcp video
data-engineer-pro video for scenario: You are implementing several batch jobs that need to be executed on a schedule. These jobs have multiple interdependent
Answer
Full Certification Question
Scenario: You are implementing several batch jobs that need to be executed on a schedule. These jobs have multiple interdependent steps that need to be run in a specific order. The jobs involve executing shell scripts, running Hadoop jobs, and running queries in BigQuery. The jobs are expected to run for many minutes up to several hours. If any step fails, it must be retried a fixed number of times. Question: Which service should you use to manage the execution of these jobs?