Scenario: You have three data processing jobs: one gcp video
data-engineer-pro video for scenario: You have three data processing jobs: one that executes a Cloud Dataflow pipeline to process data from Cloud Storage and
Question 1
Be Honest
Answer
Full Certification Question
Scenario: You have three data processing jobs: one that executes a Cloud Dataflow pipeline to process data from Cloud Storage and write results to BigQuery, another that ingests data from on-premises servers to Cloud Storage, and a third that uploads data from third-party providers to Cloud Storage. You need to schedule and monitor these workflows and have the ability to execute them manually when needed. Question: How should you schedule and monitor the execution of these three workflows, and manually trigger them when required?