data-engineer-pro video for how can you automate the execution of a complex, multi-step data pipeline on Google Cloud, incorporating Dataproc and Dataflow jobs
How can you automate the execution of a complex, multi-step data pipeline on Google Cloud, incorporating Dataproc and Dataflow jobs with interdependencies, ensuring managed services are leveraged where feasible, and scheduling daily execution? Which tool aligns best with these requirements?