A data engineering team has built a databricks video
data-analyst video for a data engineering team has built a Structured Streaming pipeline that processes data in micro-batches and updates gold-level tables
Answer
Full Certification Question
A data engineering team has built a Structured Streaming pipeline that processes data in micro-batches and updates gold-level tables every minute. A data analyst has created a dashboard based on this gold-level data. Stakeholders want the dashboard to reflect new data within one minute of it being available in the gold-level tables. Which caution should the data analyst raise before proceeding with this request?