AWS Exams GCP Exams Azure Exams GitHub Exams Jira Exams ISC2 Exams

Video: An upstream system sends more than 1000 databricks video

Question 1
« Back   Next databricks data-engineer-professional Question »

Full Certification Question

An upstream system sends more than 1000 files every hour with each file containing 5000-30000 records. The size of each file ranges from 580MB to 1.22 GB. The stream of data is ingested using a medallion architecture. The data engineer needs to limit the amount of data processed in each micro-batch. Which of the following options is valid for limiting the input rate while reading the stream of data?