This is a dedicated watch page for a single video.
A company intends to organize its Amazon S3 storage used for a data lake by implementing partitioning that has the S3 object keys in the format: s3://bucket/prefix/year=2023/month=01/day=01. A data engineer is tasked with ensuring that the AWS Glue Data Catalog remains updated in sync with any new partitions added to the S3 bucket. What solution would best meet these requirements while minimizing latency?