This is a dedicated watch page for a single video.
As part of your pipeline design, you're tasked with handling application events by publishing them to a Pub/Sub topic. While maintaining message order isn't critical, you do need to aggregate events across disjoint hourly intervals before loading them into BigQuery for analysis. Which technology would best suit processing and loading this data into BigQuery while ensuring scalability for large event volumes?