Scenario: You are designing a data pipeline to share data between job generators and job runners. The solution must scale to handle increased usage and allow new applications to be added without impacting the performance of existing applications. Question: What should you implement to meet these requirements?