A data engineer is building a data pipeline that includes transforming large datasets stored in Amazon S3 using AWS Glue. The engineer wants to automate the deployment of this pipeline, including the S3 bucket, Glue jobs, and triggers that start the job when new data arrives. How can the engineer accomplish this using AWS best practices?