AWS Exams GCP Exams Azure Exams GitHub Exams Jira Exams ISC2 Exams

Video: At the end of the inventory process a file databricks video

Question 1
« Back   Next data-engineer-associate Certification Question »

Full Certification Question

At the end of the inventory process a file gets uploaded to the cloud object storage, you are asked to build a process to ingest data which of the following method can be used to ingest the data incrementally, the schema of the file is expected to change overtime ingestion process should be able to handle these changes automatically. Below is the auto loader command to load the data, fill in the blanks for successful execution of the below code. spark . readStream . format ( "cloudfiles" ) . option ( "cloudfiles.format" ,” csv ) . option ( "_______" , ‘ dbfs : /location/ checkpoint /’) . load ( data_source ) . writeStream . option ( "_______" ,’ dbfs : /location/ checkpoint /’) . option ( "mergeSchema" , "true" ) . table ( table_name ))