This is a dedicated watch page for a single video.
A data engineer aims to completely remove a Spark SQL table named my_table, including all associated metadata and data files. They execute the following command: DROP TABLE IF EXISTS my_table; After this operation, my_table is not listed in the output of SHOW TABLES, and they verify that the data files have also been deleted. What is the reason both the table's metadata and data files were successfully deleted?