This is a dedicated watch page for a single video.
A data engineer tries to remove a Spark SQL table named my_table with the intention of erasing both the table's metadata and its data. They execute the command: DROP TABLE IF EXISTS my_table; After running this command, my_table no longer shows up in the list of tables, but the data files remain. What explains the persistence of the data files despite the deletion of the metadata?