data-engineer-pro video for you’ve built an analytics environment on Google Cloud for the data science team at Quantix Labs to analyze data without affecting
You’ve built an analytics environment on Google Cloud for the data science team at Quantix Labs to analyze data without affecting the legacy on-premises Apache Hadoop system. The current dataset resides in HDFS and consists of Optimized Row Columnar (ORC) files with multiple Hive partitions. The data science team wants to explore the data in a way similar to how they previously used SQL queries on Hive. You need to select the most cost-effective solution for both storage and processing. What should you do?