Getting Started with Hive: Optimizing Query Executions


Overview/Description
Expected Duration
Lesson Objectives
Course Number
Expertise Level



Overview/Description

In this 7-video Skillsoft Aspire course, learners can explore optimizations allowing Apache Hive to handle parallel processing of data, while users can still contribute to improving query performance. For this course, learners should have previous experience with Hive and familiarity with querying big data for analysis purposes. The course focuses only on concepts; no queries are run. Learners begin to understand how to optimize query executions in Hive, beginning with exploring different options available in Hive to query data in an optimal manner. Discuss how to split data into smaller chunks, specifically, partitioning and bucketing, so that queries need not scan full data sets each time. Hive truly democratizes access to data stored in a Hadoop cluster, eliminating the need to know MapReduce to process cluster data, and makes data accessible using the Hive query language. All files in Hadoop are exposed in the form of tables. Watch demonstrations of structuring queries to reduce numbers of map reduce operations generated by Hive, and speeding up query executions.  Other concepts covered include partitioning, bucketing, and joins.



Expected Duration (hours)
0.7

Lesson Objectives

Getting Started with Hive: Optimizing Query Executions

  • Course Overview
  • recognize how Hive translates queries to Hadoop MapReduce operations
  • identify the different options available in Hive to optimize query execution
  • recall how partitioning of a dataset can help queries run efficiently and identify the types of partitioning available in Hive
  • specify how bucketing improves query performance and compare it with partitioning a dataset
  • identify how to join tables in Hive to ensure the best performance of your query
  • work with techniques to improve performance and work with partitioning, bucketing and structured queries
  • Course Number:
    it_dsgshvdj_04_enus

    Expertise Level
    Intermediate