Create Spark Streaming Applications


Overview/Description
Target Audience
Prerequisites
Expected Duration
Lesson Objectives
Course Number
Expertise Level


Overview/Description
In this course you will learn how to create Spark streaming applications. It is one in a series of courses that prepares learners for exam 70-775: Perform Data Engineering on Microsoft Azure HDInsight.

Target Audience
IT professionals who implement and work with big data analytics and engineering workflows and use open-source technologies; IT professionals preparing for Microsoft exam 70-775

Prerequisites
None

Expected Duration (hours)
1.3

Lesson Objectives

Create Spark Streaming Applications

  • start the course
  • describe Dstream
  • describe Resilient Distributed Datasets (RDDs)
  • identify how to start and stop Spark streaming applications
  • describe DStream Transformations
  • identify long-term data stores in HBase and SQL
  • stream data from Apache Kafka
  • stream data from Event Hub
  • describe Spark streaming in a PowerBI dashboard
  • use Spark DataFrames and Dataset APIs to stream
  • create window operations on Event Time
  • describe Stateful and Stateless operations
  • describe window functions in Spark SQL
  • identify the Spark structured streaming storage options
  • stream data from Apache Kafka using Spark structured streaming
  • stream data from Event Hub using Spark structured streaming
  • describe Spark structured streaming in a PowerBI real-time dashboard
  • stream Spark applications

    • Course Number:
    df_mahd_a09_it_enus

    Expertise Level
    Intermediate