Introducing Apache Spark for AI Development


Overview/Description
Expected Duration
Lesson Objectives
Course Number
Expertise Level



Overview/Description

Apache Spark provides a robust framework for implementing machine learning and deep learning. It takes advantage of resilient distributed databases to provide a fault-tolerant platform well-suited to developing big data applications. Because many large companies are actively using this framework, AI developers should be familiar with the basics of implementing AI with Apache Spark and Spark ML.

In this course, you'll explore the concept of distributed computing. You'll identify the benefits of using Spark for AI Development, examining the advantages and disadvantages of using Spark over other big data AI platforms.

Next, you'll describe how to implement machine learning, deep learning, natural language processing, and computer vision using Spark. Finally, you'll use Spark ML to create a movie recommendation system commonly used by Netflix and YouTube.



Expected Duration (hours)
0.6

Lesson Objectives

Introducing Apache Spark for AI Development

  • discover the key concepts covered in this course
  • describe the Spark framework and name the main features it comprises
  • define distributed computing and specify the advantages of using it in AI development
  • compare disk and memory-based systems and contrast their core advantages and disadvantages
  • identify the key benefits of using Spark for AI Development
  • recognize the Spark components ecosystem and the benefits of using specific components in AI Development
  • compare Spark with other big data platforms and identify the primary advantages and disadvantages of using Spark
  • outline the process of creating machine learning models using Spark
  • describe the process of building deep learning models using Spark
  • outline the process of creating natural language processing pipelines using Spark
  • describe the process of creating computer vision pipelines using Spark
  • find key documents and resources for in-depth information about the Spark framework
  • install Spark on a Windows or Mac OS
  • create a movie recommendation system using the Spark ML framework
  • summarize the key concepts covered in this course
  • Course Number:
    it_aisprkdj_01_enus

    Expertise Level
    Intermediate