Faust: Stream Processing Using Models, Agents, & Channels


Overview/Description
Expected Duration
Lesson Objectives
Course Number
Expertise Level



Overview/Description
Stream processing in Faust uses native Python code, meaning you don't have to learn a new domain-specific language to perform data transformations. All you need to know is how existing concepts, such as models, work within a Faust context. Faust models allow you to specify fields and their data types and use this well-defined data structure to access streaming data. In this course, you'll learn how to represent the individual elements of a stream using Faust models. You'll work with agents, which are at the heart of every Faust stream processing application. You'll perform operations using agents and invoke agents synchronously and asynchronously from within your application. You'll then work with channels in Faust. At the end of this course, you'll have the confidence to use models, agents, and channels in the right way to build a successful application.

Expected Duration (hours)
1.5

Lesson Objectives

Faust: Stream Processing Using Models, Agents, & Channels

  • discover the key concepts covered in this course
  • use models to represent stream elements
  • create models with multiple fields and different data types
  • publish messages to a Kafka topic using the pykafka library
  • invoke the ask() method to await processing results from an agent
  • invoke the cast() method to await processing results from an agent
  • use multiple agents for chained processing of data
  • use multiple agents to process elements from different topics
  • use channels to send and receive messages
  • create streams manually using the .stream() method
  • define stream processors to transform stream elements
  • summarize the key concepts covered in this course
  • Course Number:
    it_pyspwfdj_02_enus

    Expertise Level
    Intermediate