加载中...

Airflow: Sensors

Course 10 of 12 in Airflow 101 (Airflow 2)

Learn how to use Airflow sensors to wait for events before triggering tasks.

rate limit

Code not recognized.

Overview

Welcome! We're so glad you're here 😍

Sensors help to wait for an event to happen before getting executed.

With Sensors, you can take your data pipelines to the next level and cover a variety of new use cases.

🎯Objectives

At the end of this course, you'll be able to:

  • Define a Sensor
  • Identify use cases where to use a Sensor
  • Implement a Sensor to check if an API is available
  • Use the task sensor decorator

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers
  • Data Scientists

Set aside 10 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 15 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Sensors? 0 hr 1 min
  • What's a Sensor? 0 hr 1 min
  • The basics
  • Waiting for files in a S3 bucket 0 hr 5 min
  • Running the Sensor 0 hr 2 min
  • Practice: Better utilize Sensors 0 hr 3 min
  • Advanced
  • Implement any logic in your Sensors 0 hr 3 min
  • Best practices with Sensors 0 hr 1 min
  • Finishing up...
  • Quiz!
  • Wrap up 0 hr 1 min
  • How was it?

Overview

Welcome! We're so glad you're here 😍

Sensors help to wait for an event to happen before getting executed.

With Sensors, you can take your data pipelines to the next level and cover a variety of new use cases.

🎯Objectives

At the end of this course, you'll be able to:

  • Define a Sensor
  • Identify use cases where to use a Sensor
  • Implement a Sensor to check if an API is available
  • Use the task sensor decorator

👥 Audience

Who should take this course:

  • Data Engineers
  • Data Analysts
  • Software Engineers
  • Data Scientists

Set aside 10 minutes to complete the course.

💻 Setup Requirements

You need to have the following:

Curriculum0 hr 15 min

  • Introduction
  • Welcome! 0 hr 1 min
  • Why Sensors? 0 hr 1 min
  • What's a Sensor? 0 hr 1 min
  • The basics
  • Waiting for files in a S3 bucket 0 hr 5 min
  • Running the Sensor 0 hr 2 min
  • Practice: Better utilize Sensors 0 hr 3 min
  • Advanced
  • Implement any logic in your Sensors 0 hr 3 min
  • Best practices with Sensors 0 hr 1 min
  • Finishing up...
  • Quiz!
  • Wrap up 0 hr 1 min
  • How was it?