加载中...

Reset

Learn Apache Airflow

Free Airflow courses taught by the Astronomer experts behind the project. Grow your skills to create powerful, scalable and reliable data pipelines based on industry and data engineering best practices. From anywhere, at anytime.

Get Certified Explore All Modules →

Marc Lamberti

Marc Lamberti

Course Instructor

The first LAB is available! 🧪 Click here to run Airflow on Astro →

New to Airflow?

Airflow 101 Learning Path

This learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow.

New to Astro?

Astro Onboarding Learning Path

This learning path shows you how to run Airflow on Astronomer’s managed service. Deploy your first DAG in minutes.

[separator] Popular Airflow Modules

Introduction to GenAI with Apache Airflow®

Create a retrieval augmented generation (RAG) application with Airflow and run it locally.

Beginner Airflow GenAI

Airflow: Datasets

Learn how to take advantage datasets to create data-aware scheduled DAGs.

Beginner Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: The KubernetesPodOperator

Master the KubernetesPodOperator (KPO) to better manage resources and dependencies of DAG tasks.

Data Engineer Astro Runtime Advanced Kubernetes Airflow Module

[separator] Popular Astro Modules

Astro: Cloud IDE

Learn about the Cloud IDE which makes it simple for someone new to Airflow and Astronomer users to write a data pipeline.

Beginner 101 Astro Module

Astro: HTTP Provider

Interact with HTTP Resources by making Web Requests to an API.

Beginner Astro Providers Module

Astro: Deployments

Organize and configure your deployments to better run your workflows

Beginner 101 Astro Module

Astro Private Cloud: 101

Learn how to install, configure, and deploy Apache Airflow pipelines using Astro Private Cloud on your own infrastructure.

101 Astro Learning Path APC

Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Intermediate Module Airflow 3

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Airflow: Connections and Variables

Learn how to use Connections and Variables in Airflow.

Beginner 101 Airflow Module Airflow 3

Airflow 101 (Airflow 3)

The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow 3. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more!

Learning Path Airflow

Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Beginner 101 Astro Runtime Airflow Module

Learning Bytes: Universal Metrics Export

Learn how to use Universal Metrics Export to achieve centralized observability of your data ecosystem in real-time!

Astro Astro Runtime Learning Byte

[Airflow 2] Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

[Airflow 2] Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Certification Exam: Apache Airflow 3 Fundamentals

Demonstrate your mastery of fundamental Apache Airflow concepts to the world, highlighting your proficiency in designing, scheduling, and overseeing data pipelines.

Astro: User permissions

Define the right permissions to the right users in Astro

Beginner 101 Astro permissions Module

Astro: Environment Manager

Manage Connections and Variables efficiently at scale!

Beginner Astro Onboarding Lab

Astro: Monitoring and Alerting

Monitor your Deployments and Pipelines

Beginner Astro Onboarding

Airflow DAG Authoring (Airflow 3)

Prepare for the the DAG Authoring certification

Learning Path Airflow

Airflow: Branching

Choosing different paths in your workflows based on conditions

Beginner Intermediate Airflow Module Airflow 3

Airflow: TaskGroups

Learn to better organize your tasks in DAGs

Beginner Intermediate Module Airflow 3

Airflow: DAG Versioning and Bundles

Learn to version your DAGs for tracking changes and never get lost again!

Beginner Intermediate Advanced Airflow Airflow 3

Airflow: Templating

Learn how to pass dynamic data to tasks at runtime.

Beginner Data Engineer Astro Runtime Intermediate Templating Airflow Module

Astro: Focus on Deployments

Properly create and configure your Deployments

Beginner Astro Lab

Airflow: Dynamic DAGs

Learn how to avoid duplicating DAGs with Dynamic DAGs.

Data Engineer Astro Runtime Advanced Airflow Module

Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Beginner 101 Astro Runtime Airflow Module

Learn how to define how many tasks run in parallel for a set of tasks with Airflow pools.

Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: Branching

Learn how to branch in order to tell the DAGs to not to run all dependent tasks, but instead to pick and choose one or more paths to go down.

Beginner 101 Intermediate Airflow Module

Software: Metrics

What are the key metrics to know, what to do if something goes wrong, let's find out!

Astronomer Platform Beginner Astronomer Enterprise Admin Monitoring Software Module

Observability: Introduction

Discover why Observability is important for you

Beginner Astro Observability

Astro: Local Development Environment

Set up and run Airflow locally following best practices

Beginner Astro Onboarding Lab

Airflow: Deferrable Operators

Learn how to efficiently manage resources by using Deferrable Operators.

Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

Beginner 101 Airflow

Make reliable and resilient deployments with CI/CD

Beginner 101 Astro cicd Module

Speed up your DAG development with the Astro SDK

Astro Data Engineer Astro Runtime Intermediate Module

[Airflow 2] Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

Learning Bytes: GitHub Integration

Learn how to setup CI/CD on Astro with the GitHub Integration!

Astro Astro Runtime Learning Byte

Airflow: Local Development Environment

Set up a local development environment for Airflow!

Beginner Airflow

Introduction to Orchestration and Airflow

An overview of the world of data orchestration and Apache Airflow!

Beginner Airflow Module

Learning Bytes: Custom Deployment Roles

An overview of the custom deployment roles feature on Astro!

Astro Astro Runtime Learning Byte

Learning Bytes: Reporting

An overview of the reporting feature on Astro!

Astro Astro Runtime Learning Byte

Learning Bytes: Customer Managed Workload Identity

An overview of the Customer Managed Workload Identity feature on Astro!

Astro Runtime Learning Byte

Learning Bytes: Astro API

An overview of the Astro API!

Astro Astro Runtime Learning Byte

Learning Bytes: Deploy dbt projects on Astro

Learn how to use the Astro dbt deploys feature to seamlessly deploy and manage dbt code in Airflow projects.

Astro Astro Runtime Learning Byte

Learning Bytes: Terraform Provider

Learn how use the Astro Terraform Provider to simplify the management of Airflow infrastructure!

Astro Astro Runtime Learning Byte

Astro Onboarding

The Astro Onboarding learning path equips you with everything you need to run your first data pipelines on Astro. This includes the core concepts, local development environments, creating your first deployments, deploying DAGs, monitoring and more. All of that through interactive Labs!

Astro Learning Path

Observability: Data Products

Track your Data Assets with Data Products!

Beginner Astro Module Observability

Astro: Introduction

Why Astro? What is it? Let's find out!

Beginner Astro Module Onboarding

Astro: Running Airflow

Create your first deployment on Astro and run Airflow!

Beginner 101 Astro Module Lab

[Airflow 2] Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

[Airflow 2] Airflow: Connections 101

Learn how to interact with systems from data pipelines with connections.

Beginner Airflow Airflow 2

[Airflow 2] Airflow: UI

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Airflow 101 (Airflow 2)

The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow 2. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more!

Learning Path Airflow

Data Observability

Learn to understand, monitor, and manage the health and reliability of data across various systems and pipelines

Learning Path Observability

Observability: Data Quality

Reliable data for reliable decisions

Beginner Astro Intermediate Observability

Airflow: Assets

Learn how to take advantage assets to create asset-aware scheduled DAGs.

Beginner Intermediate Airflow Module Airflow 3

Certification Exam: DAG Authoring (Airflow 3)

Challenge your DAG authoring skills and show to the world your expertise in creating reliable data pipelines!

Observability: SLAs

Master the art of setting and monitoring Service Level Agreements that transform your data pipelines from unpredictable black boxes into reliable, business-critical systems your stakeholders can trust.

Beginner Astro Intermediate Module Observability

Astro: Local Development Environment

Set up your local development environment with the Astro CLI and speed up your DAGs development

Beginner 101 Astro Module

Software: User Permissions

Setting the proper permissions and roles for your users can be a pain. Let us help you make it more enjoyable and straightforward.

Beginner Astronomer Enterprise Admin Software Module

Software: Alerting

Be notified when something goes wrong and know what to do

Beginner Astronomer Enterprise Admin Software Module

Astro: Environment Variables

The fundamentals of how to apply Environment Variables in Astro

Beginner 101 Astro environment variables Module

Software: Workspaces

Learn how to better organize your Airflow deployments and Users with Workspaces.

Astronomer Platform Beginner Astronomer Enterprise Admin Workspace Software Module

Monitor your deployments and quickly spot failures

Beginner 101 Astro Module

Software: Deployment Resources

Don't get your tasks killed anymore. Learn how to define your resources according to your needs.

Astronomer Platform Beginner Astronomer Enterprise Admin resources Software Module

Astro: Deployment Analytics

Learn how to interpret powerful insights relating to your deployment

Beginner Monitoring 101 Astro analytics Module

Astro: Secrets Backend

The fundamentals of how to configure an external secrets backend in Astro

Beginner modules 101 Astro AWS secrets backend secrets Module

Airflow: Command Line Interface (CLI)

Learn how to use the Airflow CLI to perform a variety of operations.

Beginner Airflow Module

[Airflow 2] Airflow: Variables 101

Learn how to store data with variables and make DAGs more dynamic.

Beginner 101 Astro Runtime Airflow Module Airflow 2

Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

Beginner Data Engineer Astro Runtime Scheduling Airflow Module

Airflow: Taskflow API

Learn how to use the Taskflow API to create DAGs faster.

Data Engineer Astro Runtime Airflow Module

Airflow: Sensors

Learn how to use Airflow sensors to wait for events before triggering tasks.

Beginner 101 Airflow Module

Airflow Project: Dynamic Task Mapping with S3

Build a DAG that interacts with S3 buckets using Dynamic Task Mapping.

Beginner AWS Data Engineer Astro Runtime Projects Airflow Module

[Airflow 2] Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Beginner Airflow Module

Airflow: Dynamic Task Mapping

Learn to create tasks based on current data using Dynamic Task Mapping.

Astro Runtime Advanced Airflow Module

Airflow: The ExternalPythonOperator

Learn how to run python tasks in a safe virtual environment.

Beginner 101 Data Engineer Astro Runtime Airflow Module

Airflow: SubDAGs

Learn how to use SubDAGs to write cleaner and more efficient DAGs.

Beginner Data Engineer Astro Runtime Grouping Intermediate Airflow Module

[separator] Airflow Fundamentals

Test your skills and make sure you've mastered the Airflow fundamentals

[separator] Airflow DAG Authoring

Show your expertise to the world and level-up your data pipelines with DAG Authoring

Certification Exam: DAG Authoring (Airflow 2)

Challenge your DAG authoring skills and show to the world your expertise in creating amazing DAGs!

Prep Course: DAG Authoring (Airflow 2)

The course is an on-demand class which dives into topics covered on the Astronomer Certification: Apache Airflow DAG Authoring

preparation course certification

Certification Exam: Apache Airflow 2 Fundamentals

Demonstrate your mastery of fundamental Apache Airflow concepts to the world, highlighting your proficiency in designing, scheduling, and overseeing data pipelines.

Airflow: Trigger Rules

Learn how to effectively control the task execution flow using trigger rules.

Data Engineer Astro Runtime Intermediate Airflow Module

Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

Beginner 101 Airflow

Introduction to Orchestration and Airflow

An overview of the world of data orchestration and Apache Airflow!

Beginner Airflow Module

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Airflow: Sensors

Learn how to use Airflow sensors to wait for events before triggering tasks.

Beginner 101 Airflow Module

Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Intermediate Module Airflow 3

Airflow: Command Line Interface (CLI)

Learn how to use the Airflow CLI to perform a variety of operations.

Beginner Airflow Module

Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

Beginner Data Engineer Astro Runtime Scheduling Airflow Module

Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Beginner 101 Astro Runtime Airflow Module

Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Beginner 101 Astro Runtime Airflow Module

Airflow: Local Development Environment

Set up a local development environment for Airflow!

Beginner Airflow

Airflow: Connections and Variables

Learn how to use Connections and Variables in Airflow.

Beginner 101 Airflow Module Airflow 3

Astro: Monitoring and Alerting

Monitor your Deployments and Pipelines

Beginner Astro Onboarding

Astro: Focus on Deployments

Properly create and configure your Deployments

Beginner Astro Lab

Astro: Environment Manager

Manage Connections and Variables efficiently at scale!

Beginner Astro Onboarding Lab

Astro: Introduction

Why Astro? What is it? Let's find out!

Beginner Astro Module Onboarding

Astro: Running Airflow

Create your first deployment on Astro and run Airflow!

Beginner 101 Astro Module Lab

Astro: Local Development Environment

Set up and run Airflow locally following best practices

Beginner Astro Onboarding Lab

Observability: Introduction

Discover why Observability is important for you

Beginner Astro Observability

Observability: Data Quality

Reliable data for reliable decisions

Beginner Astro Intermediate Observability

Observability: Data Products

Track your Data Assets with Data Products!

Beginner Astro Module Observability

Observability: SLAs

Master the art of setting and monitoring Service Level Agreements that transform your data pipelines from unpredictable black boxes into reliable, business-critical systems your stakeholders can trust.

Beginner Astro Intermediate Module Observability

Airflow: Local Development Environment

Set up a local development environment for Airflow!

Beginner Airflow

[Airflow 2] Airflow: DAG Scheduling

Learn about how DAGs are scheduled.

[Airflow 2] Airflow: Connections 101

Learn how to interact with systems from data pipelines with connections.

Beginner Airflow Airflow 2

[Airflow 2] Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Introduction to Orchestration and Airflow

An overview of the world of data orchestration and Apache Airflow!

Beginner Airflow Module

[Airflow 2] Airflow: Variables 101

Learn how to store data with variables and make DAGs more dynamic.

Beginner 101 Astro Runtime Airflow Module Airflow 2

[Airflow 2] Airflow: Basics

Explore how Apache Airflow works under the hood and the basics of how a DAG is built!

[Airflow 2] Airflow: DAGs 101

Learn the basics of how to create a data pipeline in Airflow.

Airflow: Command Line Interface (CLI)

Learn how to use the Airflow CLI to perform a variety of operations.

Beginner Airflow Module

[Airflow 2] Airflow: UI

Learn how to efficiently monitor DAGs and Tasks in the Airflow UI.

Airflow: Sensors

Learn how to use Airflow sensors to wait for events before triggering tasks.

Beginner 101 Airflow Module

[Airflow 2] Airflow: Debug DAGs

Discover how to effectively debug DAGs.

Beginner Airflow Module

Airflow: Branching

Choosing different paths in your workflows based on conditions

Beginner Intermediate Airflow Module Airflow 3

Airflow: Dynamic DAGs

Learn how to avoid duplicating DAGs with Dynamic DAGs.

Data Engineer Astro Runtime Advanced Airflow Module

Airflow: Taskflow API

Learn how to use the Taskflow API to create DAGs faster.

Data Engineer Astro Runtime Airflow Module

Airflow: Templating

Learn how to pass dynamic data to tasks at runtime.

Beginner Data Engineer Astro Runtime Intermediate Templating Airflow Module

Airflow: Assets

Learn how to take advantage assets to create asset-aware scheduled DAGs.

Beginner Intermediate Airflow Module Airflow 3

Airflow: DAG Versioning and Bundles

Learn to version your DAGs for tracking changes and never get lost again!

Beginner Intermediate Advanced Airflow Airflow 3

Airflow: Dynamic Task Mapping

Learn to create tasks based on current data using Dynamic Task Mapping.

Astro Runtime Advanced Airflow Module

Airflow: XComs 101

Learn the basics of sharing data between tasks using XComs

Beginner 101 Astro Runtime Airflow Module

Airflow: TaskGroups

Learn to better organize your tasks in DAGs

Beginner Intermediate Module Airflow 3