u/marclambertiin r/dataengineering • Recommends
Airflow 3.0 is OUT! Here is everything you need to know 🥳🥳
Enjoy ❤️
0:00 / 0:00
#apacheairflow#airflow3#dagorchestration
What's new in Apache Airflow 3?
Data with Marc
41K subscribers • 4 videos on Hallway
- Recommended by 1 person: 1 in engineering communities.
- Presented by Marc Lamberti
- May be out of date. The tools, versions or practices it shows have likely moved on.
Intermediate. Assumes working knowledge.
22K views1 year ago1 recommendation
Databases and dataTools and practiceData engineering and warehousesDeveloper productivity
Marc Lamberti explores the new features in Apache Airflow 3.0, including the rebuilt user interface, DAG versioning, and event-driven scheduling.
What's new in Apache Airflow 3? This is it! Airflow 3.0 is finally out! In this video, you will discover: ✅ The new architecture with the API server ✅ The new user interface, powered by React and FastAPI ✅ DAG versioning ✅ Event-driven scheduled data pipelines ✅ The new Asset syntax for writing DAGs ✅ The new backfilling mechanism and SO much more! 🏆 BECOME A PRO: udemy.com/course/the-ultimate-hands-on-course-to-master-apac… 👍 Smash the like button to become an Airflow Super Hero! ❤️ Subscribe to my channel to become a master of Airflow 📖 Chapters - Airflow 3.0 Has Arrived! 🚀 - The Completely Rebuilt Modern UI - The New Home: Powerful Monitoring at a Glance - The New DAGs View: Better Manage your DAGs and Tasks - Overview of a DAG With Direct Access to Failed Tasks - The New Task Tab: Easier Log Analysis & Troubleshooting - Graph View: Visualize Your Workflow Dependencies - Trigger your DAGs With Advanced Options - Updates on the Pools View with Task Status Tracking - Minor Updates on the UI - New API Endpoints - Visualize the Documentation of your DAGs - Assets: The Next Step for your DAGs - Implement your First Assets - Finally! Some Clarity on the Task Context - Visualizing and Managing Assets With the Asset View - Producing Multiple Assets at Once - Backfill Made Easy: UI & API Support! - Fetch DAGs from Various Sources with DAG Bundles Effortlessly - DAG Versioning, Never Lose Track Again - Event-Driven Scheduling: Real-time Pipeline Triggers - New Scheduling Behavior: No More Waiting! - New Architecture: Better Security & Scalability - Run Task Anywhere With The EdgeExecutor - Multiple Schedule Support For Your DAGs - Closing Thoughts & Community Thanks Thank you again for the amazing comitters and anybody who made that possible ❤️Why it's here
1 person recommends thisWhat people say. Shared to announce and summarize the major changes and new features introduced in the Apache Airflow 3.0 release.