Skip to content
Hallway
0:00 / 0:00

#apacheairflow#docker#docker-compose

Run Airflow 2.0 via Docker | Minimal Setup | Apache airflow for beginners

MaxcoTec Learning

3.3K subscribers • 2 videos on Hallway

YouTube
  • Recommended by 1 person: 1 in engineering communities.
  • Linked in the descriptionmaxcotec/Apache-Airflow
  • May be out of date. The tools, versions or practices it shows have likely moved on.

Beginner. No background in the topic needed.

28K views5 years ago1 recommendation

Databases and dataCloud and DevOpsData engineering and warehousesDocker and containers

How to spin up Apache Airflow 2 locally using Docker and a minimal Sequential Executor configuration.

#apacheairflow #airflowforbeginners #airflowdocker #maxcoteclearning UPDATE 2025: Watch Airflow 3 tutorials here youtu.be/zKGvgR6rla0 Apache airflow for beginners In this video we will spin up airflow 2 on a local machine via docker. This minimal setup of airflow using Sequential Executor will help you get your hands dirty on by exploring airflow yourself. Read the article here maxcotec.com/2022/01/apache-airflow-2-docker-beginners-guide… Get the docker-compose file here; MySql: github.com/maxcotec/Apache-Airflow/tree/main/airflow-minimal… SQLite: github.com/maxcotec/Apache-Airflow/tree/main/airflow-minimal… MySQL with LocalExecutor: github.com/maxcotec/Apache-Airflow/tree/main/airflow-minimal… Timeline: intro docker setup docker-compose setup run airflow via docker-compose visit airflow web-server explore airflow web UI access airflow dag logs outro Watch next video here; Build your first DAG: youtu.be/28UI_Usxbqo Watch airflow sensors: youtu.be/ZqIJC4mvAdw 👍 If this video was helpful to you, please don't forget to thumbs-up, ⌨️ leave a comment and 🔗 share with your friends. ⭐ Support our work by hitting that subscribe button. 🔔 hit bell icon to stay alert on more upcoming interesting stuff.

Why it's here

1 person recommends this

What people say. Recommended as a quick guide to setting up a local Apache Airflow environment using Docker.

Moments people linked to

u/surf_ocean_beachin r/dataengineering • Recommends

…# https://preview.redd.it/dhy74eykhp091.png?width=1039&format=png&auto=webp&s=cbed0caf7e89198aa0d68a96a254fc846ba13212 # Data Dashboard https://preview.redd.it/896bizwnhp091.png?width=627&format=png&auto=webp&s=86cadc6e6ab8fa594e49e0a3fca56df2d9c72740 # Learning Resources Airflow Basics: \Airflow DAG: Coding your first DAG for Beginners\([video \Running Airflow 2.0 with Docker in 5 mins\([video S3 Basics: \Setting Up Airflow Tasks To Connect Postgres And S3\([video \How to Upload files to AWS S3 using Python and Boto3\([video \Download files from S3\(https://www.stackvidhya.com/download-files-from-s3-using-boto3/) Docker Basics: \[Docker Tutorial for Beginners…
178View on Reddit