resdevd / docker-compose-airflow

Quick Docker Compose deployment for Apache Airflow version 2.x. Ideal for local development

docker-compose-airflow

Note: Updated to Airflow version 2.2.0

Docker Compose Apache Airflow (Official Docker Images) with CeleryExecutor, InitDB and InitUser

Ideal for local development or small scale personal deployments.

Features

• Add any linux packages and/or python libraries to the image.
• Easy deployment in minutes.

How to deploy:

Prerequisite: Docker and docker-compose to be installed.

Step 1: Clone this Repo and open terminal.

Step 2: Go through .env file, init_airflow_setup.sh, docker-compose.yml file to change settings according to your preference. Or you can just keep them as it is for local development.

Step 3: Run docker-compose up -d

Step 4: Run sh init_airflow_setup.sh (Run this only for initial deployment)

Step 5: Go to http://localhost:8080 and login with user: airflow_test_user and password: airflow_test_password as specified in init_airflow_setup.sh script

Step 6: Run few dags and monitor Celery workers at http://localhost:5555

docker-compose-airflow's Issues

Thank you!

Thank you!