This Repo was created for the Miuul Workshop Event

Architecture

Setup Airflow and PostgreSQL with Docker

Note: If Docker is not installed, please visit: docker.com

Start Docker services and open the terminal in the directory where the docker-compose file is located.

Then, run the following commands:

docker-compose up -d --build

docker-compose ps

Expected output:

Airflow UI

Go to Airflow UI

• Username: airflow
• Password: airflow

Connect to PostgreSQL Database

docker-compose up postgres

• username: airflow
• password: airflow
• host: localhost
• port: 5433
• database: postgres

url: 'postgresql+psycopg2://airflow:airflow@localhost:5433/postgres'

Data Source

• Uber Pickups in New York City
• https://www.kaggle.com/datasets/ravi72munde/uber-lyft-cab-prices