Delta lake is an open-source project that enables building a Lakehouse architecture on top of existing storage systems such as S3, ADLS, GCS, and HDFS.

• Create Virtual Environment

  python -m venv venv

• Load Virtual Environment

  source venv/bin/activate

• Install Dependencies

  brew install openjdk@11
  pip install -r requirements.txt

• Execute Main Job

  python main.py