Skip to content

Latest commit

 

History

History
10 lines (9 loc) · 531 Bytes

README.md

File metadata and controls

10 lines (9 loc) · 531 Bytes

Airbyte - Dagster - Langchain demo

To run, you need python 3 and docker installed:

  • Start Airbyte locally
  • Set up connection
  • Install requirements via pip install -r requirements.txt
  • Run dagster dev -f ingest.py to start the ingest pipeline
  • Go to http://127.0.0.1:3000/asset-groups to see the Dagster UI and materialize all steps
  • Run EXPORT OPENAI_API_KEY={YOUR_API_KEY}; python query.py to start the QA interface
  • Ask questions: "How much is a Volkswagen?"