- Simplified Ray bootstrap, previously this was tied to FastAPI life cycle, and the only reason FASTAPI was introduced as a dependency
- Removed domain specific data model fields and revert Ray Worker to more generic form
- Removed Python dependencies no longer needed
- replace Clickhouse with Postgres as permanent storage to track File processing status
- Wired up Alembic to support Postgres migration supported
- make repo publishable as a python package to ease integration
- name spaced ENV variables to be bound as configs
- additional Make targets to support development, schema migration.. etc
- Update to Pydantic 2
- No longer needing Mime Type based matching and reverting to initial Ray Worker Implementation
- Mime Type based routing should be moved to worker_run_method as configured in config