Skip to content

1cedsoda/ranch

Repository files navigation

ranch

ChatGPT-Style UI for Alpaca

Tech Stack

Frontend

  • SPA with Next.js
  • State Management with Redux Toolkit
  • Styling with SASS
  • Written in TypeScript

API

  • gRPC API Paradigma
  • (De)Serialization with Protocol Buffers
  • Client with grpc-web
  • Server with grpc-js
  • gRPC web proxy with Envoy

Backend

  • Written in TypeScript
  • Running on Node.js
  • Interfacing database with Mongoose
  • Database is MongoDB

Deployment

  • Containerized with Docker
  • Orchestration with Docker Compose

Setup

Install Protobuf Conpiler protoc

Installation Guide

Download Alpaca Model Weights

  1. Download the model file ggml-alpaca-7b-q4.bin
  2. Place it into ranch-deployment/.volumes/alpaca.cpp/ggml-alpaca-7b-q4.bin

Ports

Service Port
ranch-frontend 8080
Envoy Proxy for gRPC Web 8081
ranch-backend 8082
MongoDB 8083
MongoDB Express 8084