awesome-ml-dev-tools

Collection of resources and tools for ML engineering or research development

LLMs

• OpenAI GPT-3 API
  • Quickstart with Python example app
• OpenAI GPT-2 open-source
  • HuggingFace API
  • Official Python API
  • Simplified Python API
  • Dataset
• Cohere AI

Q&A over documents

• Unstructured - Python library for preprocessing of PDFs, images, HTML, Word documents etc.
• GPT Index for constructing index
• ColBertV2 for searching index

Embedding Databases

• Pinecone
• Weaviate
• pgvector

LLMs using external APIs

• LangChain
• Dust.tt

Prompt-engineering

• Microsoft LMOps
• Humanloop
• Everyprompt

Deploying ML-powered apps

• Streamlit
• Gradio

MLOps

• Chip Huyenn's MLOps discord
• MLFlow
• Kubeflow
• Metaflow
• TFServing

ML Frameworks

• PyTorch
• Jax
• TensorFlow

Example applications

• Pinecone OP Stack
• LangChain README
  • Q&A over Notion database
  • Chat-LangChain
  • GPT + WolframAlpha
• OpenAI Cookbook