Skip to content

InferDoctor v0.2.0 - Local AI Stack Health Check

Choose a tag to compare

View all tags
@anguoyang anguoyang released this 18 Jun 02:36
v0.2.0
c38ff52

InferDoctor v0.2.0 turns the project into a practical, screenshot-friendly local AI stack doctor.

Local AI is powerful, but debugging it is painful. InferDoctor helps developers find out why Ollama, vLLM, SGLang, Xinference, Dify, CUDA, NVIDIA, OpenAI-compatible endpoints, or local AI services are not working.

Highlights

  • One-command local AI stack health dashboard
  • Overall health score
  • Top Fixes
  • OpenAI-compatible endpoint diagnostics
  • SGLang checker
  • vLLM, Xinference, Ollama, Dify, CUDA, and NVIDIA checks
  • inferdoctor explain
  • inferdoctor capacity
  • Scenario readiness diagnostics
  • Safe diagnostic profile export
  • llama.cpp, LM Studio, Open WebUI, and Docker checkers
  • Japanese quickstart documentation
  • Screenshot-friendly demo outputs
  • PyPI packaging preparation

Install

pip install inferdoctor

Quick Start

inferdoctor

Why InferDoctor?

Model recommendation tools help you choose a model.

InferDoctor helps you understand why your local AI stack is broken.

InferDoctor is lightweight and read-only by default.

It does not download models.
It does not run models.
It does not install AI runtimes.
It does not modify system settings.

What's next?

The dev branch is already moving toward v0.3.0 with local AI setup assistance, template generation, guided init, recommendations, and model fit estimation.

Assets 2
Loading