This is the gradio used in demo of our Osprey, Pixel Understanding with Visual Instruction Tuning. It is an extension to official gradio-3.36.1, which supports drawing boxes on top of an image.
We install it on Ubuntu with:
curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.3/install.sh | bash
source ~/.bashrc # or ~/.zshrc based on which one you use
nvm install v18.16.0
curl -fsSL https://get.pnpm.io/install.sh | sh -
source ~/.bashrc # or ~/.zshrc based on which one you use
pnpm --version # check if success
git clone https://github.com/LiWentomng/gradio-osprey-demo.git
cd gradio-osprey-demo
bash scripts/build_frontend.sh
pip install -e .
The implementation is inspired by gradio-box and gradio-app/gradio#3220, with several modifications to gradio-3.36.1. Thanks for their open-source contributions!