Checkpoints [Would you like some water?]
Pre-release
Pre-release
A test checkpoint of SignLLaVA.
Installation into Demo
To install this checkpoint into a set-up demo backend, just go to the demo/backend folder and run:
rm -rf models/Sign_LLaVA
git clone git@github.com:JSALT2024/Sign_LLaVA.git models/Sign_LLaVA
(cd models/Sign_LLaVA && git reset --hard 19cd35769b898517e2eacbbebaa4791cb84e000d)
.venv/bin/python3 -m pip install --no-deps --editable ./models/Sign_LLaVA
rm -rf checkpoints/Sign_LLaVA
mkdir -p checkpoints/Sign_LLaVA
(cd checkpoints/Sign_LLaVA && wget "https://github.com/JSALT2024/Sign_LLaVA/releases/download/checkpoint/test_ckpt_July_26_2024_11am.zip")
(cd checkpoints/Sign_LLaVA && unzip test_ckpt_July_26_2024_11am.zip)
mv checkpoints/Sign_LLaVA/test_ckpt_July_26_2024_11am/* checkpoints/Sign_LLaVA/Then run the model test:
.venv/bin/python3 -m app.debug.test_sign_llavaAnd the test should end with:
...
The LLM says: 'Would you like some water?'
The result form the LLM seems ok.