Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Supporting MultiModal Models: an example with LLaVA Notebook #286

Merged
merged 18 commits into from
Oct 24, 2023
Merged

Supporting MultiModal Models: an example with LLaVA Notebook #286

Changes from 14 commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
6b767e5
LMM notebook
BeibinLi Oct 13, 2023
b49e4e8
Use "register_reply" instead.
BeibinLi Oct 14, 2023
064c0e2
Loop check LLaVA non-empty response
BeibinLi Oct 14, 2023
4b0bbe7
Run notebook
BeibinLi Oct 14, 2023
a9b2060
Make the llava_call function more flexible
BeibinLi Oct 16, 2023
fb3970c
Include API for LLaVA from Replicate
BeibinLi Oct 17, 2023
638d328
LLaVA data format update x2
BeibinLi Oct 18, 2023
669212e
Coding example added
BeibinLi Oct 18, 2023
709875c
Rename "ImageAgent" -> "LLaVAAgent"
BeibinLi Oct 18, 2023
9eb0a71
Docstring and comments updates
BeibinLi Oct 18, 2023
8635848
Debug notebook: Remote LLaVA tested
BeibinLi Oct 19, 2023
16fa921
Merge branch 'main' into llava
BeibinLi Oct 19, 2023
d86dbf2
Example 1: remove system message
BeibinLi Oct 19, 2023
acf294b
Merge branch 'llava' of https://github.com/microsoft/autogen into llava
BeibinLi Oct 19, 2023
9dba9bc
MultimodalConversableAgent added
BeibinLi Oct 20, 2023
32d9da4
Add gpt4v_formatter
BeibinLi Oct 20, 2023
8e51b74
LLaVA: update example 1
BeibinLi Oct 23, 2023
773f590
LLaVA: Add link to "Table of Content"
BeibinLi Oct 23, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading