AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Control Any Computer Using LLMs

[ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions

GPT-4V in Wonderland: LMMs as Smartphone Agents

Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Language instructions to mycobot using GPT-4V

Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2

🤖 GPT-4V Demos • Test the model's vision capabilities in your browser using Streamlit • Easy setup

This repository offers a Python framework for a retrieval-augmented generation (RAG) pipeline using text and images from MHTML documents, leveraging Azure AI and OpenAI services. It includes ingestion and enrichment flows, a RAG with Vision pipeline, and evaluation tools.

Chain of Images for Intuitively Reasoning

Analyze a Video and generate commentary about it with OpenAI's GPT-4V, Text-to-speech, LangChain, Streamlit, Replit, Twilio SendGrid, and OpenCV!

poc gpt-4 vision bot

Digital Artificial Intelligence Agent

Explore the rich flavors of Indian desserts with TunedLlavaDelights. Utilizing the in Llava fine-tuning, our project unveils detailed nutritional profiles, taste notes, and optimal consumption times for beloved sweets. Dive into a fusion of AI innovation and culinary tradition