OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Aircraft design optimization made fast through modern automatic differentiation. Composable analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.

A family of lightweight multimodal models.

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

A reading list for large models safety, security, and privacy.

GeoChat, the first grounded Large Vision Language Model for Remote Sensing [CVPR 2024]

Custom ComfyUI nodes for Vision Language Models, Large Language Models, Image to Music, Text to Music, Consistent and Random Creative Prompt Generation

ScreenAgent: A Computer Control Agent Driven by Visual Language Large Model

Ptera Software is a fast, easy-to-use, and open-source software package for analyzing flapping-wing flight.

A curated list of awesome papers on Embodied AI and related research/industry-driven resources.

[NeurIPS 2023 Oral] Quilt-1M: One Million Image-Text Pairs for Histopathology.

Matlab implementation to simulate the non-linear dynamics of a fixed-wing unmanned areal glider. Includes tools to calculate aerodynamic coefficients using a vortex lattice method implementation, and to extract longitudinal and lateral linear systems around the trimmed gliding state.

Famous Vision Language Models and Their Architectures

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.

Official code for Paper "Mantis: Multi-Image Instruction Tuning"

Jailbreaking Large Vision-language Models via Typographic Visual Prompts

This repo is a live list of papers on game playing and large multimodality model - "A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges".

M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts. Furthermore, M3DBench provides a new benchmark to assess large models across 3D vision-centric tasks.

A toolbox meant for aircraft design analyses.