Awesome Unified Multimodal Models
A curated list of foundation models for vision and language tasks
A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
Project Imaging-X: A Survey of 1000+ Open-Access Medical Imaging Datasets for Foundation Model Development
[CVPR 2026] Scaling Spatial Intelligence with Multimodal Foundation Models
Holistic Evaluation of Multimodal LLMs on Spatial Intelligence
A curated list of Awesome Personalized Large Multimodal Models resources
Video Search with CLIP
[CVPR2026] ConsistCompose: Unified Multimodal Layout Control for Image Composition
The official implementation of the paper "Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts" (ICLR 2026).
The official implementation of the paper "Rethinking Pruning for Vision-Language Models: Strategies for Effective Sparsity".
camroll • an AI assistant for your personal camera roll 🎞️ • Personal VQA
Implementation of the paper "Advancing Compositional Awareness in CLIP with Efficient Fine-Tuning", arXiv, 2025
Multimodal Bi-Transformers (MMBT) in Biomedical Text/Image Classification
RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery
Model Mondays is a weekly livestreamed series on Microsoft Reactor that helps you make informed model choice decisions with timely updates and model deep-dives. Watch live for the content. Join Discord for the discussions.
Chart VQA is an intelligent chart question-answering system designed to help users understand information presented in charts and graphs. The project combines computer vision, optical character recognition, and vision-language models to analyze an uploaded chart and answer questions about its content in Vietnamese or English.
Text-dominant reasoning failure in multimodal LLMs — JAAD
General-purpose vs. domain-specific models for diabetic retinopathy — Diagnostics 2026
Add a description, image, and links to the multimodal-models topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-models topic, visit your repo's landing page and select "manage topics."