GitHub topics: visual-language-models
THUDM/CogVLM
a state-of-the-art-level open visual language model | 多模态预训练模型
Language: Python - Size: 25.8 MB - Last synced at: about 5 hours ago - Pushed at: 12 months ago - Stars: 6,541 - Forks: 429
jaisidhsingh/CoN-CLIP
Implementation of the "Learn No to Say Yes Better" paper.
Language: Python - Size: 4.36 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 31 - Forks: 2
ArthurBabkin/Parimate
A Telegram bot for validating audio and video content using CV models, SR models, and VLMs, with deepfake detection leveraging metadata analysis.
Language: Python - Size: 115 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 6 - Forks: 1
rng190001/CS6375-ResearchProject
Visual Language Model focusing on testing different parsing techniques from generated responses
Language: Jupyter Notebook - Size: 880 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1 - Forks: 0
kesimeg/awesome-turkish-language-models
A curated list of Turkish AI models, datasets, papers
Size: 4.88 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 27 - Forks: 0
camel-ai/crab
🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
Language: Python - Size: 7.89 MB - Last synced at: 4 days ago - Pushed at: 9 days ago - Stars: 338 - Forks: 49
rs-anderson/explicit-alignment-for-vqa-tasks
Explicit alignment for few-shot Visual Question Answering.
Language: Python - Size: 20 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 0 - Forks: 0
csebuetnlp/IllusionVQA
This repository contains the data and code of the paper titled "IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Models"
Language: Jupyter Notebook - Size: 87.7 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 13 - Forks: 2
DavidLMS/DescribePDF
A tool to convert PDF files to detailed Markdown descriptions using VLMs
Language: Python - Size: 1.2 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0
tianyu-z/VCR
Official Repo for the paper: VCR: Visual Caption Restoration. Check arxiv.org/pdf/2406.06462 for details.
Language: Python - Size: 6.58 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 31 - Forks: 2
BioMedIA-MBZUAI/FetalCLIP
Official repository of FetalCLIP: A Visual-Language Foundation Model for Fetal Ultrasound Image Analysis
Language: Python - Size: 12.6 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 13 - Forks: 0
sduzpf/UAP_VLP
Universal Adversarial Perturbations for Vision-Language Pre-trained Models
Language: Python - Size: 14.8 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 13 - Forks: 0
GraphPKU/CoI
Chain of Images for Intuitively Reasoning
Language: Python - Size: 5.17 MB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 1
AikyamLab/hallucinogen
A benchmark for evaluating hallucinations in large visual language models
Language: Python - Size: 1.32 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 6 - Forks: 0
bilel-bj/ROSGPT_Vision
Commanding robots using only Language Models' prompts
Language: Python - Size: 21.4 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 98 - Forks: 13
declare-lab/Sealing
[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"
Language: Python - Size: 8.92 MB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 11 - Forks: 3
ARResearch-1/DiverseAR-Dataset
Advancing the Understanding and Evaluation of AR-Generated Scenes: When Vision-Language Models Shine and Stumble
Size: 4.59 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
HemantM29/Multimodal-Document-Analysis-and-Query-Retrieval
This project performs multimodal document analysis and query retrieval by downloading PDFs, converting pages to images, indexing them for semantic search, and analyzing retrieved images using visual-language models like Qwen2VL and Blip2.
Language: Jupyter Notebook - Size: 1.9 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
hk-zh/language-conditioned-robot-manipulation-models
https://arxiv.org/abs/2312.10807
Size: 1.28 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 51 - Forks: 1
AlignGPT-VL/AlignGPT
Official repo for "AlignGPT: Multi-modal Large Language Models with Adaptive Alignment Capability"
Language: Python - Size: 1.97 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 28 - Forks: 3
xinyanghuang7/Basic-Visual-Language-Model
Build a simple basic multimodal large model from scratch. 从零搭建一个简单的基础多模态大模型🤖
Language: Python - Size: 34.7 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 0
CristianoPatricio/concept-based-interpretability-VLM
Code for the paper "Towards Concept-based Interpretability of Skin Lesion Diagnosis using Vision-Language Models", ISBI 2024 (Oral).
Language: Jupyter Notebook - Size: 21.2 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 0
Sid2697/HOI-Ref
Code implementation for paper titled "HOI-Ref: Hand-Object Interaction Referral in Egocentric Vision"
Language: Python - Size: 6.73 MB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 2
amathislab/wildclip
Scene and animal attribute retrieval from camera trap data with domain-adapted vision-language models
Language: Python - Size: 5.27 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 12 - Forks: 0
laclouis5/uform-coreml-converters
CLI for converting UForm models to CoreML.
Language: Python - Size: 121 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
