GitHub / EvolvingLMMs-Lab 1 Repository
Feeling and building multimodal intelligence.
EvolvingLMMs-Lab/lmms-eval
One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Language: Python - Size: 8.29 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 3,042 - Forks: 368

EvolvingLMMs-Lab/multimodal-search-r1
MMSearch-R1 is an end-to-end RL framework that enables LMMs to perform on-demand, multi-turn search with real-world multimodal search tools.
Language: Python - Size: 1.81 MB - Last synced at: 1 day ago - Pushed at: 12 days ago - Stars: 303 - Forks: 17

EvolvingLMMs-Lab/RelateAnything
Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.
Language: Python - Size: 67.9 MB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 456 - Forks: 22

EvolvingLMMs-Lab/Otter
🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Language: Python - Size: 7.39 MB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 3,269 - Forks: 208

EvolvingLMMs-Lab/sae
A framework that allows you to apply Sparse AutoEncoder on any models
Language: Python - Size: 82 KB - Last synced at: 1 day ago - Pushed at: about 2 months ago - Stars: 37 - Forks: 1

EvolvingLMMs-Lab/multimodal-sae
[ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
Language: Python - Size: 9.69 MB - Last synced at: 1 day ago - Pushed at: about 2 months ago - Stars: 150 - Forks: 9

EvolvingLMMs-Lab/Aero-1
Language: Python - Size: 83 KB - Last synced at: 1 day ago - Pushed at: 4 months ago - Stars: 78 - Forks: 6

EvolvingLMMs-Lab/open-r1-multimodal
A fork to add multimodal model training to open-r1
Language: Python - Size: 902 KB - Last synced at: 6 days ago - Pushed at: 7 months ago - Stars: 1,379 - Forks: 68

EvolvingLMMs-Lab/LongVA
Long Context Transfer from Language to Vision
Language: Python - Size: 36.2 MB - Last synced at: 6 days ago - Pushed at: 6 months ago - Stars: 391 - Forks: 20

EvolvingLMMs-Lab/sglang Fork of sgl-project/sglang
SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.
Language: Python - Size: 28.2 MB - Last synced at: 1 day ago - Pushed at: 11 days ago - Stars: 3 - Forks: 1

EvolvingLMMs-Lab/EgoLife
[CVPR 2025] EgoLife: Towards Egocentric Life Assistant
Language: Python - Size: 35.7 MB - Last synced at: 7 days ago - Pushed at: 6 months ago - Stars: 322 - Forks: 18

EvolvingLMMs-Lab/VideoMMMU
Language: Python - Size: 15.6 MB - Last synced at: 6 days ago - Pushed at: 30 days ago - Stars: 53 - Forks: 2

EvolvingLMMs-Lab/DiffSynth-Studio Fork of modelscope/DiffSynth-Studio
Enjoy the magic of Diffusion models!
Language: Python - Size: 13.6 MB - Last synced at: 6 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

EvolvingLMMs-Lab/MGPO
High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning
Size: 41.4 MB - Last synced at: 1 day ago - Pushed at: about 2 months ago - Stars: 47 - Forks: 1

EvolvingLMMs-Lab/lean-runner
Deploying High-Performance Lean 4 Server in One Click
Language: Python - Size: 20.2 MB - Last synced at: 6 days ago - Pushed at: 23 days ago - Stars: 8 - Forks: 0

EvolvingLMMs-Lab/DeepseekLeanPlayground Fork of xinhjBrant/mathlib4
The math library of Lean 4
Size: 107 MB - Last synced at: 1 day ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

EvolvingLMMs-Lab/DeepEyes Fork of Visual-Agent/DeepEyes
Language: Python - Size: 18.1 MB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

EvolvingLMMs-Lab/agent-rl Fork of TIGER-AI-Lab/verl-tool
A fork version of verl to support multi-turn tool use and many more agentic tasks.
Size: 11.3 MB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

EvolvingLMMs-Lab/openevolve Fork of codelion/openevolve
Open-source implementation of AlphaEvolve
Language: Python - Size: 3.3 MB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

EvolvingLMMs-Lab/.github
Size: 8.57 MB - Last synced at: 1 day ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

EvolvingLMMs-Lab/demos
Language: Python - Size: 146 MB - Last synced at: 1 day ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0
