GitHub topics: multi-modal-fusion
FIVEYOUNGWOO/IEEE-802.11n-CSI-Camera-Synchronization-Toolkit
IEEE 802.11n CSI and camera synchronization toolkit.
Language: C - Size: 229 MB - Last synced at: 5 days ago - Pushed at: 4 months ago - Stars: 12 - Forks: 4

SMARTlab-Purdue/Husformer
This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.
Language: Python - Size: 2.94 MB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 91 - Forks: 26

zjukg/KG-MM-Survey
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
Size: 82.3 MB - Last synced at: 9 days ago - Pushed at: 4 months ago - Stars: 401 - Forks: 19

kyegomez/MoE-Mamba
Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta
Language: Python - Size: 2.17 MB - Last synced at: 1 day ago - Pushed at: 14 days ago - Stars: 102 - Forks: 5

zjukg/MoMoK
[Paper][ICLR 2025] Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learning
Language: Python - Size: 6.99 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 24 - Forks: 2

zjukg/MyGO
[Paper][AAAI 2025] (MyGO)Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representation
Language: Python - Size: 90.8 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 242 - Forks: 4

Event-AHU/VTF_PAR
[CVPR-2023 Workshop@NFVLR] Official PyTorch implementation of Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition
Language: Python - Size: 2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 23 - Forks: 2

kyegomez/MegaVIT
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
Language: Python - Size: 211 KB - Last synced at: 1 day ago - Pushed at: 16 days ago - Stars: 28 - Forks: 1

kyegomez/the-compiler
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
Language: Python - Size: 10.4 MB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 145 - Forks: 17

zylbuaa/TFormer
The official implementation of "TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis"
Language: Python - Size: 521 KB - Last synced at: 16 days ago - Pushed at: about 1 year ago - Stars: 14 - Forks: 2

BubbleWang-wly/EIEA
Explicit-Implicit Entity Alignment Method in Multi-modal Knowledge Graphs
Language: Python - Size: 755 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

SeyedMuhammadHosseinMousavi/Multi-Modal-Fusion
Early Fusion, Late Fusion, and Hybrid Fusion
Language: Python - Size: 3.5 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 1

SeyedMuhammadHosseinMousavi/Comprehensive-Machine-Learning-Techniques-Metrics-Classifiers-and-Evaluation
Comprehensive Machine Learning Techniques: Metrics, Classifiers, and Evaluation
Language: Python - Size: 14.8 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

zjukg/NATIVE
[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild
Language: Python - Size: 10.2 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 18 - Forks: 1

Cimy-wang/AM3Net_Multimodal_Data_Fusion
Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and lidar dataset(Houston and Trento) and multispectral and synthetic aperture radar data (grss-dfc-2007 datasets).
Language: Python - Size: 40.1 MB - Last synced at: 9 months ago - Pushed at: about 2 years ago - Stars: 31 - Forks: 3

GuanRunwei/Achelous
Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar
Language: Python - Size: 67.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 135 - Forks: 7

ecovision-uzh/sat-sinr
[ISPRS 2024] Sat-SINR: High-Resolution Species Distribution Models through Satellite Imagery
Language: Python - Size: 2.48 MB - Last synced at: 5 months ago - Pushed at: 10 months ago - Stars: 3 - Forks: 1

tudelft-iv/UniBEV
[IVS'24] UniBEV: the official implementation of UniBEV
Language: Python - Size: 12.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 10 - Forks: 1

yuntaoshou/pami
Size: 42 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

wangxiao5791509/VisEvent_SOT_Benchmark
[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.
Language: Python - Size: 19.9 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 105 - Forks: 8

gaosaroma/MM-AHGNN
Multi-Modal Attention-based Hierarchical Graph Neural Network for Object Interaction Recommendation in Internet of Things (IoT)
Language: Python - Size: 14.7 MB - Last synced at: 8 days ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1

zjukg/AdaMF-MAT
[Paper][LREC-COLING 2024] Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion
Language: Python - Size: 1.91 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 1

nhattruongpham/SER-Fuse
SER-Fuse: An Emotion Recognition Application Utilizing Multi-Modal, Multi-Lingual, and Multi-Feature Fusion
Language: Jupyter Notebook - Size: 819 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

chenzpstar/Multi-Modal-Image-Fusion
Training for multi-modal image fusion with PyTorch.
Language: Python - Size: 10.2 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 3

HackerHyper/ACMVH
Adaptive Confidence Multi-View Hashing
Language: Python - Size: 19.5 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 0

kdhht2334/Hidden_Emotion_Detection_using_MM_Signals
[CHI2021] Hidden emotion detection using multi-modal signals
Language: Python - Size: 48 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1
