Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: multi-modal-fusion
Event-AHU/VTF_PAR
[CVPR-2023 Workshop@NFVLR] Official PyTorch implementation of Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition
Language: Python - Size: 2 MB - Last synced: about 24 hours ago - Pushed: 1 day ago - Stars: 23 - Forks: 1
ecovision-uzh/sat-sinr
[ISPRS 2024] Sat-SINR: High-Resolution Species Distribution Models through Satellite Imagery
Language: Python - Size: 465 KB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 0 - Forks: 0
tudelft-iv/UniBEV
[IVS'24] UniBEV: the official implementation of UniBEV
Language: Python - Size: 554 KB - Last synced: 13 days ago - Pushed: 13 days ago - Stars: 5 - Forks: 0
wangxiao5791509/VisEvent_SOT_Benchmark
[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.
Language: Python - Size: 19.9 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 105 - Forks: 8
zjukg/MyGO
[Paper][Preprint 2024] MyGO: Discrete Modality Information as Fine-Grained Tokens for Multi-modal Knowledge Graph Completion
Language: Python - Size: 31.2 MB - Last synced: 14 days ago - Pushed: 15 days ago - Stars: 183 - Forks: 4
zjukg/KG-MM-Survey
Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey
Size: 82.2 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 204 - Forks: 13
kyegomez/the-compiler
Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!
Language: Python - Size: 10.4 MB - Last synced: about 1 month ago - Pushed: 11 months ago - Stars: 141 - Forks: 19
zjukg/NATIVE
[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild
Language: Python - Size: 10.2 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 6 - Forks: 0
kyegomez/MoE-Mamba
Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta
Language: Python - Size: 2.17 MB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 52 - Forks: 0
zjukg/AdaMF-MAT
[Paper][LREC-COLING 2024] Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion
Language: Python - Size: 1.91 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 11 - Forks: 1
GuanRunwei/Achelous
Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar
Language: Python - Size: 67.3 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 130 - Forks: 7
nhattruongpham/SER-Fuse
SER-Fuse: An Emotion Recognition Application Utilizing Multi-Modal, Multi-Lingual, and Multi-Feature Fusion
Language: Jupyter Notebook - Size: 819 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0
kyegomez/MegaVIT
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
Language: Python - Size: 228 KB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 18 - Forks: 0
FIVEYOUNGWOO/IEEE-802.11n-CSI-Camera-Synchronization-Toolkit
IEEE 802.11n CSI and camera synchronization toolkit.
Language: C - Size: 228 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 6 - Forks: 6
chenzpstar/Multi-Modal-Image-Fusion
Training for multi-modal image fusion with PyTorch.
Language: Python - Size: 10.2 MB - Last synced: 5 months ago - Pushed: 6 months ago - Stars: 16 - Forks: 3
zylbuaa/TFormer
The official implementation of "TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis"
Language: Python - Size: 521 KB - Last synced: 3 months ago - Pushed: 4 months ago - Stars: 6 - Forks: 1
HackerHyper/ACMVH
Adaptive Confidence Multi-View Hashing
Language: Python - Size: 19.5 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 19 - Forks: 0
SMARTlab-Purdue/Husformer
This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.
Language: Python - Size: 2.94 MB - Last synced: 9 months ago - Pushed: 12 months ago - Stars: 89 - Forks: 26
Cimy-wang/AM3Net_Multimodal_Data_Fusion
Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and lidar dataset(Houston and Trento) and multispectral and synthetic aperture radar data (grss-dfc-2007 datasets).
Language: Python - Size: 40.1 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 11 - Forks: 0
gaosaroma/MM-AHGNN
Multi-Modal Attention-based Hierarchical Graph Neural Network for Object Interaction Recommendation in Internet of Things (IoT)
Language: Python - Size: 14.7 MB - Last synced: over 1 year ago - Pushed: over 2 years ago - Stars: 2 - Forks: 1
kdhht2334/Hidden_Emotion_Detection_using_MM_Signals
[CHI2021] Hidden emotion detection using multi-modal signals
Language: Python - Size: 48 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 5 - Forks: 1