zjukg/KG-MM-Survey

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

Size: 82.3 MB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 401 - Forks: 19

zjukg/MyGO

[Paper][AAAI 2025] (MyGO)Tokenization, Fusion, and Augmentation: Towards Fine-grained Multi-modal Entity Representation

Language: Python - Size: 90.8 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 249 - Forks: 7

kyegomez/the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

Language: Python - Size: 10.4 MB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 144 - Forks: 16

wangxiao5791509/VisEvent_SOT_Benchmark

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

Language: Python - Size: 20 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 142 - Forks: 9

GuanRunwei/Achelous

Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar

Language: Python - Size: 67.3 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 135 - Forks: 7

kyegomez/MoE-Mamba

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

Language: Python - Size: 2.17 MB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 103 - Forks: 5

SMARTlab-Purdue/Husformer

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.

Language: Python - Size: 2.94 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 91 - Forks: 26

Cimy-wang/AM3Net_Multimodal_Data_Fusion

Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and lidar dataset(Houston and Trento) and multispectral and synthetic aperture radar data (grss-dfc-2007 datasets).

Language: Python - Size: 40.1 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 31 - Forks: 3

kyegomez/MegaVIT

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

Language: Python - Size: 211 KB - Last synced at: 17 days ago - Pushed at: about 2 months ago - Stars: 28 - Forks: 1

zjukg/MoMoK

[Paper][ICLR 2025] Multiple Heads are Better than One: Mixture of Modality Knowledge Experts for Entity Representation Learning

Language: Python - Size: 7 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 27 - Forks: 3

Event-AHU/VTF_PAR

[CVPR-2023 Workshop@NFVLR] Official PyTorch implementation of Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition

Language: Python - Size: 2 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 23 - Forks: 2

HackerHyper/ACMVH

Adaptive Confidence Multi-View Hashing

Language: Python - Size: 19.5 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 0

zjukg/NATIVE

[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild

Language: Python - Size: 10.2 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 18 - Forks: 1

chenzpstar/Multi-Modal-Image-Fusion

Training for multi-modal image fusion with PyTorch.

Language: Python - Size: 10.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 3

zylbuaa/TFormer

The official implementation of "TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis"

Language: Python - Size: 521 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 2

FIVEYOUNGWOO/IEEE-802.11n-CSI-Camera-Synchronization-Toolkit

IEEE 802.11n CSI and camera synchronization toolkit.

Language: C - Size: 229 MB - Last synced at: 8 days ago - Pushed at: 5 months ago - Stars: 12 - Forks: 4

zjukg/AdaMF-MAT

[Paper][LREC-COLING 2024] Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

Language: Python - Size: 1.91 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 1

tudelft-iv/UniBEV

[IVS'24] UniBEV: the official implementation of UniBEV

Language: Python - Size: 12.3 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 10 - Forks: 1

gaosaroma/MM-AHGNN

Multi-Modal Attention-based Hierarchical Graph Neural Network for Object Interaction Recommendation in Internet of Things (IoT)

Language: Python - Size: 14.7 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1

kdhht2334/Hidden_Emotion_Detection_using_MM_Signals

[CHI2021] Hidden emotion detection using multi-modal signals

Language: Python - Size: 48 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1

ecovision-uzh/sat-sinr

[ISPRS 2024] Sat-SINR: High-Resolution Species Distribution Models through Satellite Imagery

Language: Python - Size: 2.48 MB - Last synced at: 6 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 1

SeyedMuhammadHosseinMousavi/Multi-Modal-Fusion

Early Fusion, Late Fusion, and Hybrid Fusion

Language: Python - Size: 3.5 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 2 - Forks: 1

BubbleWang-wly/EIEA

Explicit-Implicit Entity Alignment Method in Multi-modal Knowledge Graphs

Language: Python - Size: 755 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

SeyedMuhammadHosseinMousavi/Comprehensive-Machine-Learning-Techniques-Metrics-Classifiers-and-Evaluation

Comprehensive Machine Learning Techniques: Metrics, Classifiers, and Evaluation

Language: Python - Size: 14.8 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

yuntaoshou/pami

Size: 42 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

nhattruongpham/SER-Fuse

SER-Fuse: An Emotion Recognition Application Utilizing Multi-Modal, Multi-Lingual, and Multi-Feature Fusion

Language: Jupyter Notebook - Size: 819 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0