Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: multi-modal-fusion

Event-AHU/VTF_PAR

[CVPR-2023 Workshop@NFVLR] Official PyTorch implementation of Learning CLIP Guided Visual-Text Fusion Transformer for Video-based Pedestrian Attribute Recognition

Language: Python - Size: 2 MB - Last synced: about 24 hours ago - Pushed: 1 day ago - Stars: 23 - Forks: 1

ecovision-uzh/sat-sinr

[ISPRS 2024] Sat-SINR: High-Resolution Species Distribution Models through Satellite Imagery

Language: Python - Size: 465 KB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 0 - Forks: 0

tudelft-iv/UniBEV

[IVS'24] UniBEV: the official implementation of UniBEV

Language: Python - Size: 554 KB - Last synced: 13 days ago - Pushed: 13 days ago - Stars: 5 - Forks: 0

wangxiao5791509/VisEvent_SOT_Benchmark

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

Language: Python - Size: 19.9 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 105 - Forks: 8

zjukg/MyGO

[Paper][Preprint 2024] MyGO: Discrete Modality Information as Fine-Grained Tokens for Multi-modal Knowledge Graph Completion

Language: Python - Size: 31.2 MB - Last synced: 14 days ago - Pushed: 15 days ago - Stars: 183 - Forks: 4

zjukg/KG-MM-Survey

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey

Size: 82.2 MB - Last synced: 27 days ago - Pushed: 27 days ago - Stars: 204 - Forks: 13

kyegomez/the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

Language: Python - Size: 10.4 MB - Last synced: about 1 month ago - Pushed: 11 months ago - Stars: 141 - Forks: 19

zjukg/NATIVE

[Paper][SIGIR 2024] NativE: Multi-modal Knowledge Graph Completion in the Wild

Language: Python - Size: 10.2 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 6 - Forks: 0

kyegomez/MoE-Mamba

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

Language: Python - Size: 2.17 MB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 52 - Forks: 0

zjukg/AdaMF-MAT

[Paper][LREC-COLING 2024] Unleashing the Power of Imbalanced Modality Information for Multi-modal Knowledge Graph Completion

Language: Python - Size: 1.91 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 11 - Forks: 1

GuanRunwei/Achelous

Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar

Language: Python - Size: 67.3 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 130 - Forks: 7

nhattruongpham/SER-Fuse

SER-Fuse: An Emotion Recognition Application Utilizing Multi-Modal, Multi-Lingual, and Multi-Feature Fusion

Language: Jupyter Notebook - Size: 819 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

kyegomez/MegaVIT

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

Language: Python - Size: 228 KB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 18 - Forks: 0

FIVEYOUNGWOO/IEEE-802.11n-CSI-Camera-Synchronization-Toolkit

IEEE 802.11n CSI and camera synchronization toolkit.

Language: C - Size: 228 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 6 - Forks: 6

chenzpstar/Multi-Modal-Image-Fusion

Training for multi-modal image fusion with PyTorch.

Language: Python - Size: 10.2 MB - Last synced: 5 months ago - Pushed: 6 months ago - Stars: 16 - Forks: 3

zylbuaa/TFormer

The official implementation of "TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis"

Language: Python - Size: 521 KB - Last synced: 3 months ago - Pushed: 4 months ago - Stars: 6 - Forks: 1

HackerHyper/ACMVH

Adaptive Confidence Multi-View Hashing

Language: Python - Size: 19.5 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 19 - Forks: 0

SMARTlab-Purdue/Husformer

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org/abs/2209.15182.

Language: Python - Size: 2.94 MB - Last synced: 9 months ago - Pushed: 12 months ago - Stars: 89 - Forks: 26

Cimy-wang/AM3Net_Multimodal_Data_Fusion

Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and lidar dataset(Houston and Trento) and multispectral and synthetic aperture radar data (grss-dfc-2007 datasets).

Language: Python - Size: 40.1 MB - Last synced: over 1 year ago - Pushed: over 1 year ago - Stars: 11 - Forks: 0

gaosaroma/MM-AHGNN

Multi-Modal Attention-based Hierarchical Graph Neural Network for Object Interaction Recommendation in Internet of Things (IoT)

Language: Python - Size: 14.7 MB - Last synced: over 1 year ago - Pushed: over 2 years ago - Stars: 2 - Forks: 1

kdhht2334/Hidden_Emotion_Detection_using_MM_Signals

[CHI2021] Hidden emotion detection using multi-modal signals

Language: Python - Size: 48 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 5 - Forks: 1

Related Keywords
multi-modal-fusion 21 multi-modal-learning 6 multi-modal-knowledge-graph 4 multi-modal 4 transformer 3 multi-modality 3 deep-learning 3 knowledge-graph 3 knowledge-graph-completion 3 adversarial-learning 2 imbalanced-learning 2 pytorch 2 computer-vision 1 artificial-intelligence 1 multi-lingual 1 multi-feature-extraction 1 eeg-analysis 1 emotion-recognition 1 semantic-segmentation 1 point-cloud-segmentation 1 panoptic-perception 1 object-tracking 1 object-detection 1 multi-task-learning 1 4d-mmwave-radar 1 negative-sampling 1 imbalanced-data 1 swarms 1 moe 1 hidden-emotions 1 ml 1 ai 1 incomplete-data 1 human-computer-interaction 1 valence-arousal 1 hyperspectral-sar-fusion 1 graph-embedding 1 hyperspectral-lidar-fusion 1 hyperspectral-image-classification 1 multi-modal-deep-learning 1 human-state-recognition 1 affective-computing 1 multi-view-learning 1 skin-lesion-classification 1 medical-image-analysis 1 unsupervised-learning 1 hierarchical-graph-neural-network 1 polarization 1 infrared 1 object-interaction-recommendation 1 object-social-network 1 pytorch-geometric 1 image-fusion 1 wifi-modules 1 80211 1 vision-transformer 1 vision-and-language 1 gpt4 1 tokenization 1 mygo 1 contrastive-learning 1 visevent 1 spike 1 single-object-tracking 1 pengchenglab 1 neuromorphic-vision 1 neuromorphic 1 frame-event-tracking 1 event 1 dynamic-vision-sensors 1 dvs 1 robustness 1 intelligent-vehicles 1 autonomous-driving 1 3d-object-detection 1 species-distribution-modelling 1 sentinel-2 1 geo-spatial 1 earth-observation 1 visual-text-fusion 1 video-based-attribute-recognition 1 pedestrian-attribute-recognition 1 tree-of-thoughts 1 reinforcement-learning 1 prompt-engineering 1 multimodal-deep-learning 1 deep-learning-algorithms 1 chatgpt 1 chain-of-thought 1 autogpt 1 artficial-intelligence 1 agora 1 visual-question-answering 1 surveys 1 survey 1 paper-list 1 large-language-models 1 knowledge-graph-embeddings 1 information-extraction 1 image-generation 1