microsoft/UniVL

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"

Language: Python - Size: 219 KB - Last synced at: about 12 hours ago - Pushed at: about 1 year ago - Stars: 358 - Forks: 58

declare-lab/MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

Language: Python - Size: 7.97 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 929 - Forks: 220

thuiar/MMSA-FET

A Tool for extracting multimodal features from videos.

Language: Python - Size: 24.4 MB - Last synced at: 7 days ago - Pushed at: over 2 years ago - Stars: 175 - Forks: 23

shamanez/Self-Supervised-Embedding-Fusion-Transformer

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

Language: Python - Size: 4.65 MB - Last synced at: 10 days ago - Pushed at: almost 4 years ago - Stars: 121 - Forks: 22

thuiar/MMSA

MMSA is a unified framework for Multimodal Sentiment Analysis.

Language: Python - Size: 9.04 MB - Last synced at: 23 days ago - Pushed at: 6 months ago - Stars: 825 - Forks: 121

abikaki/awesome-speech-emotion-recognition

😎 Awesome lists about Speech Emotion Recognition

Size: 6.03 MB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 91 - Forks: 6

declare-lab/multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

Language: OpenEdge ABL - Size: 181 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 840 - Forks: 155

boemer00/cooper-video-analysis

We are building the MCP layer for emotional intelligence bridging audio, video, and text to help AI/humans understand, create, and optimise emotionally resonant experiences at scale

Language: Python - Size: 245 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Haoyu-ha/LNLN

Towards Robust Multimodal Sentiment Analysis with Incomplete Data

Language: Python - Size: 29.3 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 53 - Forks: 4

declare-lab/Multimodal-Infomax

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.

Language: Python - Size: 145 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 179 - Forks: 34

declare-lab/BBFN

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

Language: Python - Size: 1.25 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 71 - Forks: 14

taco-group/DecAlign

A novel cross-modal decoupling and alignment framework for multimodal representation learning.

Language: JavaScript - Size: 13.8 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

declare-lab/MM-Align

[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"

Language: Python - Size: 284 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 2

declare-lab/contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

Language: Python - Size: 57.8 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 124 - Forks: 41

christosojan/MSA_in_Indian_Languages

Implementation of Dense Fusion Network with Multimodal Residual (DFMR) for Multi-modal Sentiment Analysis(MSA) in native Indian Languages like Malayalam by integrating Multi-modal information from Multimedia. The model processes the textual, visual, and auditory modalities of the video to classify the sentiment into five categories.

Language: Jupyter Notebook - Size: 31.3 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

NUSTM/FacialMMT

A Facial Expression-Aware Multimodal Multi-task Learning Framework for Emotion Recognition in Multi-party Conversations (ACL 2023)

Language: Python - Size: 6.63 MB - Last synced at: 7 months ago - Pushed at: 9 months ago - Stars: 62 - Forks: 3

XL2248/MSCTD

Code and Data for the ACL22 main conference paper "MSCTD: A Multimodal Sentiment Chat Translation Dataset"

Language: Python - Size: 99.8 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 40 - Forks: 3

PreferredAI/vista-net

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

Language: Python - Size: 18.6 KB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 91 - Forks: 19

Haoyu-ha/ALMT

Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis

Language: Python - Size: 52.7 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 60 - Forks: 6

declare-lab/hfusion

Multimodal sentiment analysis using hierarchical fusion with context modeling

Language: Python - Size: 1.55 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 44 - Forks: 22

declare-lab/MSA-Robustness

NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis

Language: Python - Size: 3.43 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 31 - Forks: 5

ttrikn/PBDD

Codes for paper：A Prompt-Based Learning Approach for Few-Shot Social Media Depression Detection

Language: Python - Size: 3.33 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

mongodb-developer/Google-Cloud-Sentiment-Chef

Sentiment Analysis, Summarization, Tagging with MongoDB Atlas and Gemini — Google Cloud's AI model

Language: TypeScript - Size: 206 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 12 - Forks: 4

Vamos66/MTAMW

Language: Python - Size: 1.52 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 0

imadhou/multimodal-sentiment-analysis

Multimodal sentiment analysis

Language: Jupyter Notebook - Size: 1.34 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 2

ttrikn/EMVAS

Open source code for paper: End-to-End Multimodal Emotion Visualization Analysis System

Language: Python - Size: 914 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 0

Vincent-ZHQ/DMER

A survey of deep multimodal emotion recognition.

Size: 143 KB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 44 - Forks: 4

SrishtiVashishtha/Inferring-Sentiments-from-Supervised-Classification-of-Text-and-Speech-cues-using-Fuzzy-Rules

Multimodal Sentiment Analysis of video reviews on social media platform, using a supervised fuzzy rule-based system.

Language: Python - Size: 11.7 KB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 4 - Forks: 0

WangJingyao07/Multimodal-Sentiment-Analysis-for-Health-Navigation

Emotion recognition methods through facial expression, speeches, audios, and multimodal data

Language: Jupyter Notebook - Size: 2.43 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 0

elsobhano/Multimodal-Emotion-Recognition

Multimodal Emotion Recognition using ClipBERT.

Language: Python - Size: 880 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

anita-hu/MSAF

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

Language: Python - Size: 101 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 59 - Forks: 9

shOh-ai/Personalized_Emotion-Analysis_using_Multi-modal_DL

2023 1st semester -BigDataProject Team Project Page

Language: Jupyter Notebook - Size: 233 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 2

clp-research/language-models-multimodal-tasks

Official Git repository for "Hakimov, S., and Schlangen, D., (2023). Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks. Findings of the Association for Computational Linguistics (ACL 2023 Findings)"

Language: Python - Size: 17.7 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

ichalkiad/cryptogpcausality

This repository contains the code for the paper "Sentiment-driven statistical causality in multimodal systems", by Ioannis Chalkiadakis, Anna Zaremba, Gareth W. Peters and Michael J. Chantler.

Language: MATLAB - Size: 121 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 2

thuiar/Cross-Modal-BERT

CM-BERT: Cross-Modal BERT for Text-Audio Sentiment Analysis（MM2020）

Language: Python - Size: 1.79 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 76 - Forks: 23

Kaicheng-Yang0828/Multimodal-Sentiment-Analysis-Paper-list

This paper list is about multimodal sentiment analysis.

Size: 14.6 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 27 - Forks: 1

04mayukh/R2D2-at-SemEval-2022-Task-5-MAMI

This repository contains the code for submission made at SemEval 2022 Task 5: MAMI

Language: Jupyter Notebook - Size: 562 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

cleopatra-itn/fair_multimodal_sentiment

Code and Splits for the paper "A Fair and Comprehensive Comparison of Multimodal Tweet Sentiment Analysis Methods", In Proceedings of the 2021 Workshop on Multi-Modal Pre-Training for Multimedia Understanding (MMPT ’21), August 21, 2021,Taipei, Taiwan

Language: Python - Size: 628 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 2

sverma88/DeepCU-IJCAI19

DeepCU: Integrating Both Common and Unique Latent Information for Multimodal Sentiment Analysis, IJCAI-19

Language: Python - Size: 36.7 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 19 - Forks: 8

vkeswani/IITK_Memotion_Analysis

Bimodal and Unimodal Sentiment Analysis of Internet Memes (Image+Text)

Language: Python - Size: 252 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 11 - Forks: 3

Fuzzytariy/CMF-DGCN

A Chinese Sentiment Analysis Model based on Transmembrane State Attention for Modal Fusion and Multimodal Dynamic Gradient Regulation.

Language: Python - Size: 4.04 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

A2Zadeh/TensorFusionNetwork

EMNLP 2017 (Oral): Tensor Fusion Network for Multimodal Sentiment Analysis Code

Language: Python - Size: 13.7 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 56 - Forks: 13

Baibhav-nag/Multimodal-emotion-recognition

Multimodal emotion recognition on two benchmark datasets RAVDESS and SAVEE from audio-visual information using CNN(Convolutional Neural Networks)

Language: Jupyter Notebook - Size: 10 MB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 2

roshansridhar/Multimodal-Sentiment-Analysis

Engaged in research to help improve to boost text sentiment analysis using facial features from video using machine learning.

Language: Jupyter Notebook - Size: 2.04 MB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 25 - Forks: 10