GitHub topics: multimodal-emotion-recognition
Sanchemtos/Multi-Label-Emotion-Recognition
This project focuses on detecting multiple emotions from English text using a fine-tuned **BERT** model. It leverages the [GoEmotions](https://huggingface.co/datasets/go_emotions) dataset — a large-scale human-annotated dataset of Reddit comments labeled with 27 emotions + neutral.
Language: Jupyter Notebook - Size: 118 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0
SuperKogito/SER-datasets
A collection of datasets for the purpose of emotion recognition/detection in speech.
Language: HTML - Size: 3.72 MB - Last synced at: 8 days ago - Pushed at: 7 months ago - Stars: 332 - Forks: 44
rishiswethan/Video-Audio-Face-Emotion-Recognition
The repo contains an audio emotion detection model, facial emotion detection model, and a model that combines both these models to predict emotions from a video
Language: Jupyter Notebook - Size: 126 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 73 - Forks: 19
abikaki/awesome-speech-emotion-recognition
😎 Awesome lists about Speech Emotion Recognition
Size: 6.03 MB - Last synced at: 8 days ago - Pushed at: 5 months ago - Stars: 84 - Forks: 4
ankurbhatia24/MULTIMODAL-EMOTION-RECOGNITION
Human Emotion Understanding using multimodal dataset.
Language: Jupyter Notebook - Size: 5.72 MB - Last synced at: 2 days ago - Pushed at: almost 5 years ago - Stars: 97 - Forks: 24
shamanez/Self-Supervised-Embedding-Fusion-Transformer
The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.
Language: Python - Size: 4.65 MB - Last synced at: 23 days ago - Pushed at: over 3 years ago - Stars: 119 - Forks: 22
declare-lab/MELD
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
Language: Python - Size: 7.97 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 890 - Forks: 215
Demfier/multimodal-speech-emotion-recognition
Lightweight and Interpretable ML Model for Speech Emotion Recognition and Ambiguity Resolution (trained on IEMOCAP dataset)
Language: Jupyter Notebook - Size: 11.9 MB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 415 - Forks: 86
shamanez/BERT-like-is-All-You-Need
The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion Recognition
Language: Python - Size: 6.73 MB - Last synced at: 23 days ago - Pushed at: about 4 years ago - Stars: 120 - Forks: 11
NUSTM/UniVA
A Unimodal Valence-Arousal Driven Contrastive Learning Framework for Multimodal Multi-Label Emotion Recognition (ACM MM 2024 oral)
Language: Python - Size: 11.6 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 11 - Forks: 0
katerynaCh/MMA-DFER
This repository provides the codes for MMA-DFER: multimodal (audiovisual) emotion recognition method. This is an official implementation for the paper MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild.
Language: Python - Size: 1.77 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 1
Jayanth-MKV/emotion2vec-speech-emotion-detection-api
This API utilizes a pre-trained model for emotion recognition from audio files. It accepts audio files as input, processes them using the pre-trained model, and returns the predicted emotion along with the confidence score. The API leverages the FastAPI framework for easy development and deployment.
Language: Python - Size: 4.88 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0
MIntelligence-Group/SpeechImg_EmoRec
Published in Springer Multimedia Tools and Applications Journal.
Size: 181 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
Vincent-ZHQ/DMER
A survey of deep multimodal emotion recognition.
Size: 143 KB - Last synced at: 12 months ago - Pushed at: about 3 years ago - Stars: 44 - Forks: 4
rofe-dl/emotion-recognition-ensemble-learning
Emotion recognition from Speech & Text using different heterogeneous ensemble learning methods
Language: Jupyter Notebook - Size: 3.46 MB - Last synced at: 12 months ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 2
INTERSPEECH-2024/MER
Official repo for "Multi-Corpus Emotion Recognition Method based on Cross-Modal Gated Attention Fusion" in INTERSPEECH 2024
Language: Python - Size: 3.37 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
nhattruongpham/mmser
SERVER: Multi-modal Speech Emotion Recognition using Transformer-based and Vision-based Embeddings
Language: Jupyter Notebook - Size: 2.83 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0
anita-hu/MSAF
Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"
Language: Python - Size: 101 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 59 - Forks: 9
winston-lin-wei-cheng/MultiScale-Chunk-Regularization
audio-text multimodal emotion recognition model which is robust to missing data
Language: Python - Size: 188 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
bolajixi/Mulitimodal-Speech-Emotion-Recognition
A Tensorflow implementation of Speech Emotion Recognition using Audio signals and Text Data
Language: Jupyter Notebook - Size: 330 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 8 - Forks: 0
Damorgal/Multimodal-Research-experiments
All experiments were done to classify multimodal data.
Size: 161 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
