Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: multimodal-interactions

thuiar/UMC

Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances (ACL 2024)

Language: Python - Size: 1.85 MB - Last synced: 11 days ago - Pushed: 12 days ago - Stars: 7 - Forks: 0

declare-lab/awesome-emotion-recognition-in-conversations

A comprehensive reading list for Emotion Recognition in Conversations

Size: 273 KB - Last synced: 12 days ago - Pushed: 4 months ago - Stars: 244 - Forks: 42

IdentiMood/LittleAntispoof

A multimodal face liveness detection module that can be used in the context of face anti-spoofing

Language: Python - Size: 2.98 MB - Last synced: 18 days ago - Pushed: 19 days ago - Stars: 6 - Forks: 0

declare-lab/MELD

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

Language: Python - Size: 7.97 MB - Last synced: about 2 months ago - Pushed: 3 months ago - Stars: 746 - Forks: 194

declare-lab/multimodal-deep-learning

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

Language: OpenEdge ABL - Size: 181 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 640 - Forks: 138

declare-lab/contextual-utterance-level-multimodal-sentiment-analysis

Context-Dependent Sentiment Analysis in User-Generated Videos

Language: Python - Size: 57.8 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 119 - Forks: 42

microsoft/psi

Platform for Situated Intelligence

Language: C# - Size: 36.9 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 505 - Forks: 90

declare-lab/hfusion

Multimodal sentiment analysis using hierarchical fusion with context modeling

Language: Python - Size: 1.55 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 43 - Forks: 22

soujanyaporia/MUStARD

Multimodal Sarcasm Detection Dataset

Language: OpenEdge ABL - Size: 75.4 MB - Last synced: 7 months ago - Pushed: about 1 year ago - Stars: 247 - Forks: 57

tiagohpf/im-2018-assign4

Control of some Spotify's functionalities with gestures and speech

Language: C# - Size: 14.4 MB - Last synced: 8 months ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0

tiagohpf/im-2018-assign3

Control of some Spotify's functionalities with gestures

Language: C# - Size: 11 MB - Last synced: 8 months ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0

tiagohpf/im-2018-assign2

Control of some Spotify's functionalities by voice

Language: C# - Size: 10.4 MB - Last synced: 8 months ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0

Techievena/Numbers_Trivia

A multimodal skill built with Amazon Alexa Skills Kit that educates children on the importance of numbers and dates.

Language: Python - Size: 1.69 MB - Last synced: 10 months ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

amrgomaaelhady/ML-PersRef

Code for ICMI2020 and ICMI2021 papers: "Studying Person-Specific Pointing and Gaze Behavior for Multimodal Referencing of Outside Objects from a Moving Vehicle" and "ML-PersRef: A Machine Learning-based Personalized Multimodal Fusion Approach for Referencing Outside Objects From a Moving Vehicle"

Language: Jupyter Notebook - Size: 17 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 3 - Forks: 1

semanux/website

Website of the Semanux spin-off.

Language: CSS - Size: 46.4 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 4 - Forks: 0

umdsquare/data-at-hand-mobile

Mobile application for exploring fitness data using both speech and touch interaction.

Language: TypeScript - Size: 12.1 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 63 - Forks: 18

A2Zadeh/TensorFusionNetwork

EMNLP 2017 (Oral): Tensor Fusion Network for Multimodal Sentiment Analysis Code

Language: Python - Size: 13.7 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 56 - Forks: 13

jcornaz/hesso.mpri.hmm 📦

Travail de groupe pour le cours MPRI de la HES-SO

Language: Matlab - Size: 5.77 MB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 0 - Forks: 0

jcornaz/hesso.mpri.kemboko 📦

Challenge of gesture recognition for the course : "Multimodal Processing Recognition and Interaction" of the HES-SO university (Switzerland)

Language: Matlab - Size: 1.8 MB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 0 - Forks: 0

erunseelie/MMIyo Fork of Alvipe/Open-Myo 📦

Repository to contain MMI development during UTA CSE REU 2019. Makes use of Open-Myo, a module to get data from a Myo armband using a generic BLE interface.

Language: Python - Size: 14.5 MB - Last synced: almost 1 year ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0

PrithivirajDamodaran/vision-language-modelling-series

Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations

Language: Jupyter Notebook - Size: 6.15 MB - Last synced: over 1 year ago - Pushed: almost 2 years ago - Stars: 13 - Forks: 4

xuxingya/talkingdraw

Using voice and pen to draw diagrams quickly with automatically suggested icons and texts by AI in talking.

Language: JavaScript - Size: 22.7 MB - Last synced: about 1 year ago - Pushed: about 6 years ago - Stars: 6 - Forks: 0

emanuelegiona/MI2020

Project for Multimodal Interaction course (A.Y. 2019/2020), GesturePad

Language: Python - Size: 3.07 MB - Last synced: over 1 year ago - Pushed: almost 4 years ago - Stars: 2 - Forks: 0

geut/plusultra_whitepaper

Technical Draft: A platform to augment web applications with multimodal interactions

Language: TeX - Size: 246 KB - Last synced: over 1 year ago - Pushed: almost 9 years ago - Stars: 3 - Forks: 0

Related Keywords
multimodal-interactions 24 multimodal-deep-learning 5 multimodal-sentiment-analysis 5 emotion-recognition 4 sentiment-analysis 3 academic-project 3 speech-recognition 3 spotify-api 3 master 2 hes-so 2 machine-learning 2 artificial-intelligence 2 multimodal-learning 2 emotion-detection 2 kinect-v2 2 gesture-recognition 2 emotion-recognition-in-conversation 2 dialogue-systems 2 conversational-ai 2 component-library 1 jekyll 1 startup 1 deep-learning 1 visualization 1 visual-data 1 speech 1 smartphones 1 navigation 1 mobile-app 1 voice-input 1 fitness-tracker 1 web 1 website 1 fitbit 1 research-project 1 geut-labs 1 voicetext 1 text-editor 1 sapienza-university 1 python 1 mediapipe 1 google-cloud-speech 1 gesture-control 1 user-interface 1 sequence-to-sequence 1 vision-and-language-pre-training 1 vision-and-language-navigation 1 vision-and-language 1 multimodal-representation 1 research 1 myo-armband 1 emg 1 bluetooth-low-energy 1 school-project 1 challenge 1 schoolwork 1 lstm-neural-networks 1 lstm 1 keras 1 personality-traits 1 personality-profiling 1 multimodal-emotion-recognition 1 emotion 1 dialogue 1 chatbot 1 gaze-tracking 1 gaze-estimation 1 gaze-detection 1 deepface 1 blink-detection 1 natural-language-processing 1 intent 1 discovery 1 clustering 1 acl2024 1 eye-tracking 1 blog 1 accessibility 1 automotive 1 numbersapi 1 amazon-web-services 1 alexa 1 sarcasm-detection 1 sarcasm 1 multimodal-fusion 1 fusion 1 emotion-analysis 1 data-fusion 1 streaming 1 stream-processing 1 pipelines 1 perception 1 multimodal 1 human-robot-interaction 1 framework 1