GitHub / declare-lab 56 Repositories
declare-lab/jamify
JAM: A Tiny Flow-based Song Generator with Fine-grained Controllability and Aesthetic Alignment
Language: Python - Size: 68.9 MB - Last synced at: about 14 hours ago - Pushed at: about 16 hours ago - Stars: 0 - Forks: 0

declare-lab/declare-lab.github.io
Language: HTML - Size: 421 MB - Last synced at: about 20 hours ago - Pushed at: about 22 hours ago - Stars: 0 - Forks: 0

declare-lab/awesome-emotion-recognition-in-conversations
A comprehensive reading list for Emotion Recognition in Conversations
Size: 273 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 271 - Forks: 45

declare-lab/MELD
MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation
Language: Python - Size: 7.97 MB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 929 - Forks: 220

declare-lab/nora
NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks
Language: Python - Size: 1.21 MB - Last synced at: 18 days ago - Pushed at: 19 days ago - Stars: 141 - Forks: 8

declare-lab/flacuna
Flacuna was developed by fine-tuning Vicuna on Flan-mini, a comprehensive instruction collection encompassing various tasks. Vicuna is already an excellent writing assistant, and the intention behind Flacuna was to enhance Vicuna's problem-solving capabilities. To achieve this, we curated a dedicated instruction dataset called Flan-mini.
Language: Python - Size: 1.63 MB - Last synced at: 2 days ago - Pushed at: almost 2 years ago - Stars: 111 - Forks: 2

declare-lab/LLM-PuzzleTest
This repository is maintained to release dataset and models for multimodal puzzle reasoning.
Language: Python - Size: 131 MB - Last synced at: 24 days ago - Pushed at: 5 months ago - Stars: 95 - Forks: 7

declare-lab/red-instruct
Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
Language: Python - Size: 48 MB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 102 - Forks: 13

declare-lab/Auto-Scaling
[Arxiv 2024] Official Implementation of the paper: "Towards Robust Instruction Tuning on Multimodal Large Language Models"
Language: Jupyter Notebook - Size: 67.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 9 - Forks: 1

declare-lab/RECCON
This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.
Language: Python - Size: 15.9 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 182 - Forks: 30

declare-lab/ferret
Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique
Language: Python - Size: 47.9 MB - Last synced at: 21 days ago - Pushed at: 11 months ago - Stars: 17 - Forks: 3

declare-lab/TangoFlux
TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching
Language: Jupyter Notebook - Size: 10.8 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 734 - Forks: 65

declare-lab/awesome-sentiment-analysis
Reading list for Awesome Sentiment Analysis papers
Size: 3.47 MB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 528 - Forks: 95

declare-lab/PathFinder-PRM
This repository contains the official implementation of Error Typing for Smarter Rewards: Improving Process Reward Models with Error-Aware Hierarchical Supervision.
Language: Jupyter Notebook - Size: 22.2 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

declare-lab/conv-emotion
This repo contains implementation of different architectures for emotion recognition in conversations.
Language: Python - Size: 734 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 1,438 - Forks: 339

declare-lab/multimodal-deep-learning
This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.
Language: OpenEdge ABL - Size: 181 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 840 - Forks: 155

declare-lab/tango
A family of diffusion models for text-to-audio generation.
Language: Python - Size: 19.3 MB - Last synced at: 2 months ago - Pushed at: 7 months ago - Stars: 1,167 - Forks: 99

declare-lab/Emma-X
Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning
Language: Python - Size: 32.7 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 64 - Forks: 5

declare-lab/instruct-eval
This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
Language: Python - Size: 3.55 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 547 - Forks: 46

declare-lab/flan-alpaca
This repository contains code for extending the Stanford Alpaca synthetic instruction tuning to existing instruction-tuned models such as Flan-T5.
Language: Python - Size: 33.2 KB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 352 - Forks: 38

declare-lab/LLM-ReasoningTest
Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions
Language: Python - Size: 1.78 MB - Last synced at: 10 days ago - Pushed at: 3 months ago - Stars: 10 - Forks: 1

declare-lab/exemplary-empathy
This repository contains the source codes of the paper -- Exemplars-guided Empathetic Response Generation Controlled by the Elements of Human Communication
Language: Python - Size: 108 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 24 - Forks: 5

declare-lab/safety-arithmetic
Language: Jupyter Notebook - Size: 382 KB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 11 - Forks: 5

declare-lab/adapter-mix
Language: Python - Size: 245 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 4

declare-lab/darwin
Language: Python - Size: 9.77 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 3 - Forks: 0

declare-lab/CICERO
The purpose of this repository is to introduce new dialogue-level commonsense inference datasets and tasks. We chose dialogues as the data source because dialogues are known to be complex and rich in commonsense.
Language: Python - Size: 7.62 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 64 - Forks: 7

declare-lab/Multimodal-Infomax
This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNLP 2021.
Language: Python - Size: 145 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 179 - Forks: 34

declare-lab/MISA
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Language: Python - Size: 229 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 229 - Forks: 33

declare-lab/dialogue-understanding
This repository contains PyTorch implementation for the baseline models from the paper Utterance-level Dialogue Understanding: An Empirical Study
Language: Python - Size: 216 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 126 - Forks: 21

declare-lab/PromptDistill
Size: 0 Bytes - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

declare-lab/BBFN
This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis
Language: Python - Size: 1.25 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 71 - Forks: 14

declare-lab/MM-InstructEval
This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimodal content comprehension tasks.
Language: Python - Size: 32.6 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 27 - Forks: 1

declare-lab/trust-align
Codes and datasets for the paper Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse
Language: Python - Size: 2.41 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 47 - Forks: 2

declare-lab/resta
Restore safety in fine-tuned language models through task arithmetic
Language: Python - Size: 75.6 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 2

declare-lab/RelationPrompt
This repository implements our ACL Findings 2022 research paper RelationPrompt: Leveraging Prompts to Generate Synthetic Data for Zero-Shot Relation Triplet Extraction. The goal of Zero-Shot Relation Triplet Extraction (ZeroRTE) is to extract relation triplets of the format (head entity, tail entity, relation), despite not having annotated data for the test relation labels.
Language: Python - Size: 66.4 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 131 - Forks: 16

declare-lab/MM-Align
[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Sequences"
Language: Python - Size: 284 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 2

declare-lab/.github
Size: 137 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

declare-lab/KNOT
This repository contains the implementation of the paper -- KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Language: Python - Size: 70.3 KB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 14 - Forks: 1

declare-lab/della
DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling
Language: Python - Size: 160 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 29 - Forks: 2

declare-lab/MIME
This repository contains PyTorch implementations of the models from the paper An Empirical Study MIME: MIMicking Emotions for Empathetic Response Generation.
Language: Python - Size: 25.2 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 44 - Forks: 11

declare-lab/contextual-utterance-level-multimodal-sentiment-analysis
Context-Dependent Sentiment Analysis in User-Generated Videos
Language: Python - Size: 57.8 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 124 - Forks: 41

declare-lab/HyperTTS
Language: Python - Size: 145 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 2

declare-lab/CASCADE
This repo contains code to detect sarcasm from text in discussion forum using deep learning
Language: Python - Size: 68.5 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 86 - Forks: 48

declare-lab/Sealing
[NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"
Language: Python - Size: 8.92 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 3

declare-lab/ASTE-RL
This repository contains the source codes for the paper: "Aspect Sentiment Triplet Extraction using Reinforcement Learning" published at CIKM 2021.
Language: Python - Size: 39.1 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 3

declare-lab/domadapter
Code for EACL'23 paper "Udapter: Efficient Domain Adaptation Using Adapters"
Language: Python - Size: 538 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 1

declare-lab/kingdom
Domain Adaptation using External Knowledge for Sentiment Analysis
Language: Python - Size: 31.9 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 54 - Forks: 14

declare-lab/TEAM
Our EMNLP 2022 paper on MCQA
Language: Python - Size: 98 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 23 - Forks: 3

declare-lab/HyperRED
This repository implements our EMNLP 2022 research paper A Dataset for Hyper-Relational Extraction and a Cube-Filling Approach.
Language: Python - Size: 232 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 2

declare-lab/speech-adapters
Codes and datasets for our ICASSP2023 paper, Evaluating parameter-efficient transfer learning approaches on SURE benchmark for speech understanding
Language: Python - Size: 2.17 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 43 - Forks: 8

declare-lab/dialog-HGAT
Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks
Language: Python - Size: 18.2 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 56 - Forks: 13

declare-lab/segue
Codes and Checkpoints of the Interspeech paper "Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken Language Understanding"
Language: Python - Size: 244 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 7 - Forks: 1

declare-lab/DoubleMix
Code for the COLING 2022 paper "DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification"
Language: Python - Size: 136 MB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 19 - Forks: 1

declare-lab/hfusion
Multimodal sentiment analysis using hierarchical fusion with context modeling
Language: Python - Size: 1.55 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 44 - Forks: 22

declare-lab/CIDER
This repository contains the dataset and the pytorch implementations of the models from the paper CIDER: Commonsense Inference for Dialogue Explanation and Reasoning. CIDER has been accepted to appear at SIGDIAL 2021.
Language: Python - Size: 9.06 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 6

declare-lab/sentence-ordering
This repository contains the PyTorch implementation of the paper STaCK: Sentence Ordering with Temporal Commonsense Knowledge appearing at EMNLP 2021.
Language: Python - Size: 8.37 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 28 - Forks: 7

declare-lab/MSA-Robustness
NAACL 2022 paper on Analyzing Modality Robustness in Multimodal Sentiment Analysis
Language: Python - Size: 3.43 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 31 - Forks: 5

declare-lab/M2H2-dataset
This repository contains the dataset and baselines explained in the paper: M2H2: A Multimodal Multiparty Hindi Dataset For HumorRecognition in Conversations
Language: Python - Size: 2.21 GB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 12

declare-lab/WikiDes
A Wikipedia-based summarization dataset
Language: Python - Size: 60.6 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 3

declare-lab/VIP
Our EMNLP 2022 paper on VIP-Based Prompting for Parameter-Efficient Learning
Language: Python - Size: 996 KB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 8 - Forks: 0

declare-lab/SANCL
[COLING 2022] This repository contains the code of the paper SANCL: Multimodal Review Helpfulness Prediction with Selective Attention and Natural Contrastive Learning.
Language: Python - Size: 13.8 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 0

declare-lab/mustango Fork of AMAAI-Lab/mustango
Mustango: Toward Controllable Text-to-Music Generation
Language: Python - Size: 51.4 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

declare-lab/NLP-OT
Size: 1.95 KB - Last synced at: 23 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

declare-lab/SAT
Code for the EMNLP 2022 Findings short paper "SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Training"
Language: Jupyter Notebook - Size: 63.9 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 4

declare-lab/Video2Music Fork of AMAAI-Lab/Video2Music
Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model
Size: 604 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

declare-lab/identifiable-transformers
Language: Python - Size: 11.1 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 2

declare-lab/LG-VQA
Language: Python - Size: 29.4 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 1

declare-lab/DPR Fork of facebookresearch/DPR
Dense Passage Retriever - is a set of tools and models for open domain Q&A task.
Size: 300 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1
