GitHub topics: multilingual-nlp

Repositories

Tanlouie/Gendered_Abuse_Detection_In_Indic-Languages

Online gender-based violence limits marginalized voices. Detection in Indic languages is hard due to limited data and linguistic complexity. This work builds better classifiers for improved abuse detection in such settings.

Language: Jupyter Notebook - Size: 17.8 MB - Last synced at: about 1 hour ago - Pushed at: about 2 hours ago - Stars: 0 - Forks: 0

spqr-86/gitlab-onboarding-rag

A multilingual (RU/EN) RAG system built on 847 pages of GitLab documentation to provide instant answers for new employees, achieving 89% response accuracy and sub-3-second latency.

Language: HTML - Size: 3.23 MB - Last synced at: about 8 hours ago - Pushed at: about 9 hours ago - Stars: 0 - Forks: 0

embeddings-benchmark/mteb

MTEB: Massive Text Embedding Benchmark

Language: Python - Size: 40.5 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 2,626 - Forks: 422

epfl-nlp/ConLID

Language: Python - Size: 356 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2 - Forks: 0

MS134340/Sentence-Embeddings-Using-N-Gram-Features-and-Contrastive-Learning-for-Multilingual-Datasets

"Generates sentence embeddings using N-gram features and contrastive learning, optimized for multilingual datasets and semantic similarity tasks."

Language: Jupyter Notebook - Size: 2.64 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

franciellevargas/MFTCXplain

MFTCXplain is the first multilingual benchmark dataset designed to evaluate the moral reasoning of Large Language Models (LLM) through multi-hop hate speech explanations grounded in Moral Foundations Theory (MFT).

Language: Jupyter Notebook - Size: 2.77 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

BeaEsparcia/Spanish_Text_Classification_BERT

Spanish text classifier using BERT to detect user intent (information request, complaint, or recommendation). Includes synthetic training data and custom ambiguous examples to test robustness. Portfolio project focused on intent recognition and conversational design in Spanish.

Language: Jupyter Notebook - Size: 460 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

FSoft-AI4Code/TheVault

[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

Language: Jupyter Notebook - Size: 9.44 MB - Last synced at: 9 days ago - Pushed at: 10 months ago - Stars: 96 - Forks: 9

microsoft/Multilingual-Culture-First-Misgendering-Guardrails

Repository for the paper "A Multilingual, Culture-First Approach to Addressing Misgendering in LLM Applications"

Size: 3.29 MB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

llm-lab-org/MENA-Values-Benchmark-Evaluating-Cultural-Alignment-and-Multilingual-Bias-in-Large-Language-Models

This repository contains the dataset and code used in our paper, “MENA Values Benchmark: Evaluating Cultural Alignment and Multilingual Bias in Large Language Models.” It provides tools to evaluate how large language models represent Middle Eastern and North African cultural values across 16 countries, multiple languages, and perspectives.

Language: Python - Size: 87.3 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 1 - Forks: 0

epfl-dlab/llm-latent-language

Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".

Language: Jupyter Notebook - Size: 2.54 MB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 76 - Forks: 17

eriglesias/RosettaFables

Analyzing Aesop's fables across languages using advanced NLP techniques

Language: Python - Size: 19 MB - Last synced at: 3 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0

swaggy66/M-ABSA

M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis

Language: Python - Size: 30.5 MB - Last synced at: 30 days ago - Pushed at: 30 days ago - Stars: 4 - Forks: 1

cisnlp/Glot500

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

Language: Python - Size: 151 KB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 101 - Forks: 4

bigscience-workshop/xmtf

Crosslingual Generalization through Multitask Finetuning

Language: Jupyter Notebook - Size: 28.6 MB - Last synced at: 29 days ago - Pushed at: 9 months ago - Stars: 533 - Forks: 39

VenkateshSoni/MarathiSentimentAnalysis

A natural language processing project focused on analyzing sentiment in Marathi text. It leverages state of the art Large Language Model to classify text into positive, negative, or neutral sentiments—enabling sentiment-aware applications in regional languages.

Language: Python - Size: 26.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

sardaralikhamosh/Burushaski_Words_Network

A network science and computational linguistics project analyzing lexical connections between Burushaski and global languages using centrality measures and interactive graph visualizations.

Language: Python - Size: 12.7 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

sankar-2002/Gendered_Abuse_Detection_In_Indic-Languages

Language: Jupyter Notebook - Size: 18.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

AnanthaRajuC/AIML_NLP

AIML Natural Language Processing - Speech, Audio

Language: Java - Size: 4.4 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

viktor-shcherb/vive_la_ner

The default way to fine-tune BERT is wrong. Here is why

Language: Jupyter Notebook - Size: 107 KB - Last synced at: 3 days ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

AlokTheDataGuy/internship_projects

Multiple chatbots and NLP-based projects completed during my internship. Each project demonstrates different aspects of AI application development, from text summarization to multilingual chatbots.

Language: Python - Size: 4.53 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

harmonydata/harmony_r

R library for Harmony. R package - open source tool using AI for psychology and mental health. Actively recruiting contributors.

Language: HTML - Size: 1.19 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 2 - Forks: 3

GALA-MDS/Gala-External-Resources

This repository compiles and data sources created for the CHIST ERA 2025 proposal GALA.

Language: Jupyter Notebook - Size: 70.9 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

cisnlp/MEXA

🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment

Language: Python - Size: 26.4 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 10 - Forks: 0

DmitryRyumin/EMNLP-2023-Papers

EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. :star: support NLP!

Language: Python - Size: 6.43 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 107 - Forks: 7

ceferisbarov/TUMLU

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages

Language: Python - Size: 38.3 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 19 - Forks: 1

swaggy66/MSMO

Multi-Scale and Multi-Objective Optimization for Cross-Lingual Aspect-Based Sentiment Analysis

Language: Python - Size: 1.84 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

deokhk/CBP

Official Repository for Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing (EMNLP 2024)

Language: Python - Size: 7.32 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

cambridgeltl/sail-bli

Self-Augmented In-Context Learning for Unsupervised Word Translation (ACL 2024). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Language: Python - Size: 445 KB - Last synced at: 10 days ago - Pushed at: 10 months ago - Stars: 3 - Forks: 1

cambridgeltl/prompt4bli

On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Language: Python - Size: 86.9 KB - Last synced at: 10 days ago - Pushed at: 5 months ago - Stars: 10 - Forks: 2

pintamonas4575/NLP-text-detox-MAADM-UPM

NLP for detoxing language phrases in several languages.

Language: Jupyter Notebook - Size: 8.82 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

joyou159/SWIZT Fork of MohamedAlaaAli/SWIZT

Exploring the use of multilingual transformers, specifically mBERT and XLM-RoBERTa, for named entity recognition (NER) in the context of Switzerland’s multi lingual environment.

Language: Jupyter Notebook - Size: 1.35 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Helsinki-NLP/lm-vs-mt

A Comparison of Language Modeling and Translation as Multilingual Pretraining Objectives

Language: Python - Size: 1.15 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

koushik16/Naive-Bayes-on-Multi-Language-Text

Implementation of Naive Bayes for text classification across multiple languages, focusing on natural language processing and multilingual text analysis.

Language: Python - Size: 2.93 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

Wei-RongRong2/RojakLanguageSentimentAnalysis

This is a machine learning project focused on analysing and classifying sentiments in code-switched and code-mixed text, specifically targeting the unique linguistic characteristics found in Malaysian conversations.

Language: Jupyter Notebook - Size: 20.6 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

BatsResearch/cross-lingual-detox

Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages"

Language: Jupyter Notebook - Size: 309 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 14 - Forks: 0

CristianBudala/Multilingual-Sentiment-Analysis-and-Intent-Classification

Multilingual sentiment analysis and intent classification in Romanian, Bachelors thesis

Language: Jupyter Notebook - Size: 837 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

MaLA-LM/mala-500

MaLA-500: Massive Language Adaptation of Large Language Models

Language: Python - Size: 97.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

Rajarshi1001/IITK-SemEval-2024-Task-1

SemEval task 1: Semantic Textual Relatedness for the course CS779A

Language: Jupyter Notebook - Size: 9.92 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

csebuetnlp/CrossSum

This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.

Language: Python - Size: 5.72 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 47 - Forks: 7