An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: inter-annotator-agreement

pln-fing-udelar/fast-krippendorff

Fast computation of Krippendorff's alpha agreement measure in Python.

Language: Python - Size: 87.9 KB - Last synced at: 5 days ago - Pushed at: 3 months ago - Stars: 139 - Forks: 16

CrowdTruth/CrowdTruth-core

CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems

Language: Jupyter Notebook - Size: 51.3 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 58 - Forks: 11

kldtz/bratiaa

Inter-annotator agreement for Brat annotation projects

Language: Python - Size: 263 KB - Last synced at: 8 days ago - Pushed at: almost 2 years ago - Stars: 22 - Forks: 7

kakumarabhishek/StyleSeg

[MICCAI ISIC 2024] Code for "Segmentation Style Discovery: Application to Skin Lesion Images"

Size: 3.91 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

krisstallenberg/evaluating-annotations

This repository holds code to annotate textual data using LLMs, and calculate different measures of Inter-Annotator Agreement (IAA).

Language: Jupyter Notebook - Size: 938 KB - Last synced at: 5 months ago - Pushed at: 12 months ago - Stars: 2 - Forks: 0

ancatmara/DL-SFL-2018

Digita Literacy for School of Foreign Languages (NRU HSE, 2018)

Size: 8.89 MB - Last synced at: 2 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 2

vribeiro1/skin-lesion-segmentation-agreement 📦

Exploring the inter-annotator agreement between ISIC Archive segmentation masks

Language: Python - Size: 113 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 2

nilsreiter/iaa

command line stuff to calculate inter annotator agreement

Language: Awk - Size: 5.86 KB - Last synced at: 19 days ago - Pushed at: over 8 years ago - Stars: 2 - Forks: 0