huggingface-datasets | Topic | Ecosyste.ms: Repos

Topic: "huggingface-datasets"

grok-ai/nn-template

Generic template to bootstrap your PyTorch project.

Language: Python - Size: 2.68 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 641 - Forks: 67

xlang-ai/UnifiedSKG

[EMNLP 2022] Unifying and multi-tasking structured knowledge grounding with language models

Language: Python - Size: 21 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 557 - Forks: 60

StacklokLabs/promptwright

Generate large synthetic data using an LLM

Language: Python - Size: 13.5 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 427 - Forks: 32

Comprehensive Vector Data Tooling. The universal interface for all vector database, datasets and RAG platforms. Easily export, import, backup, re-embed (using any model) or access your vector data from any vector databases or repository.

Language: Jupyter Notebook - Size: 4.39 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 246 - Forks: 29

autogluon/fev

Forecast evaluation library

Language: Python - Size: 209 KB - Last synced at: 7 days ago - Pushed at: 16 days ago - Stars: 83 - Forks: 9

BirkhoffG/jax-dataloader

Pytorch-like dataloaders for JAX.

Language: Jupyter Notebook - Size: 1.01 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 81 - Forks: 3

BUAADreamer/Chinese-LLaVA-Med

中文医学多模态大模型 Large Chinese Language-and-Vision Assistant for BioMedicine

Language: Python - Size: 2.26 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 76 - Forks: 4

defeat-beta/defeatbeta-api

An open-source alternative to Yahoo Finance's market data APIs with higher reliability.

Language: Python - Size: 2.95 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 62 - Forks: 4

git-lfs-fuse/git-lfs-fuse

Mount remote repositories, models and datasets managed by Git LFS locally.

Language: Go - Size: 253 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 50 - Forks: 3

onesuper/HuggingFace-Datasets-Text-Quality-Analysis

Retrieves parquet files from Hugging Face, identifies and quantifies junky data, duplication, contamination, and biased content in dataset using pandas

Language: Python - Size: 415 KB - Last synced at: 7 months ago - Pushed at: almost 2 years ago - Stars: 50 - Forks: 3

TirendazAcademy/Hugging-Face-Tutorials

Getting started with Hugging Face

Language: Jupyter Notebook - Size: 12.3 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 37 - Forks: 10

raidionics/AeroPath

:hugs: AeroPath: An airway segmentation benchmark dataset with challenging pathology

Language: Jupyter Notebook - Size: 320 KB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 37 - Forks: 6

BUAADreamer/MLLM-Finetuning-Demo

使用LLaMA-Factory微调多模态大语言模型的示例代码 Demo of Finetuning Multimodal LLM with LLaMA-Factory

Language: Python - Size: 61.5 KB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 32 - Forks: 2

daspartho/predict-subreddit

NLP model that predicts subreddit based on the title of a post

Language: Jupyter Notebook - Size: 816 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 6

SapienzaNLP/ita-bench

A collection of Italian benchmarks for LLM evaluation

Language: Python - Size: 731 KB - Last synced at: 22 days ago - Pushed at: about 1 month ago - Stars: 30 - Forks: 1

xieincz/huggingface-go

huggingface-go : 加速下载 huggingface 的模型和数据集

Language: Go - Size: 27.3 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 30 - Forks: 5

vTuanpham/Large_dataset_translator

Translate large dataset to any language with google translation api and multithread processing, no key required !

Language: Python - Size: 84.6 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 30 - Forks: 11

mrcabbage972/simple-toolformer

A Python implementation of Toolformer using Huggingface Transformers

Language: Python - Size: 72.3 KB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 15 - Forks: 2

DSYZayn/gopeed-extension-huggingface

A gopeed-extension for downloading models and datasets from huggingface, hf-mirror and modelscope. Huggingface download

Language: JavaScript - Size: 1.57 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 13 - Forks: 1

abhi9ab/DeepSeek-R1-Distill-Llama-8B-finance-v1

Finetuned Deepseek 8b model for finance reasoning

Language: Jupyter Notebook - Size: 29.3 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 13 - Forks: 1

shunk031/huggingface-datasets_JGLUE

JGLUE: Japanese General Language Understanding Evaluation for huggingface datasets

Language: Python - Size: 464 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 12 - Forks: 3

SmithaUpadhyaya/fashion_image_caption

Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.

Language: Jupyter Notebook - Size: 26.6 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 1

vincentkoc/tiny_qa_benchmark_pp

Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.

Language: Python - Size: 306 KB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 0

npuichigo/tarzan

High-level API for tar-based dataset

Language: Python - Size: 27.3 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1

acrion/ditana-assistant

Ditana Assistant: AI-powered CLI/GUI tool for intelligent assistance, leveraging LLMs with OS interaction capabilities and context augmentation, optionally via Wolfram|Alpha

Language: Python - Size: 834 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 10 - Forks: 0

antoinejeannot/jurisprudence

French Jurisprudences at your fingertips @ every 72h

Language: Python - Size: 146 KB - Last synced at: 21 days ago - Pushed at: 2 months ago - Stars: 9 - Forks: 2

balnarendrasapa/road-detection

This is a course project for DSCI-6011 - Deep Learning. deals with Drivable Area and lane segmentation for self driving cars

Language: Jupyter Notebook - Size: 181 MB - Last synced at: 20 days ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 1

daspartho/bored-ape-diffusion

diffusion model for unconditional image generation of Bored Apes

Language: Jupyter Notebook - Size: 892 KB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 0

huggingface/pyspark_huggingface

PySpark custom data source for Hugging Face Datasets

Language: Python - Size: 201 KB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 6 - Forks: 5

hearmeneigh/e621-rising-configs

Configuration files for building E621-Rising v3 SDXL model and dataset

Language: Shell - Size: 130 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

pr0mila/ParquetToHuggingFace

ParquetToHuggingFace processes raw audio data, converts it into Parquet files, and uploads them to Hugging Face. The README explains how to set up the environment, configure paths, and run the scripts to generate and upload the data.

Language: Python - Size: 2.84 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 0

shunk031/cookiecutter-huggingface-datasets

cookiecutter for huggingface datasets

Language: Python - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 5 - Forks: 0

neverbiasu/hf-mirror-hub

一个从 Hugging Face 镜像站点快速下载模型和数据集的命令行工具。

Language: Python - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 0

shunk031/huggingface-datasets_MSCOCO

Microsoft COCO: Common Objects in Context for huggingface datasets

Language: Python - Size: 176 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

ItzCrazyKns/Dataset-Converter

A Python script for converting URL-based datasets into image datasets.

Language: Python - Size: 1000 Bytes - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

shunk031/huggingface-datasets_COCOA

COCOA: Semantic Amodal Segmentation for huggingface datasets

Language: Python - Size: 75.2 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0

shunk031/huggingface-datasets_wrime

WRIME for huggingface datasets

Language: Python - Size: 51.8 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

abhi9ab/DeepSeek-R1-Distill-Qwen-1.5B-finance-v1

Finetuned Deepseek 1.5b model for finance reasoning

Language: Jupyter Notebook - Size: 33.2 KB - Last synced at: 14 days ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

Jpzinn654/qa-portuguese-v1

This is a split 500 thousands rows of a dataset from hugging face in portuguese to train NLP's for Question-and-Answering

Language: Python - Size: 4.88 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

louisbrulenaudet/legalkit-pipeline

Publication pipeline for French legal codes on 🤗 Datasets from LegiFrance with concurrent upload and dynamic REAMDE.md.

Language: Python - Size: 51.8 KB - Last synced at: 3 months ago - Pushed at: 8 months ago - Stars: 3 - Forks: 1

adamelkholyy/whisper-yt

Toolkit for using Whisper to transcribe YouTube videos. Includes Whisper transcription of YouTube videos, conversion of YouTube video into HuggingFace dataset (using audio and subtitles) and evaluation of Whisper transcription against YouTube subtitles

Language: Python - Size: 79.1 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 3 - Forks: 0

sileod/metaeval

Collection of tasks for meta-learning and extreme multitask learning

Language: Python - Size: 33.2 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

e-hossam96/arabic-nano-gpt

Arabic Nano GPT Trained on Arabic Wikipedia Dataset from Wikimedia

Language: Jupyter Notebook - Size: 1.65 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

mahikshith/Transformer-Text-Summarizer-Fine-tuning-with-ETL-pipeline-and-Deployment

Fine tuning pre-trained transformer model for custom text summarization with ETL pipeline and end to end deployment

Language: Jupyter Notebook - Size: 116 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 2 - Forks: 0

creative-graphic-design/huggingface-datasets_Rico

Rico: A Mobile App Dataset for Building Data-Driven Design Applications for huggingface datasets

Language: Python - Size: 88.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

michelecafagna26/HL-dataset

[INLG2023] The High-Level (HL) dataset is a Vision and Language (V&L) resource aligning object-centric descriptions from COCO with high-level descriptions crowdsourced along 3 axes: scene, action, rationale.

Size: 5.67 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

creative-graphic-design/huggingface-datasets_Magazine

Magazine dataset from Content-aware Generative Modeling of Graphic Design Layouts for huggingface datasets

Language: Python - Size: 46.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

shunk031/huggingface-datasets_livedoor-news-corpus

Japanese Livedoor news corpus for huggingface datasets

Language: Python - Size: 82 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

wsobanski/scraper-tvp

Scraping large amount of articles for transformer training.

Language: Python - Size: 57.6 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

creative-graphic-design/huggingface-datasets_CAMERA

CAMERA (CyberAgent Multimodal Evaluation for Ad Text GeneRAtion) for huggingface datasets

Language: Python - Size: 50.8 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

davanstrien/hugit-cli

push ImageFolder style image datasets to the 🤗 Hub from the command line

Language: Python - Size: 946 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

alcazar90/rock-glacier-detection

Proyecto curso MDS7201-1, en conjunto con el Centro de Modelamiento Matemático (CMM)

Language: Jupyter Notebook - Size: 462 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

shunk031/huggingface-datasets_jsnli

JSNLI (Japanese SNLI) dataset for huggingface datasets

Language: Python - Size: 58.6 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Md-Emon-Hasan/Fine-Tuning

End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment

Language: Jupyter Notebook - Size: 5.53 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 1 - Forks: 0

vishvaRam/Fine-Tune-Qwen2.5

This repository provides resources and instructions for fine-tuning the Qwen2.5-0.5B model. It includes scripts, tips, and best practices to adapt the model for specific tasks or domains. Designed for researchers and developers, it simplifies the fine-tuning process to achieve optimal performance and accuracy.

Language: Python - Size: 44.9 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 1 - Forks: 0

Arya920/Natural_Language_To_SQL_Queries

The task of this project is to Convert Natural Language to SQL Queries

Language: Jupyter Notebook - Size: 9.33 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

Dhanush-R-git/MH-Analysis

The MHRoberta is Mental Health Roberta model. The pretrained Roberta transformer based model fine-tunned on Mental Health dataset by adopting PEFT method.

Language: Jupyter Notebook - Size: 3.67 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

yliuhz/hf-download

Language: Python - Size: 119 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

creative-graphic-design/huggingface-datasets_PKU-PosterLayout

PKU-PosterLayout for huggingface datasets

Language: Python - Size: 300 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

ShawonAshraf/bangla-math-chat

A math dataset for fine-tuning LLMs to chat on math problems in Bangla

Language: Python - Size: 50.8 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

canstralian/Transformers-Fine-Tuner

Language: Python - Size: 61.5 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

developer0hye/hugging-face-image-ocr-dataset-upload-example

One of the Hugging Face Image Dataset Upload Guides

Language: Python - Size: 635 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

dhanushpittala11/SummarizerText_Hf_End2End_1

This is a Text Summarization web application using Huggingface models finetuned on a custom dataset. This project focuses on building an end-to-end pipeline for data ingestion, data transformation, model training ,model evaluation, prediction and API integration, hosting it on the web.

Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

EkBass/fin-eng-translations-set

Massive translation set between Finnish and English languages.

Size: 4.19 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

creative-graphic-design/huggingface-datasets_CGL-Dataset-v2

CGL-Dataset v2 for huggingface datasets

Language: Python - Size: 105 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

creative-graphic-design/huggingface-datasets_PubLayNet

PubLayNet for huggingface datasets

Language: Python - Size: 113 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

eljandoubi/Copilot

Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.

Language: Jupyter Notebook - Size: 241 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

eljandoubi/huggingface_image_classifier

Fine-tune the Vision Transformer (ViT) using LoRA and Optuna for hyperparameter search.

Language: Python - Size: 47.9 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

morikaglobal/finetune_bert_model

Fine-tuning pretrained BERT model for sentiment analysis (text classification)

Language: Jupyter Notebook - Size: 47.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

semaj87/summarise-dialogue-flan-t5

Performing the task of dialogue summarisation using Generative AI, whilst comparing the effects of zero shot, one shot and few shot prompt engineering. These steps are used to enhance the completion of Large Language Models (LLMs))

Language: Jupyter Notebook - Size: 278 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

creative-graphic-design/huggingface-datasets_PosterErase

PosterErase for huggingface datasets

Language: Python - Size: 47.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

cx0/neurips-llm-efficiency

My submission for NeurIPS 2023 LLM Efficiency Challenge.

Size: 17.6 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

shunk031/huggingface-datasets_DrawBench

DrawBench for huggingface datasets

Language: Python - Size: 43 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

sankalpie/PiNacle-Coder-v2

The PiNacle Coder site with updated API

Language: Jupyter Notebook - Size: 495 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

ksgr5566/AutoTuneNLP

A comprehensive toolkit for seamless data generation and fine-tuning of NLP models, all conveniently packed into a single block.

Language: Python - Size: 231 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

anujsahani01/English-Marathi-Translation

Fine-tuned and compared 3 🤗 pre-trained Multilingual LLMs

Language: Jupyter Notebook - Size: 333 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

Netruk44/repo-search

Search for code by what it does in natural language, using machine learning embeddings.

Language: Python - Size: 82 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 1

NusretOzates/hf-datasets-server-py

Python SDK to use HuggingFace's datasets server API

Language: Python - Size: 28.3 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

shunk031/tango-jglue-benchmarks

Reproducible implementation using ai2-tango for JGLUE, Japanese benchmark

Language: Jsonnet - Size: 149 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

alcazar90/cell-segmentation

A fine-tuning script for training an image segmentation model (SegFormer) on a cell dataset. The workflow involves creating a hugging face dataset repository and tracking your experiments with W&B.

Language: Python - Size: 751 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Living-with-machines/ai4lam-huggingface-datasets-demo

datasets demo for ai4lam

Language: Jupyter Notebook - Size: 423 KB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

daspartho/depression-detector

text classifier to detect depression

Language: Jupyter Notebook - Size: 5.86 KB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

Hugging-Face-Supporter/datacards

Find Hugging face datasets that are missing tags. Then Help to fill then in; one-by-one

Language: Python - Size: 104 KB - Last synced at: about 8 hours ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 1

paulohl/hugging_face_diffusers_manuscript

Hugging Face Diffusers Library book repo *Packt Publishing

Language: TeX - Size: 27.6 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

aspirant2018/conllu-pos-dataset

git remote add origin https://github.com/aspirant2018/conllu-pos-dataset.git

Language: Python - Size: 1.95 KB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

shunk031/huggingface-datasets_cocoapi-tools

A helper library for easily converting MSCOCO format data using the loading script of huggingface datasets.

Language: Python - Size: 104 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

AadityaArunSingh/RoBERTa-Token-Classification-with-Additional-PLODv2-Data

This repo explores token classification for abbreviation and long-form detection using RoBERTa. We evaluate the impact of adding 50% of the PLODv2-filtered dataset, achieving improved F1 and recall. The repo includes methodology, evaluation using seqeval, and confusion matrix analysis.

Language: Python - Size: 11.7 KB - Last synced at: 26 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0