An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: qlora

aman-17/MediSOAP

FineTuning LLMs on conversational medical dataset.

Language: Jupyter Notebook - Size: 39.9 MB - Last synced at: about 20 hours ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0

yangjianxin1/Firefly

Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

Language: Python - Size: 6.24 MB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 6,382 - Forks: 576

yangjianxin1/Firefly-LLaMA2-Chinese

Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

Language: Python - Size: 2.02 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 410 - Forks: 32

nikolamilosevic86/verifAI

VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)

Language: Jupyter Notebook - Size: 86.2 MB - Last synced at: about 21 hours ago - Pushed at: 2 months ago - Stars: 70 - Forks: 4

lyogavin/airllm

AirLLM 70B inference with single 4GB GPU

Language: Jupyter Notebook - Size: 3.23 MB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 5,767 - Forks: 456

ddzipp/AutoAudit

AutoAudit—— the LLM for Cyber Security 网络安全大语言模型

Language: HTML - Size: 5.46 MB - Last synced at: about 20 hours ago - Pushed at: 2 months ago - Stars: 332 - Forks: 37

kavya4411/tune

Flutter Piano is a simple and educational music application that allows users to play black and white piano keys that produce realistic sounds upon tapping. It is built with Flutter and designed with a clean, intuitive interface that offers an authentic piano playing experience.

Language: C++ - Size: 2.82 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 1

taishan1994/Llama3.1-Finetuning

对llama3进行全参微调、lora微调以及qlora微调。

Language: Python - Size: 159 KB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 195 - Forks: 16

georgian-io/LLM-Finetuning-Toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

Language: Python - Size: 32.7 MB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 838 - Forks: 99

wangermeng2021/llm-webui

A Gradio web UI for Large Language Models. Supports LoRA/QLoRA finetuning,RAG(Retrieval-augmented generation) and Chat

Language: Python - Size: 2.46 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 6

Vamsi-Dath/QLoRA_for_Software_Bug_Detection

Fine-Tuning for Bug Detection and Bug Fix using Low-Rank Adapters. ⁠Preprocessed buggy–fixed code pairs into structured AST representations, highlighting semantic differences to optimize fine-grained model training. Fine-tuned CodeLlama-7B using QLoRA (4-bit), updating only 0.1% of model weights (q_proj, v_proj)

Language: Jupyter Notebook - Size: 2.98 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

Size: 196 KB - Last synced at: about 20 hours ago - Pushed at: 4 months ago - Stars: 265 - Forks: 81

bitsandbytes-foundation/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Language: Python - Size: 2.78 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 6,987 - Forks: 693

iamarunbrahma/finetuned-qlora-falcon7b-medical

Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset

Language: Jupyter Notebook - Size: 174 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 252 - Forks: 26

unslothai/unsloth

Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥

Language: Python - Size: 6.46 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 38,080 - Forks: 2,982

hiyouga/LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Language: Python - Size: 46.2 MB - Last synced at: 6 days ago - Pushed at: 9 days ago - Stars: 48,256 - Forks: 5,881

prakash-aryan/qwen-arabic-project

This project fine-tunes the Qwen2-1.5B model for Arabic language tasks using Quantized LoRA (QLoRA).

Language: Python - Size: 12.6 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 5 - Forks: 1

RATHOD-SHUBHAM/Finetuning-LLMs

This repository contains experiments on fine-tuning LLMs (Llama, Llama3.1, Gemma). It includes notebooks for model tuning, data preprocessing, and hyperparameter optimization to enhance model performance.

Language: Jupyter Notebook - Size: 5.12 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

NisaarAgharia/Indian-LawyerGPT

Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.

Language: Jupyter Notebook - Size: 3.54 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 79 - Forks: 31

CAI991108/Natural-Language-Processing-Utils

This repository contains three projects exploring cutting-edge NLP techniques—from word embeddings to LLM fine-tuning and medical agent frameworks. Each assignment tackles real-world challenges with code, experiments, and detailed reports

Language: Jupyter Notebook - Size: 52.3 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

AlbertChoo/NLP-Projects

Hmm, projects with, transformers, pre-trained model, finetuning LLM using LoRA, QLoRA, calibration techniques to improve confidence, reduce `eval_loss`, etc.

Language: Jupyter Notebook - Size: 25 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0

jianzhnie/LLamaTuner

Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.

Language: Python - Size: 1.02 MB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 602 - Forks: 65

souradipp76/ReadMeReady

Tool for auto-generating README documentation for code repositories

Language: Python - Size: 20.5 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 6 - Forks: 1

brossign/dadAI

LLM-powered assistant for first-time dads, fine-tuned on real parenting discussions using Mistral 7B

Language: Python - Size: 724 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

hiyouga/ChatGLM-Efficient-Tuning 📦

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

Language: Python - Size: 194 MB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 3,699 - Forks: 475

GURPREETKAURJETHRA/Meta-LLAMA3-GenAI-UseCases-End-To-End-Implementation-Guides

META LLAMA3 GENAI Real World UseCases End To End Implementation Guide

Language: Jupyter Notebook - Size: 163 KB - Last synced at: about 21 hours ago - Pushed at: 8 months ago - Stars: 27 - Forks: 9

taishan1994/qlora-chinese-LLM

使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE

Language: Python - Size: 3.92 MB - Last synced at: about 21 hours ago - Pushed at: almost 2 years ago - Stars: 86 - Forks: 5

ArchitJ6/Llama2-FineTuning

🦙 Llama2-FineTuning: Fine-tune LLAMA 2 with Custom Datasets Using LoRA and QLoRA Techniques

Language: Jupyter Notebook - Size: 2.83 MB - Last synced at: 22 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

bitsandbytes-foundation/bitsandbytes-intel

An extension to enable performance acceleration for bitsandbytes on Intel platforms.

Language: Python - Size: 20.5 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 1 - Forks: 0

sanskaryo/LLM-Finetuning-Projects

This repository contains various projects focused on fine-tuning Large Language Models (LLMs). i am currently working on

Language: Jupyter Notebook - Size: 188 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

computational-cell-analytics/peft-sam

Parameter Efficient Fine-Tuning of Segment Anything Model

Language: Python - Size: 374 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 12 - Forks: 0

maciusyoury15/IFT6135_HW2

Implementing GPT, Decoder, LSTM, Lora, Layer-Batch normalizations, LLMs, FFNN, Attention mechanism, Transformer

Language: Python - Size: 4.41 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

shaheennabi/Production-Ready-Instruction-Finetuning-of-Meta-Llama-3.2-3B-Instruct-Project

🎋🌿🌟 Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations 🌟🌿🎋 Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. 🚀✨ Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning🎇🎉

Language: Jupyter Notebook - Size: 692 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 18 - Forks: 2

X-D-Lab/MindChat

🐋MindChat(漫谈)——心理大模型:漫谈人生路, 笑对风霜途

Language: Python - Size: 84.9 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 663 - Forks: 54

ssbuild/chatglm_finetuning

chatglm 6b finetuning and alpaca finetuning

Language: Python - Size: 7.25 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 1,542 - Forks: 178

ssbuild/qwen_finetuning

qwen models finetuning

Language: Python - Size: 13.7 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 95 - Forks: 9

iusztinpaul/hands-on-llms 📦

🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴

Language: Jupyter Notebook - Size: 25.7 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 3,231 - Forks: 525

rabiloo/llm-finetuning

Sample for Fine-Tuning LLMs & VLMs

Language: Python - Size: 274 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 2

Md-Emon-Hasan/Fine-Tuning

End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment

Language: Jupyter Notebook - Size: 5.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

asifhaider/LLM-Finetuning-Prompting-Project

Python Project Sample for Demonstration

Language: Jupyter Notebook - Size: 60.8 MB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0

Abhimanyu9539/LLM-FineTuning

Finetuning of different LLM models

Language: Jupyter Notebook - Size: 83 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

mrnust/Fine_Tuning_LLM

Language: Jupyter Notebook - Size: 108 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Muavia1/DeepSeek-Math-FineTuned-For-Math-Meme-Correcction

This project fine-tunes the DeepSeek-Math-7B model using LoRA (Low-Rank Adaptation) to correct mathematical memes and equations efficiently. By leveraging 4-bit quantization and PEFT (Parameter-Efficient Fine-Tuning), the model improves mathematical reasoning while maintaining a lightweight footprint.

Language: Jupyter Notebook - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

AbsarRaashid3/SassySolver

SassySolver 🤖📚 - An AI-powered tool that humorously corrects wrong math memes! Built with a fine-tuned Qwen1.5-4B-Chat model using LoRA, deployed via Streamlit. It identifies common math misconceptions and provides accurate, sassy explanations. Make math memes smarter, one joke at a time!

Language: Jupyter Notebook - Size: 77.1 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Followb1ind1y/Medical-LLM-Fine-tuning

Fine-tunes LLaMA-3-8B on PubMedQA with QLoRA, optimized via DeepSpeed and vLLM for efficient, low-latency medical QA. Deployable via Docker for scalable clinical inference.

Language: Jupyter Notebook - Size: 3.38 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

0xZee/DeepSeek-R1-FineTuning

Fine-Tuning of DeepSeek-Style Reasoning Models | RL + Quantization Implementation

Language: Jupyter Notebook - Size: 43.9 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 11 - Forks: 3

yuki-2025/llama3-8b-fine-tuning-math

Fine-tuning Llama3 8b to generate JSON formats for arithmetic questions and process the output to perform calculations.

Language: Python - Size: 19.5 KB - Last synced at: about 20 hours ago - Pushed at: 12 months ago - Stars: 4 - Forks: 1

sergio11/llm_finetuning_and_evaluation

The LLM FineTuning and Evaluation project 🚀 enhances FLAN-T5 models for tasks like summarizing Spanish news articles 🇪🇸📰. It features detailed notebooks 📚 on fine-tuning and evaluating models to optimize performance for specific applications. 🔍✨

Language: Jupyter Notebook - Size: 499 KB - Last synced at: 23 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 1

yangjianxin1/LongQLoRA

LongQLoRA: Extent Context Length of LLMs Efficiently

Language: Python - Size: 1.92 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 164 - Forks: 15

urbanclimatefr/esg-llm-text-classification

This research investigates the classification of Environmental, Social, and Governance (ESG) information within textual disclosures. The aim is to develop and evaluate binary classification models capable of accurately identifying and categorizing E, S and G-related content respectively.

Language: Jupyter Notebook - Size: 11.9 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

naidezhujimo/LoRA-DoRA-QLoRA-PyTorch-Efficient-Fine-Tuning-with-Low-Rank-Adaptation

This repository contains a PyTorch implementation of a Convolutional Neural Network (CNN) for classifying the MNIST dataset. The project explores different fine-tuning techniques, including LoRA (Low-Rank Adaptation), DoRA (Dynamic Low-Rank Adaptation), and QLoRA (Quantized Low-Rank Adaptation), to improve model performance and efficiency.

Language: Python - Size: 236 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

ssbuild/llm_finetuning

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

Language: Python - Size: 325 KB - Last synced at: about 19 hours ago - Pushed at: about 1 year ago - Stars: 97 - Forks: 12

NotShrirang/DeepSeek-R1-Distill-Qwen-1.5B-SQL-Coder-PEFT

DeepSeek R1 Distill Qwen 1.5B finetuned for converting natural language queries to SQL queries

Language: Jupyter Notebook - Size: 31.3 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

kapshaul/LLM-finetune-vuln-detection

Fine-tuning a Large Language Model (LLM) for code vulnerability detection using QLoRA, a method that quantizes the model to 4-bit floats and incorporates adapters for fine-tuning.

Language: Python - Size: 11.4 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 7 - Forks: 1

arham-kk/llama2-qlora-sft

This model is a fine-tuned model based on the "TinyPixel/Llama-2-7B-bf16-sharded" model and "timdettmers/openassistant-guanaco" dataset

Size: 640 KB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

InquestGeronimo/tllm

An LLM training library for instruction-tuning.

Language: Python - Size: 785 KB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 25 - Forks: 3

YanSte/NLP-LLM-Fine-tuning-Llame-2-QLoRA-2024

Natural Language Processing (NLP) and Large Language Models (LLM) with Fine-Tuning LLM QLoRA and Llama 2 in 2024

Language: Jupyter Notebook - Size: 153 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 4

kyegomez/Finetuning-Suite

Finetune any model on HF in less than 30 seconds

Language: Jupyter Notebook - Size: 95.4 MB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 58 - Forks: 7

Abhi0323/Fine-Tuning-LLaMA-2-with-QLORA-and-PEFT

This project enhances the LLaMA-2 model using Quantized Low-Rank Adaptation (QLoRA) and other parameter-efficient fine-tuning techniques to optimize its performance for specific NLP tasks. The improved model is demonstrated through a Streamlit application, showcasing its capabilities in real-time interactive settings.

Language: Jupyter Notebook - Size: 160 KB - Last synced at: about 21 hours ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 5

Gustav-Proxi/AI-DxMH-Artificial-Intelligence-Diagnosis-for-Modern-Health

AI-DxMH is an AI-powered health assistant that provides accessible medical diagnoses for people in remote areas of India. It uses a large language model (LLM), natural language processing, and machine learning to ask users questions about their symptoms and provide likely diagnoses and health advice.

Language: Jupyter Notebook - Size: 11.4 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

avnlp/llm-finetuning

Language: Python - Size: 817 KB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

soniawmeyer/WanderChat

A Comparison of LLM Chat Bot Implementation Methods with Travel Use Case

Language: Jupyter Notebook - Size: 8.66 MB - Last synced at: about 21 hours ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1

michaelnny/QLoRA-LLM 📦

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

Language: Python - Size: 26 MB - Last synced at: about 20 hours ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 1

alessioborgi/NSIO_NeuralSearchIndexingOptimization

Optimizing the Differentiable Search Index (DSI) with data augmentation (Num2Word, Stopwords Removal, POS-MLM) and parameter-efficient fine-tuning (LoRA, QLoRA, AdaLoRA, ConvoLoRA), improving retrieval accuracy and efficiency while reducing memory and computational overhead. Evaluated on the MS MARCO dataset for scalable performance.

Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 1

AnanthaPadmanaban-KrishnaKumar/EffiLLaMA

Finetuning LLaMA 3.2-1B-Instruct model using qLoRA and LoRA quantization PEFT methods

Language: Python - Size: 44.6 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

SathvikNayak123/Agentic-RAG

Agentic RAG with Llama-3.1-8b model Fine-tuned on medical conversational dataset

Language: Jupyter Notebook - Size: 215 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

reshalfahsi/medbot-instruct-conversational

MedBot: Medical Chatbot with Instruction Fine-Tuning and Conversational Memory

Language: Jupyter Notebook - Size: 126 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

akshay-kamath/Practical-LLM-Fine-Tuning

This repository contains hands on tutorials on fine tuning LLMs

Size: 17.9 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

gmongaras/Llama-2_Huggingface_4Bit_QLoRA

A working example of a 4bit QLoRA Falcon model using huggingface

Language: Python - Size: 11.7 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 2

kuutsav/llm-toys

Small finetuned LLMs for a diverse set of useful tasks

Language: Python - Size: 72.6 MB - Last synced at: 30 days ago - Pushed at: almost 2 years ago - Stars: 126 - Forks: 6

ssbuild/t5_finetuning

clue chatyuan finetuning

Language: Python - Size: 130 KB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 17 - Forks: 4

RajVenkat20/LLM-Optimizations-QLoRA-AWQ

This project takes the Flan-T5 LLM and applies QLoRA and AWQ quantization techniques

Language: Python - Size: 488 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

gauss5930/AlpaGasus2-QLoRA

This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!

Language: Python - Size: 3 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 3

paraglondhe098/sentiment-classification-llm

Implemented and fine-tuned BERT for a custom sequence classification task, leveraging LoRA adapters for efficient parameter updates and 4-bit quantization to optimize performance and resource utilization.

Language: Jupyter Notebook - Size: 6.66 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

faezeh-gholamrezaie/Fine-Tuning-Large-Language-Models-for-Sleep-Stage-Classification

Fine-tuning Large Language Models (LLMs) using QLoRA on EEG data for efficient sleep stage classification and pattern recognition.

Language: Jupyter Notebook - Size: 31.8 MB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

dasdristanta13/LLM-Lora-PEFT_accumulate

LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models (LLMs) using PEFT, LORA, and QLORA. Contribute experiments and implementations to enhance LLM efficiency. Join discussions and push the boundaries of LLM optimization. Let's make LLMs more efficient together!

Language: Jupyter Notebook - Size: 138 KB - Last synced at: about 20 hours ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 1

ErFer7/Computer-Vision

Este repositório contém o código do trabalho desenvolvido para a disciplina de Visão Computacional (INE410121) da UFSC.

Language: Jupyter Notebook - Size: 4.7 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

sarahboal/Machine-Translation-NLP-EN-FR-CS685-Umass

Machine Translation Model Comparisons for English to French using mT5 and Llama 2

Language: Jupyter Notebook - Size: 7.29 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

AbineshSivakumar/Llama-2-7B-QLoRA-Vicuna

This repository contains code to fine-tune a Llama-7B-Uncensored model using the Vicuna 70k dataset using Quantised Low Rank Adapations (LoRA).

Language: Python - Size: 2.55 MB - Last synced at: about 20 hours ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 4

ssbuild/chatglm_rlhf

chatglm_rlhf_finetuning

Language: Python - Size: 149 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 1

Gyanbardhan/Disha_Chatbot_IIITN

Chatbot for IIIT Nagpur using Fine Tuning and RAG

Language: Jupyter Notebook - Size: 5.06 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

MohamedAlaouiMhamdi/Finetuning_LLM

This project demonstrates the fine-tuning of the Mistral-7B language model using QLoRA (Quantized Low-Rank Adaptation) to optimize the model for dialogue summarization and customer support tasks.

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

louisc-s/QLoRA-Fine-tuning-for-Film-Character-Styled-Responses-from-LLM

Code for fine-tuning Llama2 LLM with custom text dataset to produce film character styled responses

Language: Python - Size: 63.1 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 1

0xZee/finetune_model_dataset

Fine-Tunning Model llama3.2 on local Dataset using LoRA, QLoRA and PEFT..

Size: 5.86 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

monk1337/NanoPeft

The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]

Language: Jupyter Notebook - Size: 68.4 KB - Last synced at: about 21 hours ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 2

AINNOV/secure-your-contract

Secure Your Contract: Towards Efficient and Reliable AI-Assisted Contract Drafting

Language: Python - Size: 890 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

sidharth72/Scriptr---Gemma-2-Fine-tuning

A fine-tuned Version of Gemma 2 Model for Youtube Script Generation

Language: Jupyter Notebook - Size: 7.16 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

ssbuild/rwkv_finetuning

rwkv finetuning

Language: Python - Size: 1.32 MB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 36 - Forks: 1

Gaurav-Van/Fine-Tuning-LLMs

Introductory Guide where we will talk about Different Techniques of Fine Tuning LLMs

Language: Jupyter Notebook - Size: 2.95 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 2 - Forks: 2

HEMANGANI/LLM-Recommendation-Systems

This project fine-tunes large language models (LLMs) for text-based recommendations, using a novel prompt mechanism to improve accuracy and user satisfaction. It demonstrates efficient model adaptation with diverse datasets, leveraging advanced libraries and techniques for optimal performance.

Language: Jupyter Notebook - Size: 2.67 MB - Last synced at: about 20 hours ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

justsomerandomdude264/Homework_Solver_LLM

A fine-tuned LLM to solve homework questions ranging from maths to science and social science.

Size: 2.19 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

ssbuild/internlm_finetuning

internlm funetuning

Language: Python - Size: 305 KB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 5 - Forks: 1

EliasK93/instruction-fine-tuned-gemma-2-for-stance-detection

Example application for applying QLoRA-based Parameter-Efficient Fine-Tuning (PEFT) to a Stance Detection task using Gemma-2-9B-Instruct

Language: Python - Size: 1.98 MB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

EliasK93/qlora-based-efficient-fine-tuning-for-sentence-pair-classification

Example application for applying QLoRA-based Parameter-Efficient Fine-Tuning (PEFT) to a sentence pair classification task using Mistral-7B and Llama3-8B

Language: Python - Size: 480 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

MuhammadBinUsman03/Real-Time-3-pipeline-LLM-Financial-Advisor

3-Pipeline LLMOps Financial advisor. Steaming pipeline deployed on AWS, 24/7 collects, embeds live-data into QdrantDB. Training pipeline finetunes model on serverless GPU and logs best model on WandB Registry.Inference pipeline downloads best model from registry for inference, utilizes Langchain to maintain history and context retrieval.

Language: Python - Size: 440 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

timkoehne/Llama3-Finetuning-for-ABAP

Llama3 Fine-Tuning for ABAP using Unsloth 4-Bit QLoRA

Language: Jupyter Notebook - Size: 78.4 MB - Last synced at: 28 days ago - Pushed at: 9 months ago - Stars: 0 - Forks: 1

KwokHing/AI-Planet-LLM-Bootcamp-Challenge

An LLM challenge to (i) fine-tune pre-trained HuggingFace transformer model to build a Code Generation language model, and (ii) build a retrieval-augmented generation (RAG) application using LangChain

Language: Jupyter Notebook - Size: 874 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

Spectrewolf8/kaggle-sql-xp-phi-3-mini-4k-instruct

A fine-tuned version of Phi-3-mini-4k-instruct for generating SQL queries from natural language prompts, utilizing synthetic datasets and QLoRA for efficient adaptation and deployment.

Language: Jupyter Notebook - Size: 178 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

jordandeklerk/OpenCodeInterpreter-Finetune-SQL

Fine-tuning coding LLM OpenCodeInterpreter-DS-6.7B for Text-to-SQL Code Generation on a Single A100 GPU in PyTorch

Language: Jupyter Notebook - Size: 1.01 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

faizan1234567/NewsQA

News QA generation and fine tuning an LLM for QA generation (under development)

Language: Jupyter Notebook - Size: 707 KB - Last synced at: 8 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0