GitHub topics: qlora
aman-17/MediSOAP
FineTuning LLMs on conversational medical dataset.
Language: Jupyter Notebook - Size: 39.9 MB - Last synced at: about 20 hours ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0

yangjianxin1/Firefly
Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
Language: Python - Size: 6.24 MB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 6,382 - Forks: 576

yangjianxin1/Firefly-LLaMA2-Chinese
Firefly中文LLaMA-2大模型,支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型
Language: Python - Size: 2.02 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 410 - Forks: 32

nikolamilosevic86/verifAI
VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
Language: Jupyter Notebook - Size: 86.2 MB - Last synced at: about 21 hours ago - Pushed at: 2 months ago - Stars: 70 - Forks: 4

lyogavin/airllm
AirLLM 70B inference with single 4GB GPU
Language: Jupyter Notebook - Size: 3.23 MB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 5,767 - Forks: 456

ddzipp/AutoAudit
AutoAudit—— the LLM for Cyber Security 网络安全大语言模型
Language: HTML - Size: 5.46 MB - Last synced at: about 20 hours ago - Pushed at: 2 months ago - Stars: 332 - Forks: 37

kavya4411/tune
Flutter Piano is a simple and educational music application that allows users to play black and white piano keys that produce realistic sounds upon tapping. It is built with Flutter and designed with a clean, intuitive interface that offers an authentic piano playing experience.
Language: C++ - Size: 2.82 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 1

taishan1994/Llama3.1-Finetuning
对llama3进行全参微调、lora微调以及qlora微调。
Language: Python - Size: 159 KB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 195 - Forks: 16

georgian-io/LLM-Finetuning-Toolkit
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
Language: Python - Size: 32.7 MB - Last synced at: about 20 hours ago - Pushed at: 7 months ago - Stars: 838 - Forks: 99

wangermeng2021/llm-webui
A Gradio web UI for Large Language Models. Supports LoRA/QLoRA finetuning,RAG(Retrieval-augmented generation) and Chat
Language: Python - Size: 2.46 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 6

Vamsi-Dath/QLoRA_for_Software_Bug_Detection
Fine-Tuning for Bug Detection and Bug Fix using Low-Rank Adapters. Preprocessed buggy–fixed code pairs into structured AST representations, highlighting semantic differences to optimize fine-grained model training. Fine-tuned CodeLlama-7B using QLoRA (4-bit), updating only 0.1% of model weights (q_proj, v_proj)
Language: Jupyter Notebook - Size: 2.98 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
Size: 196 KB - Last synced at: about 20 hours ago - Pushed at: 4 months ago - Stars: 265 - Forks: 81

bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
Language: Python - Size: 2.78 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 6,987 - Forks: 693

iamarunbrahma/finetuned-qlora-falcon7b-medical
Finetuning of Falcon-7B LLM using QLoRA on Mental Health Conversational Dataset
Language: Jupyter Notebook - Size: 174 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 252 - Forks: 26

unslothai/unsloth
Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
Language: Python - Size: 6.46 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 38,080 - Forks: 2,982

hiyouga/LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Language: Python - Size: 46.2 MB - Last synced at: 6 days ago - Pushed at: 9 days ago - Stars: 48,256 - Forks: 5,881

prakash-aryan/qwen-arabic-project
This project fine-tunes the Qwen2-1.5B model for Arabic language tasks using Quantized LoRA (QLoRA).
Language: Python - Size: 12.6 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 5 - Forks: 1

RATHOD-SHUBHAM/Finetuning-LLMs
This repository contains experiments on fine-tuning LLMs (Llama, Llama3.1, Gemma). It includes notebooks for model tuning, data preprocessing, and hyperparameter optimization to enhance model performance.
Language: Jupyter Notebook - Size: 5.12 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

NisaarAgharia/Indian-LawyerGPT
Fine-Tuning Falcon-7B, LLAMA 2 with QLoRA to create an advanced AI model with a profound understanding of the Indian legal context.
Language: Jupyter Notebook - Size: 3.54 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 79 - Forks: 31

CAI991108/Natural-Language-Processing-Utils
This repository contains three projects exploring cutting-edge NLP techniques—from word embeddings to LLM fine-tuning and medical agent frameworks. Each assignment tackles real-world challenges with code, experiments, and detailed reports
Language: Jupyter Notebook - Size: 52.3 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

AlbertChoo/NLP-Projects
Hmm, projects with, transformers, pre-trained model, finetuning LLM using LoRA, QLoRA, calibration techniques to improve confidence, reduce `eval_loss`, etc.
Language: Jupyter Notebook - Size: 25 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0

jianzhnie/LLamaTuner
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
Language: Python - Size: 1.02 MB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 602 - Forks: 65

souradipp76/ReadMeReady
Tool for auto-generating README documentation for code repositories
Language: Python - Size: 20.5 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 6 - Forks: 1

brossign/dadAI
LLM-powered assistant for first-time dads, fine-tuned on real parenting discussions using Mistral 7B
Language: Python - Size: 724 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

hiyouga/ChatGLM-Efficient-Tuning 📦
Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
Language: Python - Size: 194 MB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 3,699 - Forks: 475

GURPREETKAURJETHRA/Meta-LLAMA3-GenAI-UseCases-End-To-End-Implementation-Guides
META LLAMA3 GENAI Real World UseCases End To End Implementation Guide
Language: Jupyter Notebook - Size: 163 KB - Last synced at: about 21 hours ago - Pushed at: 8 months ago - Stars: 27 - Forks: 9

taishan1994/qlora-chinese-LLM
使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE
Language: Python - Size: 3.92 MB - Last synced at: about 21 hours ago - Pushed at: almost 2 years ago - Stars: 86 - Forks: 5

ArchitJ6/Llama2-FineTuning
🦙 Llama2-FineTuning: Fine-tune LLAMA 2 with Custom Datasets Using LoRA and QLoRA Techniques
Language: Jupyter Notebook - Size: 2.83 MB - Last synced at: 22 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

bitsandbytes-foundation/bitsandbytes-intel
An extension to enable performance acceleration for bitsandbytes on Intel platforms.
Language: Python - Size: 20.5 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 1 - Forks: 0

sanskaryo/LLM-Finetuning-Projects
This repository contains various projects focused on fine-tuning Large Language Models (LLMs). i am currently working on
Language: Jupyter Notebook - Size: 188 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

computational-cell-analytics/peft-sam
Parameter Efficient Fine-Tuning of Segment Anything Model
Language: Python - Size: 374 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 12 - Forks: 0

maciusyoury15/IFT6135_HW2
Implementing GPT, Decoder, LSTM, Lora, Layer-Batch normalizations, LLMs, FFNN, Attention mechanism, Transformer
Language: Python - Size: 4.41 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

shaheennabi/Production-Ready-Instruction-Finetuning-of-Meta-Llama-3.2-3B-Instruct-Project
🎋🌿🌟 Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations 🌟🌿🎋 Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. 🚀✨ Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning🎇🎉
Language: Jupyter Notebook - Size: 692 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 18 - Forks: 2

X-D-Lab/MindChat
🐋MindChat(漫谈)——心理大模型:漫谈人生路, 笑对风霜途
Language: Python - Size: 84.9 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 663 - Forks: 54

ssbuild/chatglm_finetuning
chatglm 6b finetuning and alpaca finetuning
Language: Python - Size: 7.25 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 1,542 - Forks: 178

ssbuild/qwen_finetuning
qwen models finetuning
Language: Python - Size: 13.7 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 95 - Forks: 9

iusztinpaul/hands-on-llms 📦
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Language: Jupyter Notebook - Size: 25.7 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 3,231 - Forks: 525

rabiloo/llm-finetuning
Sample for Fine-Tuning LLMs & VLMs
Language: Python - Size: 274 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 2

Md-Emon-Hasan/Fine-Tuning
End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment
Language: Jupyter Notebook - Size: 5.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

asifhaider/LLM-Finetuning-Prompting-Project
Python Project Sample for Demonstration
Language: Jupyter Notebook - Size: 60.8 MB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 3 - Forks: 0

Abhimanyu9539/LLM-FineTuning
Finetuning of different LLM models
Language: Jupyter Notebook - Size: 83 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

mrnust/Fine_Tuning_LLM
Language: Jupyter Notebook - Size: 108 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Muavia1/DeepSeek-Math-FineTuned-For-Math-Meme-Correcction
This project fine-tunes the DeepSeek-Math-7B model using LoRA (Low-Rank Adaptation) to correct mathematical memes and equations efficiently. By leveraging 4-bit quantization and PEFT (Parameter-Efficient Fine-Tuning), the model improves mathematical reasoning while maintaining a lightweight footprint.
Language: Jupyter Notebook - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

AbsarRaashid3/SassySolver
SassySolver 🤖📚 - An AI-powered tool that humorously corrects wrong math memes! Built with a fine-tuned Qwen1.5-4B-Chat model using LoRA, deployed via Streamlit. It identifies common math misconceptions and provides accurate, sassy explanations. Make math memes smarter, one joke at a time!
Language: Jupyter Notebook - Size: 77.1 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Followb1ind1y/Medical-LLM-Fine-tuning
Fine-tunes LLaMA-3-8B on PubMedQA with QLoRA, optimized via DeepSpeed and vLLM for efficient, low-latency medical QA. Deployable via Docker for scalable clinical inference.
Language: Jupyter Notebook - Size: 3.38 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

0xZee/DeepSeek-R1-FineTuning
Fine-Tuning of DeepSeek-Style Reasoning Models | RL + Quantization Implementation
Language: Jupyter Notebook - Size: 43.9 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 11 - Forks: 3

yuki-2025/llama3-8b-fine-tuning-math
Fine-tuning Llama3 8b to generate JSON formats for arithmetic questions and process the output to perform calculations.
Language: Python - Size: 19.5 KB - Last synced at: about 20 hours ago - Pushed at: 12 months ago - Stars: 4 - Forks: 1

sergio11/llm_finetuning_and_evaluation
The LLM FineTuning and Evaluation project 🚀 enhances FLAN-T5 models for tasks like summarizing Spanish news articles 🇪🇸📰. It features detailed notebooks 📚 on fine-tuning and evaluating models to optimize performance for specific applications. 🔍✨
Language: Jupyter Notebook - Size: 499 KB - Last synced at: 23 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 1

yangjianxin1/LongQLoRA
LongQLoRA: Extent Context Length of LLMs Efficiently
Language: Python - Size: 1.92 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 164 - Forks: 15

urbanclimatefr/esg-llm-text-classification
This research investigates the classification of Environmental, Social, and Governance (ESG) information within textual disclosures. The aim is to develop and evaluate binary classification models capable of accurately identifying and categorizing E, S and G-related content respectively.
Language: Jupyter Notebook - Size: 11.9 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

naidezhujimo/LoRA-DoRA-QLoRA-PyTorch-Efficient-Fine-Tuning-with-Low-Rank-Adaptation
This repository contains a PyTorch implementation of a Convolutional Neural Network (CNN) for classifying the MNIST dataset. The project explores different fine-tuning techniques, including LoRA (Low-Rank Adaptation), DoRA (Dynamic Low-Rank Adaptation), and QLoRA (Quantized Low-Rank Adaptation), to improve model performance and efficiency.
Language: Python - Size: 236 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

ssbuild/llm_finetuning
Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on
Language: Python - Size: 325 KB - Last synced at: about 19 hours ago - Pushed at: about 1 year ago - Stars: 97 - Forks: 12

NotShrirang/DeepSeek-R1-Distill-Qwen-1.5B-SQL-Coder-PEFT
DeepSeek R1 Distill Qwen 1.5B finetuned for converting natural language queries to SQL queries
Language: Jupyter Notebook - Size: 31.3 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

kapshaul/LLM-finetune-vuln-detection
Fine-tuning a Large Language Model (LLM) for code vulnerability detection using QLoRA, a method that quantizes the model to 4-bit floats and incorporates adapters for fine-tuning.
Language: Python - Size: 11.4 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 7 - Forks: 1

arham-kk/llama2-qlora-sft
This model is a fine-tuned model based on the "TinyPixel/Llama-2-7B-bf16-sharded" model and "timdettmers/openassistant-guanaco" dataset
Size: 640 KB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

InquestGeronimo/tllm
An LLM training library for instruction-tuning.
Language: Python - Size: 785 KB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 25 - Forks: 3

YanSte/NLP-LLM-Fine-tuning-Llame-2-QLoRA-2024
Natural Language Processing (NLP) and Large Language Models (LLM) with Fine-Tuning LLM QLoRA and Llama 2 in 2024
Language: Jupyter Notebook - Size: 153 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 4

kyegomez/Finetuning-Suite
Finetune any model on HF in less than 30 seconds
Language: Jupyter Notebook - Size: 95.4 MB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 58 - Forks: 7

Abhi0323/Fine-Tuning-LLaMA-2-with-QLORA-and-PEFT
This project enhances the LLaMA-2 model using Quantized Low-Rank Adaptation (QLoRA) and other parameter-efficient fine-tuning techniques to optimize its performance for specific NLP tasks. The improved model is demonstrated through a Streamlit application, showcasing its capabilities in real-time interactive settings.
Language: Jupyter Notebook - Size: 160 KB - Last synced at: about 21 hours ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 5

Gustav-Proxi/AI-DxMH-Artificial-Intelligence-Diagnosis-for-Modern-Health
AI-DxMH is an AI-powered health assistant that provides accessible medical diagnoses for people in remote areas of India. It uses a large language model (LLM), natural language processing, and machine learning to ask users questions about their symptoms and provide likely diagnoses and health advice.
Language: Jupyter Notebook - Size: 11.4 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

avnlp/llm-finetuning
Language: Python - Size: 817 KB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

soniawmeyer/WanderChat
A Comparison of LLM Chat Bot Implementation Methods with Travel Use Case
Language: Jupyter Notebook - Size: 8.66 MB - Last synced at: about 21 hours ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1

michaelnny/QLoRA-LLM 📦
A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
Language: Python - Size: 26 MB - Last synced at: about 20 hours ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 1

alessioborgi/NSIO_NeuralSearchIndexingOptimization
Optimizing the Differentiable Search Index (DSI) with data augmentation (Num2Word, Stopwords Removal, POS-MLM) and parameter-efficient fine-tuning (LoRA, QLoRA, AdaLoRA, ConvoLoRA), improving retrieval accuracy and efficiency while reducing memory and computational overhead. Evaluated on the MS MARCO dataset for scalable performance.
Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 1

AnanthaPadmanaban-KrishnaKumar/EffiLLaMA
Finetuning LLaMA 3.2-1B-Instruct model using qLoRA and LoRA quantization PEFT methods
Language: Python - Size: 44.6 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

SathvikNayak123/Agentic-RAG
Agentic RAG with Llama-3.1-8b model Fine-tuned on medical conversational dataset
Language: Jupyter Notebook - Size: 215 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

reshalfahsi/medbot-instruct-conversational
MedBot: Medical Chatbot with Instruction Fine-Tuning and Conversational Memory
Language: Jupyter Notebook - Size: 126 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

akshay-kamath/Practical-LLM-Fine-Tuning
This repository contains hands on tutorials on fine tuning LLMs
Size: 17.9 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

gmongaras/Llama-2_Huggingface_4Bit_QLoRA
A working example of a 4bit QLoRA Falcon model using huggingface
Language: Python - Size: 11.7 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 2

kuutsav/llm-toys
Small finetuned LLMs for a diverse set of useful tasks
Language: Python - Size: 72.6 MB - Last synced at: 30 days ago - Pushed at: almost 2 years ago - Stars: 126 - Forks: 6

ssbuild/t5_finetuning
clue chatyuan finetuning
Language: Python - Size: 130 KB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 17 - Forks: 4

RajVenkat20/LLM-Optimizations-QLoRA-AWQ
This project takes the Flan-T5 LLM and applies QLoRA and AWQ quantization techniques
Language: Python - Size: 488 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

gauss5930/AlpaGasus2-QLoRA
This is AlpaGasus2-QLoRA based on LLaMA2 with AlpaGasus mechanism using QLoRA!
Language: Python - Size: 3 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 3

paraglondhe098/sentiment-classification-llm
Implemented and fine-tuned BERT for a custom sequence classification task, leveraging LoRA adapters for efficient parameter updates and 4-bit quantization to optimize performance and resource utilization.
Language: Jupyter Notebook - Size: 6.66 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

faezeh-gholamrezaie/Fine-Tuning-Large-Language-Models-for-Sleep-Stage-Classification
Fine-tuning Large Language Models (LLMs) using QLoRA on EEG data for efficient sleep stage classification and pattern recognition.
Language: Jupyter Notebook - Size: 31.8 MB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

dasdristanta13/LLM-Lora-PEFT_accumulate
LLM-Lora-PEFT_accumulate explores optimizations for Large Language Models (LLMs) using PEFT, LORA, and QLORA. Contribute experiments and implementations to enhance LLM efficiency. Join discussions and push the boundaries of LLM optimization. Let's make LLMs more efficient together!
Language: Jupyter Notebook - Size: 138 KB - Last synced at: about 20 hours ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 1

ErFer7/Computer-Vision
Este repositório contém o código do trabalho desenvolvido para a disciplina de Visão Computacional (INE410121) da UFSC.
Language: Jupyter Notebook - Size: 4.7 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

sarahboal/Machine-Translation-NLP-EN-FR-CS685-Umass
Machine Translation Model Comparisons for English to French using mT5 and Llama 2
Language: Jupyter Notebook - Size: 7.29 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

AbineshSivakumar/Llama-2-7B-QLoRA-Vicuna
This repository contains code to fine-tune a Llama-7B-Uncensored model using the Vicuna 70k dataset using Quantised Low Rank Adapations (LoRA).
Language: Python - Size: 2.55 MB - Last synced at: about 20 hours ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 4

ssbuild/chatglm_rlhf
chatglm_rlhf_finetuning
Language: Python - Size: 149 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 1

Gyanbardhan/Disha_Chatbot_IIITN
Chatbot for IIIT Nagpur using Fine Tuning and RAG
Language: Jupyter Notebook - Size: 5.06 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

MohamedAlaouiMhamdi/Finetuning_LLM
This project demonstrates the fine-tuning of the Mistral-7B language model using QLoRA (Quantized Low-Rank Adaptation) to optimize the model for dialogue summarization and customer support tasks.
Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

louisc-s/QLoRA-Fine-tuning-for-Film-Character-Styled-Responses-from-LLM
Code for fine-tuning Llama2 LLM with custom text dataset to produce film character styled responses
Language: Python - Size: 63.1 MB - Last synced at: about 21 hours ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 1

0xZee/finetune_model_dataset
Fine-Tunning Model llama3.2 on local Dataset using LoRA, QLoRA and PEFT..
Size: 5.86 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

monk1337/NanoPeft
The simplest repository & Neat implementation of different Lora methods for training/fine-tuning Transformer-based models (i.e., BERT, GPTs). [ Research purpose ]
Language: Jupyter Notebook - Size: 68.4 KB - Last synced at: about 21 hours ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 2

AINNOV/secure-your-contract
Secure Your Contract: Towards Efficient and Reliable AI-Assisted Contract Drafting
Language: Python - Size: 890 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

sidharth72/Scriptr---Gemma-2-Fine-tuning
A fine-tuned Version of Gemma 2 Model for Youtube Script Generation
Language: Jupyter Notebook - Size: 7.16 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

ssbuild/rwkv_finetuning
rwkv finetuning
Language: Python - Size: 1.32 MB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 36 - Forks: 1

Gaurav-Van/Fine-Tuning-LLMs
Introductory Guide where we will talk about Different Techniques of Fine Tuning LLMs
Language: Jupyter Notebook - Size: 2.95 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 2 - Forks: 2

HEMANGANI/LLM-Recommendation-Systems
This project fine-tunes large language models (LLMs) for text-based recommendations, using a novel prompt mechanism to improve accuracy and user satisfaction. It demonstrates efficient model adaptation with diverse datasets, leveraging advanced libraries and techniques for optimal performance.
Language: Jupyter Notebook - Size: 2.67 MB - Last synced at: about 20 hours ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

justsomerandomdude264/Homework_Solver_LLM
A fine-tuned LLM to solve homework questions ranging from maths to science and social science.
Size: 2.19 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

ssbuild/internlm_finetuning
internlm funetuning
Language: Python - Size: 305 KB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 5 - Forks: 1

EliasK93/instruction-fine-tuned-gemma-2-for-stance-detection
Example application for applying QLoRA-based Parameter-Efficient Fine-Tuning (PEFT) to a Stance Detection task using Gemma-2-9B-Instruct
Language: Python - Size: 1.98 MB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

EliasK93/qlora-based-efficient-fine-tuning-for-sentence-pair-classification
Example application for applying QLoRA-based Parameter-Efficient Fine-Tuning (PEFT) to a sentence pair classification task using Mistral-7B and Llama3-8B
Language: Python - Size: 480 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

MuhammadBinUsman03/Real-Time-3-pipeline-LLM-Financial-Advisor
3-Pipeline LLMOps Financial advisor. Steaming pipeline deployed on AWS, 24/7 collects, embeds live-data into QdrantDB. Training pipeline finetunes model on serverless GPU and logs best model on WandB Registry.Inference pipeline downloads best model from registry for inference, utilizes Langchain to maintain history and context retrieval.
Language: Python - Size: 440 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

timkoehne/Llama3-Finetuning-for-ABAP
Llama3 Fine-Tuning for ABAP using Unsloth 4-Bit QLoRA
Language: Jupyter Notebook - Size: 78.4 MB - Last synced at: 28 days ago - Pushed at: 9 months ago - Stars: 0 - Forks: 1

KwokHing/AI-Planet-LLM-Bootcamp-Challenge
An LLM challenge to (i) fine-tune pre-trained HuggingFace transformer model to build a Code Generation language model, and (ii) build a retrieval-augmented generation (RAG) application using LangChain
Language: Jupyter Notebook - Size: 874 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0

Spectrewolf8/kaggle-sql-xp-phi-3-mini-4k-instruct
A fine-tuned version of Phi-3-mini-4k-instruct for generating SQL queries from natural language prompts, utilizing synthetic datasets and QLoRA for efficient adaptation and deployment.
Language: Jupyter Notebook - Size: 178 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

jordandeklerk/OpenCodeInterpreter-Finetune-SQL
Fine-tuning coding LLM OpenCodeInterpreter-DS-6.7B for Text-to-SQL Code Generation on a Single A100 GPU in PyTorch
Language: Jupyter Notebook - Size: 1.01 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

faizan1234567/NewsQA
News QA generation and fine tuning an LLM for QA generation (under development)
Language: Jupyter Notebook - Size: 707 KB - Last synced at: 8 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0
