NVlabs/DoRA

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

Language: Python - Size: 3.06 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 668 - Forks: 44

synbol/Awesome-Parameter-Efficient-Transfer-Learning

Collection of awesome parameter-efficient fine-tuning resources.

Size: 188 KB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 548 - Forks: 13

Paranioar/Awesome_Matching_Pretraining_Transfering

The Paper List of Large Multi-Modality Model (Perception, Generation, Unification), Parameter-Efficient Finetuning, Vision-Language Pretraining, Conventional Image-Text Matching for Preliminary Insight.

Size: 369 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 425 - Forks: 48

Chongjie-Si/Subspace-Tuning

A generalized framework for subspace tuning methods in parameter efficient fine-tuning.

Language: Python - Size: 53.3 MB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 137 - Forks: 7

liuqidong07/MOELoRA-peft

[SIGIR'24] The official implementation code of MOELoRA.

Language: Python - Size: 10.2 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 105 - Forks: 11

ShiZhengyan/DePT

[ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"

Language: Python - Size: 3.71 MB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 96 - Forks: 16

ziplab/SPT

[ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.

Language: Python - Size: 15.5 MB - Last synced at: 21 days ago - Pushed at: over 1 year ago - Stars: 67 - Forks: 2

astra-vision/FAMix

[CVPR 2024] Domain generalization by interpolating original feature styles with styles obtained using random descriptions in natural language

Language: Python - Size: 54.3 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 51 - Forks: 3

iboing/CorDA

CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)

Language: Python - Size: 1.96 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 41 - Forks: 1

miccunifi/KDPL

[ECCV 2024] - Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation

Language: Python - Size: 2.62 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 36 - Forks: 1

umbertocappellazzo/PETL_AST

This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters".

Language: Python - Size: 3.09 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 32 - Forks: 1

OSU-MLB/ViT_PEFT_Vision

[CVPR'25] Lessons and Insights from a Unifying Study of Parameter-Efficient Fine-Tuning (PEFT) in Visual Recognition

Language: Jupyter Notebook - Size: 3.54 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 31 - Forks: 0

astra-vision/ProLIP

An extremely simple method for validation-free efficient adaptation of CLIP-like VLMs that is robust to the learning rate.

Language: Shell - Size: 3.9 MB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 24 - Forks: 2

auniquesun/PPT

[ICRA 2024] Official Implementation of the Paper "Parameter-efficient Prompt Learning for 3D Point Cloud Understanding"

Language: Jupyter Notebook - Size: 11 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 22 - Forks: 5

fredzzhang/atlas

Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"

Language: Python - Size: 689 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 18 - Forks: 0

PurdueDigitalTwin/MACP

[WACV 2024] MACP: Efficient Model Adaptation for Cooperative Perception.

Language: Python - Size: 106 MB - Last synced at: 12 days ago - Pushed at: 12 months ago - Stars: 16 - Forks: 1

cityuhkai/SBoRA

Language: Python - Size: 4.24 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 9 - Forks: 0

CASE-Lab-UMD/Router-Tuning-Mixture-of-Depths

The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for Enabling Dynamic Depth in Transformers."

Language: Python - Size: 467 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 7 - Forks: 2

Raman1121/FairTune

A framework to optimize Parameter-Efficient Fine-Tuning for Fairness in Medical Image Analysis

Language: Python - Size: 235 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 1

ssfgunner/SNELL

[NeurIPS 2024] This is the official repository for our paper: ''Expanding Sparse Tuning for Low Memory Usage''.

Language: Python - Size: 431 KB - Last synced at: 30 days ago - Pushed at: 30 days ago - Stars: 6 - Forks: 0

fork123aniket/LLM-RAG-powered-QA-App

A Production-Ready, Scalable RAG-powered LLM-based Context-Aware QA App

Language: Python - Size: 22.5 KB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 5 - Forks: 1

ltlhuuu/PSEC

[ICLR 2025] The offical Implementation of "PSEC: Skill Expansion and Composition in Parameter Space"

Language: Python - Size: 67.5 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 3 - Forks: 0

GeorgeVern/lmcor

Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"

Language: Python - Size: 401 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

Paranioar/SHERL

[ECCV2024] The code of "SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning"

Size: 8.79 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0

Sid3503/LoRA

A beginner-friendly guide to Low-Rank Adaptation (LoRA) - the efficient fine-tuning technique for LLMs. Explains core concepts with intuitive visuals, math, and minimal code.

Language: Jupyter Notebook - Size: 1.27 MB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0

Md-Emon-Hasan/Fine-Tuning

End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment

Language: Jupyter Notebook - Size: 5.5 MB - Last synced at: 23 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0

rochitasundar/Generative-AI-with-Large-Language-Models

This repository contains the lab work for Coursera course on "Generative AI with Large Language Models".

Language: Jupyter Notebook - Size: 218 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

XelfXendr/peft_unlearning

Repository exploring the use of parameter-efficient finetuning methods for sensitive information unlearning from LLMs

Language: Jupyter Notebook - Size: 1.24 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0

iurada/talos-task-arithmetic

Official repository of our work "Efficient Model Editing with Task-Localized Sparse Fine-tuning" accepted at ICLR 2025

Language: Python - Size: 84 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

lliutianc/roselora

Language: Python - Size: 14.3 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Hamid-Nasiri/EDoRA

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition

Language: Python - Size: 1.69 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

RuvenGuna94/Dialogue-Summary-PEFT-Fine-Tuning

This notebook fine-tunes the FLAN-T5 model for dialogue summarization, comparing full fine-tuning with Parameter-Efficient Fine-Tuning (PEFT). It evaluates performance using ROUGE metrics, demonstrating PEFT's efficiency while achieving competitive results.

Language: Jupyter Notebook - Size: 289 KB - Last synced at: 19 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

qiqinyi/GenAI-with-LLMs

My lab work of “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.

Language: Jupyter Notebook - Size: 28.9 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

giuseppedipoce/Task-Arithmetic-Tuning-of-MobileNetV2-

This repository contain a project which goal is to find new parameter efficient fine tuning framework in order to improve performance of Deep Artificial Neural Network onto "out of distribution" data (OOD). In this specific case you can find Multi-task Learning problem.

Language: Jupyter Notebook - Size: 2.08 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

architkaila/Fine-Tuning-LLMs-for-Medical-Entity-Extraction

Exploring the potential of fine-tuning Large Language Models (LLMs) like Llama2 and StableLM for medical entity extraction. This project focuses on adapting these models using PEFT, Adapter V2, and LoRA techniques to efficiently and accurately extract drug names and adverse side-effects from pharmaceutical texts

Language: Python - Size: 761 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Andy-LZH/peft4clip

Parameter Efficient Fine-Tuning for CLIP

Language: Python - Size: 19.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

alinourian/Fine-tuning-Mistral-7b-QA

Fine tuning Mistral-7b with PEFT(Parameter Efficient Fine-Tuning) and LoRA(Low-Rank Adaptation) on Puffin Dataset(multi-turn conversations between GPT-4 and real humans)

Language: Jupyter Notebook - Size: 20.5 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0