An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: distillation

foxar124/distillery

like homebrew but with less fizz. install binaries as fast and as easy as possible. no package manager, no recipes or metadata to update, just install and go bin, binaries, fast, installer

Language: Go - Size: 99.6 KB - Last synced at: about 13 hours ago - Pushed at: about 14 hours ago - Stars: 0 - Forks: 0

fullscreen-triangle/vingi

**Personal Reality Distillation Engine** that actively manages, executes, and optimizes routine cognitive tasks while maintaining contextual awareness across temporal and domain boundaries.

Language: Swift - Size: 4.52 MB - Last synced at: about 22 hours ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

nicolay-r/distill-d2n-long Fork of Xiaoxiao-Liu/distill-d2n

Rationale-based Distillation fine-tuning framwork for AutoModelCasualLM for TextSummarization fine-tuning

Language: Python - Size: 3.23 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

hyeonsangjeon/PDF2LLM-Tuning-Studio

PDF 문서에서 GPU 가속 처리로 고품질 질의응답(QA) 데이터를 자동 생성하고 LLM을 효율적으로 파인튜닝하는 솔루션입니다. Unstructured 라이브러리와 AWS Bedrock Claude로 도메인 특화 QA 쌍을 생성하고, LoRA 기법으로 경량 모델을 훈련합니다.

Language: Jupyter Notebook - Size: 1.01 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 1

huggingface/optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

Language: Jupyter Notebook - Size: 17.5 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 466 - Forks: 131

lightly-ai/lightly-train

LightlyTrain is the first PyTorch framework to pretrain computer vision models on unlabeled data for industrial applications

Language: Python - Size: 5.72 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 327 - Forks: 8

GMvandeVen/continual-learning

PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Classifier) in three different scenarios.

Language: Jupyter Notebook - Size: 2.93 MB - Last synced at: 4 days ago - Pushed at: 15 days ago - Stars: 1,709 - Forks: 328

larry-athey/rpi-smart-still

Raspberry Pi (or clone) and Arduino/ESP32 powered smart still controller system. Designed around the Still Spirits T500 column and boiler, but can be easily added to any other gas or electric still with a dephlegmator.

Language: PHP - Size: 34.2 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 18 - Forks: 0

larry-athey/airhead

Air Still (or clone) upgrade that uses an SCR board or SSR for heating element control and an ESP32 to make the whole thing smarter. Eliminates that constant full power on/off switching to the heating element and the possibility of scorching. Plus even more features.

Language: C++ - Size: 14.1 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 3 - Forks: 0

tangxyw/RecSysPapers

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

Language: Python - Size: 1.57 GB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1,768 - Forks: 241

larry-athey/boilermaker

WiFi enabled and ESP32 driven power controller and temperature regulator for distillation boilers. Multiple units can be combined in a master/slave configuration.

Language: C++ - Size: 4.52 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 2 - Forks: 1

joisino/speedbook

書籍『深層ニューラルネットワークの高速化』のサポートサイトです。

Language: Jupyter Notebook - Size: 480 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 57 - Forks: 2

sinanuozdemir/quick-start-guide-to-llms

The Official Repo for "Quick Start Guide to Large Language Models"

Language: Jupyter Notebook - Size: 91.8 MB - Last synced at: 9 days ago - Pushed at: 19 days ago - Stars: 282 - Forks: 165

ViTAE-Transformer/ViTPose

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

Language: Python - Size: 10.5 MB - Last synced at: 10 days ago - Pushed at: 10 months ago - Stars: 1,614 - Forks: 208

BioSTEAMDevelopmentGroup/biosteam

The Biorefinery Simulation and Techno-Economic Analysis Modules; Life Cycle Assessment; Chemical Process Simulation Under Uncertainty

Language: Python - Size: 1.42 GB - Last synced at: 7 days ago - Pushed at: 12 days ago - Stars: 205 - Forks: 38

airaria/TextBrewer

A PyTorch-based knowledge distillation toolkit for natural language processing

Language: Python - Size: 7.54 MB - Last synced at: 10 days ago - Pushed at: about 2 years ago - Stars: 1,658 - Forks: 245

Aegis1863/LLMs-Distillation-Quantification

Repo of "Quantification of Large Language Model Distillation"

Language: Python - Size: 44.8 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 83 - Forks: 7

golololologol/LLM-Distillery

A pipeline for LLM knowledge distillation

Language: Python - Size: 562 KB - Last synced at: 11 days ago - Pushed at: 2 months ago - Stars: 103 - Forks: 13

Nota-NetsPresso/BK-SDM

A Compressed Stable Diffusion for Efficient Text-to-Image Generation [ECCV'24]

Language: Python - Size: 106 KB - Last synced at: 7 days ago - Pushed at: 11 months ago - Stars: 285 - Forks: 19

PaddlePaddle/PaddleSlim

PaddleSlim is an open-source library for deep model compression and architecture search.

Language: Python - Size: 16.3 MB - Last synced at: 4 days ago - Pushed at: 6 months ago - Stars: 1,591 - Forks: 350

CLUEbenchmark/CLUEPretrainedModels

高质量中文预训练模型集合:最先进大模型、最快小模型、相似度专门模型

Language: Python - Size: 789 KB - Last synced at: 8 days ago - Pushed at: almost 5 years ago - Stars: 817 - Forks: 96

raphaelsty/mkb

Knowledge Base Embedding By Cooperative Knowledge Distillation

Language: Python - Size: 44.1 MB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 67 - Forks: 3

ardaerendogru/dinov2_distillation

This project implements knowledge distillation from DINOv2 (Vision Transformer) to convolutional networks, enabling efficient visual representation learning with reduced computational requirements.

Language: Python - Size: 92.8 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 2 - Forks: 0

HySonLab/PointDistill

Topology-Guided Knowledge Distillation for Efficient Point Cloud Processing

Language: Python - Size: 671 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 2 - Forks: 0

Vicetrion/Distillation

Python code for simple distillation column using MaCabe-Thiele method and giving haet exchange at boiler and condenser.

Language: Python - Size: 14.6 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0

JhCircle/Less-is-More

Official Code for "Less is More: Enhancing Structured Multi-Agent Reasoning via Quality-Guided Distillation" for the ACL@XLLM Shared Task-III: on LLMs for Structural Reasoning.

Language: Python - Size: 1.58 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 14 - Forks: 1

bminixhofer/tokenkit

A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.

Language: Python - Size: 491 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 20 - Forks: 2

snap-research/graphless-neural-networks

[ICLR 2022] Code for Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillation (GLNN)

Language: Python - Size: 684 KB - Last synced at: 14 days ago - Pushed at: 7 months ago - Stars: 89 - Forks: 21

milistu/bertdistiller

Faster, smaller BERT models in just a few lines.

Language: Python - Size: 241 KB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 0

kaistAI/GenPI

This repository is the official implementation of Generative Context Distillation.

Language: Python - Size: 2.57 MB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 4 - Forks: 0

sinanuozdemir/oreilly-hands-on-gpt-llm

Mastering the Art of Scalable and Efficient AI Model Deployment

Language: Jupyter Notebook - Size: 33.2 MB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 136 - Forks: 91

jleto6/parse-note

This project uses real AI workflows including LLMs, retrieval-augmented generation, prompt engineering, and distillation to understand unstructured text and generate structured, readable output. It focuses on extracting, organizing, and clarifying complex content using applied NLP techniques.

Language: Python - Size: 156 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

GMvandeVen/brain-inspired-replay

A brain-inspired version of generative replay for continual learning with deep neural networks (e.g., class-incremental learning on CIFAR-100; PyTorch code).

Language: Python - Size: 24.5 MB - Last synced at: 12 days ago - Pushed at: almost 2 years ago - Stars: 237 - Forks: 65

dkozlov/awesome-knowledge-distillation

Awesome Knowledge Distillation

Size: 171 KB - Last synced at: 26 days ago - Pushed at: 3 months ago - Stars: 3,664 - Forks: 509

FLHonker/Awesome-Knowledge-Distillation

Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。

Size: 457 KB - Last synced at: 27 days ago - Pushed at: about 2 years ago - Stars: 2,577 - Forks: 338

IntelLabs/distiller 📦

Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distiller

Language: Jupyter Notebook - Size: 40.5 MB - Last synced at: 29 days ago - Pushed at: about 2 years ago - Stars: 4,390 - Forks: 805

Tanuki/tanuki.py

Prompt engineering for developers

Language: Python - Size: 774 KB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 686 - Forks: 25

Efficient-ML/Awesome-Efficient-AIGC

A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including language and vision, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

Size: 63.5 KB - Last synced at: 25 days ago - Pushed at: 4 months ago - Stars: 178 - Forks: 11

WezSieTato/BoolBrewLator

Language: C++ - Size: 6.35 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

JulesBelveze/bert-squeeze

🛠️ Tools for Transformers compression using PyTorch Lightning ⚡

Language: Python - Size: 2.44 MB - Last synced at: 13 days ago - Pushed at: 7 months ago - Stars: 83 - Forks: 10

JamesTheGiblet/Random-Art

An exploration of generative art through Python programming, creating unique, algorithmically generated patterns and designs.

Language: Python - Size: 52.7 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

bunyaminergen/TAS

The TAS (Teacher-Assistant-Student) repository contains code demonstrating how "knowledge" acquired by a large-scale, open or closed-source language model (LLM) can be transferred to a relatively smaller student model through an intermediate assistant model.

Language: Python - Size: 123 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

imagination-research/distilled-decoding

[ICLR 2025] Distilled Decoding 1: One-step Sampling of Image Auto-regressive Models with Flow Matching

Size: 78.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 43 - Forks: 2

Agents4Good/MasterChef-AI

Acesse: https://agents4good.github.io/MasterChef-AI/

Language: Jupyter Notebook - Size: 346 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

vscherbo/distibot

Distibot (DISTIller roBOT) is a Python program for Raspberry Pi (Raspbian) to control a whole process of distillation

Language: Python - Size: 5.1 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 3

khaykingleb/keyword-spotting

Attention Implementation for KWS

Language: Jupyter Notebook - Size: 1000 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 2

thu-ml/ares

A Python library for adversarial machine learning focusing on benchmarking adversarial robustness.

Language: Python - Size: 378 MB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 505 - Forks: 86

Syencil/mobile-yolov5-pruning-distillation

mobilev2-yolov5s剪枝、蒸馏,支持ncnn,tensorRT部署。ultra-light but better performence!

Language: Jupyter Notebook - Size: 19.4 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 843 - Forks: 165

mauritsmul/Chemical-Engineering-Tools

Chemical Engineering Toolbox (ongoing)

Language: Python - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

sayakpaul/deit-tf

Includes PyTorch -> Keras model porting code for DeiT models with fine-tuning and inference notebooks.

Language: Jupyter Notebook - Size: 40.4 MB - Last synced at: 9 days ago - Pushed at: about 3 years ago - Stars: 41 - Forks: 7

Sharpiless/Yolov5-distillation-train-inference

Yolov5 distillation training | Yolov5知识蒸馏训练,支持训练自己的数据

Language: Python - Size: 2.36 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 216 - Forks: 33

dark-horiznz/URL-Threat-Detection-using-Model-Distillation

A complete pipeline for deep learning model optimization via teacher fine-tuning, knowledge distillation, and 4-bit quantization. Built with PyTorch, Transformers, and BitsAndBytes.

Language: Jupyter Notebook - Size: 1020 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

birkhoffkiki/GPFM

The official implementation of GPFM

Language: Python - Size: 24.5 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 54 - Forks: 3

palomapiot/distil-metahate

Towards Efficient and Explainable Hate Speech Detection via Model Distillation

Language: Python - Size: 683 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

yandex-research/swd

Scale-wise Distillation of Diffusion Models

Size: 8.18 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 88 - Forks: 3

anarchy-ai/LLM-VM

irresponsible innovation. Try now at https://chat.dev/

Language: Python - Size: 1.74 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 488 - Forks: 142

yaya-sy/lillama

[NAACL' 25 main] Lillama: Large Language Model Compression via Low-Rank Feature Distillation

Language: Python - Size: 166 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 6 - Forks: 0

SanderGi/YADES

YOLOv8 Animal Detection for Embedded Systems. 97% test accuracy in just 400kb (about the same size as the photos it classifies or 1 second of video). Various quantization, pruning, and distillation techniques for vision models are explored.

Language: Jupyter Notebook - Size: 62 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0

microsoft/augmented-interpretable-models

Interpretable and efficient predictors using pre-trained language models. Scikit-learn compatible.

Language: Jupyter Notebook - Size: 189 MB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 42 - Forks: 12

backspacetg/distilAlhubert

code for our paper DistilALHuBERT: A Distilled Parameter Sharing Audio Representation Model

Language: Python - Size: 223 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 6 - Forks: 0

snap-research/linkless-link-prediction

[ICML 2023] Linkless Link Prediction via Relational Distillation

Language: Python - Size: 184 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 7

ViTAE-Transformer/SimDistill

The official repo for [AAAI 2024] "SimDistill: Simulated Multi-modal Distillation for BEV 3D Object Detection""

Language: Python - Size: 8.69 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 34 - Forks: 2

Tanuki/tanuki.ts

Prompt engineering for developers

Language: TypeScript - Size: 1.69 MB - Last synced at: 20 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

segmind/distill-sd

Segmind Distilled diffusion

Language: Python - Size: 4.14 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 595 - Forks: 38

cattomantis/cleave

Cleave: Resize any Transformer

Language: Python - Size: 5.19 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

gojasper/flash-diffusion

⚡ Flash Diffusion ⚡: Accelerating Any Conditional Diffusion Model for Few Steps Image Generation (AAAI 2025 Oral)

Language: Python - Size: 50.4 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 566 - Forks: 40

sinanuozdemir/oreilly-pytorch-dl

Code for Deep Learning for Modern AI

Language: Jupyter Notebook - Size: 7.06 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 42 - Forks: 33

dotchen/LAV

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

Language: Python - Size: 67.6 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 424 - Forks: 71

stanleylsx/text_classifier_torch

Text classification repository built with Torch, featuring training tricks, acceleration methods, and model optimization techniques like distillation, compression, and pruning. Supports single-label and multi-label training with customizable configurations. 基于Torch的文本分类仓库,包含训练技巧、加速方法以及模型优化技术,如蒸馏、压缩和剪枝。支持单标签和多标签训练,并提供可自定义的配置选项。

Language: Python - Size: 17.1 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 6 - Forks: 1

bloomberg/minilmv2.bb

Our open source implementation of MiniLMv2 (https://aclanthology.org/2021.findings-acl.188)

Language: Python - Size: 30.3 KB - Last synced at: 25 days ago - Pushed at: almost 2 years ago - Stars: 61 - Forks: 5

qcraftai/distill-bev

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation (ICCV 2023)

Language: Python - Size: 22 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 97 - Forks: 6

maliknaik16/machine-learning

ML journey to explore concepts and framework through code and math. It serves as a personal log of my learning experiences, revisiting foundational topics, and delving into new areas within the field.

Language: Jupyter Notebook - Size: 3.79 MB - Last synced at: 17 days ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0

Yu-Group/adaptive-wavelets

Adaptive, interpretable wavelets across domains (NeurIPS 2021)

Language: Jupyter Notebook - Size: 268 MB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 77 - Forks: 11

hung20gg/kg_llm

Using Knowledge Graph to Query Resume

Language: Jupyter Notebook - Size: 380 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

snap-research/R2L

[ECCV 2022] R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis

Language: Python - Size: 71.2 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 192 - Forks: 23

autodistill/autodistill-base-model-template

A template for use in creating Autodistill Base Model packages.

Language: Python - Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2

qiangsiwei/bert_distill

BERT distillation(基于BERT的蒸馏实验 )

Language: Python - Size: 28.9 MB - Last synced at: 2 months ago - Pushed at: almost 5 years ago - Stars: 311 - Forks: 86

sungnyun/ARMHuBERT

(Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT

Language: Python - Size: 4.52 MB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 39 - Forks: 6

DiTo97/Rf-PIQA

A machine learning toolkit for reference-free panorama IQA modelling.

Language: Python - Size: 1.1 MB - Last synced at: about 3 hours ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

Nota-NetsPresso/nota-wav2lip

A 28× Compressed Wav2Lip for Efficient Talking Face Generation [ICCV'23 Demo] [MLSys'23 Workshop] [NVIDIA GTC'23]

Language: Python - Size: 78.1 KB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 56 - Forks: 6

lapp0/distily

Distily: Language Model Distillation Toolkit and Library

Language: Python - Size: 342 KB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 7 - Forks: 0

zouharvi/reference-mt-distill

Almost Black-Box MT Model Stealing with Reference Translations Supersampling

Language: TeX - Size: 9.12 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

akimach/tensorflow-distillation-examples

Knowledge distillation implemented in TensorFlow

Language: Jupyter Notebook - Size: 8.38 MB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 18 - Forks: 4

fightnyy/distillBART_ECK

Repository for distillation of English, Chinese, Korean Multilingual BART

Language: Python - Size: 45.9 KB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 1

K-bNd/DINOv1_implem

DINOv1 implementation in Pytorch

Language: Python - Size: 156 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

alldbi/SuperMix

Pytorch implementation of CVPR2021 paper: SuperMix: Supervising the Mixing Data Augmentation

Language: Python - Size: 1.86 MB - Last synced at: 26 days ago - Pushed at: over 3 years ago - Stars: 92 - Forks: 21

gyunggyung/DistilKoBiLSTM

Distilling Task-Specific Knowledge from Teacher Model into BiLSTM

Language: Python - Size: 88.3 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 32 - Forks: 4

PialGhosh2233/Finetune-Light-weight-StableDiffusion-ImageTOImage

Grayscale image colorization using Light weight stable diffusion

Language: Jupyter Notebook - Size: 32.2 KB - Last synced at: 2 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Adamdad/KnowledgeFactor

[ECCV2022] Factorizing Knowledge in Neural Networks

Language: Python - Size: 781 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 89 - Forks: 5

khurramjaved96/incremental-learning

Pytorch implementation of ACCV18 paper "Revisiting Distillation and Incremental Classifier Learning."

Language: Python - Size: 2.16 MB - Last synced at: 24 days ago - Pushed at: 10 months ago - Stars: 107 - Forks: 24

sinanuozdemir/odsc-llmops

Sinan Ozdemir's ODSC West Workshop: LLMs from Protoype to Production

Language: Jupyter Notebook - Size: 6.24 MB - Last synced at: 5 days ago - Pushed at: 7 months ago - Stars: 11 - Forks: 1

microsoft/Lightweight-Low-Resource-NMT

Official code for "Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models" to appear in WMT 2022.

Language: Python - Size: 45.9 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 5

tonywu71/distilling-and-forgetting-in-large-pre-trained-models

Code for my dissertation on "Distilling and Forgetting in Large Pre-Trained Models" for the MPhil in Machine Learning and Machine Intelligence (MLMI) at the University of Cambridge.

Language: Jupyter Notebook - Size: 11.3 MB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 2

Lizhecheng02/Kaggle-LMSYS

Analyze a dataset of conversations from the Chatbot Arena, where various LLMs provide responses to user prompts. The goal is to develop a model that enhances chatbot interactions, ensuring they align more closely with human preferences.

Language: Jupyter Notebook - Size: 1.93 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

aakanksha-gubbala/mccabe-thiele

McCabe-Thiele Plots

Language: Jupyter Notebook - Size: 836 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0

kyaiooiayk/Cheap-ML-models

Optimising train, inference and throughput of expensive ML models

Size: 27.3 KB - Last synced at: 6 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

icon-lab/DreaMR

Diffusion-driven Counterfactual Explanation for Functional MRI (https://arxiv.org/abs/2307.09547)

Language: Python - Size: 6.52 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0

Atenrev/diffusion_continual_learning

PyTorch implementation of various distillation approaches for continual learning of Diffusion Models.

Language: Python - Size: 78.8 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 0

cantbebetter2/Awesome-Diffusion-Distillation

A list of papers, docs, codes about diffusion distillation.This repo collects various distillation methods for the Diffusion model. Welcome to PR the works (papers, repositories) missed by the repo.

Size: 1000 Bytes - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 1

yukimasano/single-img-extrapolating

Repo for the paper "Extrapolating from a Single Image to a Thousand Classes using Distillation"

Language: Python - Size: 66.2 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 35 - Forks: 3

Related Keywords
distillation 200 pytorch 40 deep-learning 36 knowledge-distillation 24 quantization 21 bert 19 pruning 18 nlp 17 model-compression 16 python 16 llm 14 machine-learning 14 transformers 10 computer-vision 9 transformer 9 tensorflow 8 classification 8 neural-network 7 diffusion-models 7 self-supervised-learning 6 continual-learning 6 knowledge 6 language-model 6 distillation-model 5 kd 5 text-classification 5 stable-diffusion 5 contrastive-learning 5 lightweight 5 huggingface 5 knowledge-transfer 5 ai 5 artificial-intelligence 5 incremental-learning 5 chemical-engineering 5 large-language-models 5 pretrained-models 4 inference 4 esp32 4 compression 4 reinforcement-learning 4 distilbert 4 deep-neural-networks 4 llms 4 graph-neural-networks 3 llm-training 3 multi-modal 3 fermentation 3 neural-networks 3 adversarial-attacks 3 generative-ai 3 teacher-student 3 llm-inference 3 machine-translation 3 multimodal 3 lifelong-learning 3 mccabe-thiele 3 automation 3 arduino 3 roberta 3 keras 3 yolov5 3 gnn 3 efficient-inference 3 self-distillation 3 clip 3 knowldge-distillation 3 autonomous-driving 3 cvpr2022 3 embeddings 3 deeplearning 3 natural-language-processing 3 data-science 2 attention 2 data 2 transfer-learning 2 scalability 2 pre-trained-model 2 matlab 2 point-cloud 2 kd-methods 2 knowledge-graph 2 graph 2 multilabel-classification 2 chinese 2 tensorrt 2 sparsity 2 segmentation 2 nas 2 detection 2 thermodynamics 2 vision-transformer 2 generative-replay 2 explainability 2 interpretability 2 tensorflow2 2 efficientnet 2 3d-object-detection 2 diffusion 2 defense 2