GitHub topics: preference-optimization
general-preference/general-preference-model
Official implementation of ICML 2025 paper "Beyond Bradley-Terry Models: A General Preference Model for Language Model Alignment" (https://arxiv.org/abs/2410.02197)
Language: Python - Size: 90.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 23 - Forks: 3
DtYXs/Pre-DPO
Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model
Language: Python - Size: 204 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 0
Sreyan88/Synthio
Code for ICLR 2025 Paper: Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Data
Language: Python - Size: 2.29 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
s-vco/s-vco
Symmetrical Visual Contrastive Optimization: Aligning Vision-Language Models with Minimal Contrastive Images
Language: Python - Size: 24.1 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 0
sahsaeedi/TPO
Triple Preference Optimization
Language: Python - Size: 19 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 21 - Forks: 0
sahsaeedi/DCPO-T2I
Dual Caption Preference Optimization
Language: Python - Size: 979 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0
martimfasantos/CustomPOs-for-SLMs
Novel Preference Optimization Algorithms for state-of-the-art small LMs, enhancing performance in GenAI and NLP tasks
Language: Python - Size: 272 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
