argilla-io/notus

Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first approach

Language: Python - Size: 4.43 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 168 - Forks: 14