louisbrulenaudet/mergeKit

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

Language: Jupyter Notebook - Size: 13.7 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 0