Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

Topic: "large-scale-language-modeling"

VPGTrans/VPGTrans

Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.

Language: Python - Size: 3.97 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 270 - Forks: 25

xrsrke/pipegoose

Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*

Language: Python - Size: 1.26 MB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 82 - Forks: 18

Related Topics
3d-parallelism 1 data-parallelism 1 distributed-optimizers 1 huggingface-transformers 1 megatron 1 megatron-lm 1 mixture-of-experts 1 model-parallelism 1 moe 1 pipeline-parallelism 1 sequence-parallelism 1 tensor-parallelism 1 transformers 1 zero-1 1 llm 1 vision-language-model 1 vl-llm 1