Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: zero3

InternLM/InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

Language: Python - Size: 6.8 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 389 - Forks: 67

Related Keywords
910b 1 deepspeed-ulysses 1 flash-attention 1 gemma 1 internlm 1 internlm2 1 llama3 1 llava 1 llm-framework 1 llm-training 1 multi-modal 1 pipeline-parallelism 1 pytorch 1 ring-attention 1 sequence-parallelism 1 tensor-parallelism 1 transformers-models 1 zero3 1