llm-parallelism-explorer-poc

It is a cutting-edge research tool designed to optimize parallelism strategies for large language models, with a particular focus on Mixture of Experts (MoE) architectures.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Siddhant-K-code%2Fllm-parallelism-explorer-poc

Stars: 2
Forks: 2
Open issues: 0

License: None
Language: Python
Size: 6.84 KB
Dependencies parsed at: Pending

Created at: 7 months ago
Updated at: 5 months ago
Pushed at: 6 months ago
Last synced at: 1 day ago

Topics: hydra, llm, parallelism, poc

Funding Links https://github.com/sponsors/Siddhant-K-code

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Repos

GitHub / Siddhant-K-code / llm-parallelism-explorer-poc