Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: multi-gpu-inference

inferflow/inferflow

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

Language: C++ - Size: 1.89 MB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 242 - Forks: 25

BY571/DistRL-LLM

Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization

Language: Python - Size: 374 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 9 - Forks: 0

JingyunLiang/PyTorch-Multi-GPU-Multi-Process-Testing

A script for PyTorch multi-GPU multi-process testing

Language: Python - Size: 16.6 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 21 - Forks: 6

Related Keywords
multi-gpu-inference 3 pytorch 1 multi-gpu-testing 1 multi-gpu-multi-process 1 reinforcement-learning-fine-tuning 1 reinforcement-learning 1 r1 1 pg 1 multi-gpu-training 1 llm-training 1 llm-finetuning 1 llm-fine-tuning 1 llm 1 grpo 1 qwen 1 phi-2 1 moe 1 model-quantization 1 mixture-of-experts 1 mixtral 1 mistral 1 minicpm 1 m2m100 1 llm-inference 1 llamacpp 1 llama2 1 internlm 1 gemma 1 falcon 1 deepseek 1 bloom 1 baichuan2 1