foundation-model-stack/fms-acceleration

🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

Language: Python - Size: 657 KB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 9 - Forks: 15

foundation-model-stack/foundation-model-stack

🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

Language: Python - Size: 6.87 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 193 - Forks: 67

foundation-model-stack/aiu-fms-testing-utils

Tests/Scripts for use with foundation-model-stack models running on AIU

Language: Python - Size: 568 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 12

foundation-model-stack/fms-hf-tuning

🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

Language: Python - Size: 154 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 41 - Forks: 56

foundation-model-stack/fms-guardrails-orchestrator

🚀 Guardrails orchestration server for application of various detections on text generation input and output.

Language: Rust - Size: 3.71 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 15 - Forks: 28

foundation-model-stack/multi-nic-cni

Language: Go - Size: 29.7 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 38 - Forks: 7

foundation-model-stack/fms-model-optimizer

FMS Model Optimizer is a framework for developing reduced precision neural network models.

Language: Python - Size: 14 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 16 - Forks: 11

foundation-model-stack/vllm-detector-adapter

Tiny adapter that runs on top of vllm and provides detector APIs

Language: Python - Size: 146 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 5 - Forks: 5

foundation-model-stack/fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

Language: Python - Size: 769 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 240 - Forks: 38

foundation-model-stack/vllm-triton-backend

A Triton-only attention backend for vLLM

Language: Python - Size: 259 KB - Last synced at: 8 days ago - Pushed at: 16 days ago - Stars: 4 - Forks: 6

foundation-model-stack/bamba

Train, tune, and infer Bamba model

Language: Python - Size: 2.32 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 88 - Forks: 13

foundation-model-stack/fm-training-estimator

Estimate resources needed to train LLMs

Language: Python - Size: 764 KB - Last synced at: 3 days ago - Pushed at: 2 months ago - Stars: 13 - Forks: 8

foundation-model-stack/transformers Fork of mayank31398/transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Size: 229 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

foundation-model-stack/fms-dgt

Synthetic Data Generation for Foundation Models

Language: Python - Size: 770 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 17 - Forks: 24

foundation-model-stack/hf-resource-scanner

Scan resources consumed during LLM training

Language: Python - Size: 160 KB - Last synced at: 12 days ago - Pushed at: 4 months ago - Stars: 8 - Forks: 3

foundation-model-stack/ocp-efa-operator

Operator that enables EFA and/or GDRCOPY in an OpenShift cluster

Language: Go - Size: 104 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

foundation-model-stack/blog Fork of huggingface/blog

Public repo for HF blog posts

Size: 519 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

foundation-model-stack/base-images

Language: Dockerfile - Size: 48.8 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 2 - Forks: 4

foundation-model-stack/pod-vllm

Source code to launch a number of pods, performing synthetic data generation

Language: Python - Size: 84 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

foundation-model-stack/moe-distributed-training

Demonstration of MoE distributed training using various techniques

Language: Python - Size: 145 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

foundation-model-stack/fms-extras

Language: Python - Size: 270 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 17 - Forks: 7

foundation-model-stack/fms-lm-eval-service

Language: Go - Size: 115 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

foundation-model-stack/avengers

Language: Shell - Size: 365 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

foundation-model-stack/fastsafetensors

High-performance safetensors model loader

Language: Python - Size: 1.44 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

foundation-model-stack/text-generation-inference Fork of huggingface/text-generation-inference

Large Language Model Text Generation Inference

Size: 5.22 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

foundation-model-stack/trl Fork of huggingface/trl

Train transformer language models with reinforcement learning.

Size: 5.43 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

foundation-model-stack/train-conductor

Training job management tool for foundation model service

Language: Python - Size: 193 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 3

foundation-model-stack/training-operator Fork of kubeflow/training-operator

Training operators on Kubernetes.

Language: Python - Size: 45.1 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 1