GitHub / AI-Hypercomputer / jetstream-pytorch
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AI-Hypercomputer%2Fjetstream-pytorch
PURL: pkg:github/AI-Hypercomputer/jetstream-pytorch
Stars: 60
Forks: 17
Open issues: 14
License: apache-2.0
Language: Python
Size: 1.41 MB
Dependencies parsed at: Pending
Created at: about 1 year ago
Updated at: 28 days ago
Pushed at: 3 months ago
Last synced at: 7 days ago
Commit Stats
Commits: 210
Authors: 15
Mean commits per author: 14.0
Development Distribution Score: 0.648
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/AI-Hypercomputer/jetstream-pytorch
Topics: attention, batching, gemma, inference, llama, llama2, llm, llm-inference, model-serving, pytorch, tpu