Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / google / JetStream

JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/google%2FJetStream

Stars: 126
Forks: 15
Open Issues: 5

License: apache-2.0
Language: Python
Repo Size: 377 KB
Dependencies: 99

Created: 3 months ago
Updated: 22 days ago
Last pushed: 26 days ago
Last synced: 24 days ago

Topics: gemma, gpt, gpu, inference, jax, large-language-models, llama, llama2, llm, llm-inference, llmops, mlops, model-serving, pytorch, tpu, transformer

Files
    Loading...
    Readme
    Loading...
    Dependencies
    setup.py pypi