Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SJTU-IPADS%2FPowerInfer

Stars: 6,963
Forks: 368
Open Issues: 70

License: mit
Language: C++
Repo Size: 12.2 MB
Dependencies: 33

Created: 5 months ago
Updated: 11 days ago
Last pushed: 11 days ago
Last synced: 11 days ago

Topics: bamboo-7b, falcon, large-language-models, llama, llm, llm-inference, local-inference

Files
    Loading...
    Readme
    Loading...
    Dependencies
    .github/workflows/build.yml actions
    .github/workflows/code-coverage.yml actions
    .github/workflows/docker.yml actions
    .github/workflows/editorconfig.yml actions
    .github/workflows/gguf-publish.yml actions
    .github/workflows/tidy-post.yml actions
    .github/workflows/tidy-review.yml actions
    .github/workflows/zig-build.yml actions
    gguf-py/pyproject.toml pypi
    powerinfer-py/pyproject.toml pypi
    requirements.txt pypi
    Package.swift swiftpm
    examples/batched.swift/Package.swift swiftpm