Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / OSS-Pole-Emploi / happy_vllm

A REST API for vLLM, production ready

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OSS-Pole-Emploi%2Fhappy_vllm

Stars: 18
Forks: 1
Open Issues: 4

License: agpl-3.0
Language: Python
Repo Size: 815 KB
Dependencies: 39

Created: 3 months ago
Updated: about 1 month ago
Last pushed: about 2 months ago
Last synced: about 1 month ago

Topics: api-rest, llm, llm-serving, mlops, production, serving, transformers, vllm

Files

Loading...

Readme

Loading...

Dependencies

pyproject.toml pypi

fastapi >=0.100.0,<1.0
lm-format-enforcer >=0.9.0,<0.10.0
numpy >=1.19
pydantic_settings >=2.0.1,<3.0
starlette-prometheus >=0.9,<1.0
torch >=2.0.0,<3.0.0
uvicorn [standard]>=0.20,<1.0
vllm >=0.3.2, <1.0

.github/workflows/bandit.yaml actions

actions/checkout v3 composite
actions/setup-python v3 composite

.github/workflows/build_and_tests.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/docs.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/install_test_from_requirements.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/linter.yaml actions

actions/checkout v3 composite
actions/setup-python v3 composite

.github/workflows/publish-pypi.yaml actions

actions/checkout v3 composite
actions/setup-python v3 composite
pypa/gh-action-pypi-publish v1.4.1 composite

.github/workflows/publish_docker_image.yaml actions

actions/checkout v4 composite
docker/build-push-action 3b5e8027fcad23fda98b2e3ac259d8d67585f671 composite
docker/login-action f4ef78c080cd8ba55a85445d5b36e214a81df20a composite
docker/metadata-action 9ec57ed1fcdbf14dcef7dfbe97b2010124a938b7 composite

.github/workflows/vulnerability.yaml actions

actions/checkout v3 composite
actions/setup-python v3 composite
actions/upload-artifact v3 composite

.github/workflows/wheel.yaml actions

actions/checkout v3 composite
actions/setup-python v3 composite

Dockerfile docker

nvidia/cuda 12.1.0-runtime-ubuntu22.04 build

requirements.txt pypi

fastapi ==0.109.2
lm-format-enforcer ==0.9.0
numpy ==1.26.4
pydantic-settings ==2.2.1
starlette-prometheus ==0.9.0
torch ==2.1.2
uvicorn ==0.27.1
vllm ==0.3.2

setup.py pypi