Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / 0-mostafa-rezaee-0 / Batch_LLM_Inference_with_Ray_Data_LLM

Batch LLM Inference with Ray Data LLM: From Simple to Advanced

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/0-mostafa-rezaee-0%2FBatch_LLM_Inference_with_Ray_Data_LLM

Stars: 3
Forks: 1
Open issues: 0

License: mit
Language: Jupyter Notebook
Size: 1.63 MB
Dependencies parsed at: Pending

Created at: about 1 month ago
Updated at: about 1 month ago
Pushed at: about 1 month ago
Last synced at: about 1 month ago

Topics: batch-inference, distributed-computing, large-language-models, llm, llm-api, nlp, parallel-processing, ray, ray-data, ray-serve, vllm

    Loading...