Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / Jawabreh0 / self-hosted-LLM
This repository provides inference sever to host any open-source LLM, providing the user OpenAI API colpatabile inference server, and AutoGen agents with function calling.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Jawabreh0%2Fself-hosted-LLM
Stars: 0
Forks: 0
Open Issues: 1
License: None
Language: Python
Repo Size: 452 KB
Dependencies:
92
Created: 4 months ago
Updated: about 1 month ago
Last pushed: about 1 month ago
Last synced: about 1 month ago
Topics: agent-based-modeling, agent-based-simulation, ai, deep-learning, function-calling, host-server, language-model, llm, llms, machine-learning
Files
Dependencies
- annotated-types ==0.6.0
- anyio ==3.7.1
- click ==8.1.7
- diskcache ==5.6.3
- fastapi ==0.104.1
- h11 ==0.14.0
- idna ==3.4
- jinja2 ==3.1.2
- llama-cpp-python ==0.2.14
- markupsafe ==2.1.3
- numpy ==1.26.1
- pydantic ==2.4.2
- pydantic-core ==2.10.1
- pyyaml ==6.0.1
- sniffio ==1.3.0
- starlette ==0.27.0
- typing-extensions ==4.8.0
- uvicorn ==0.24.0.post1
- FLAML ==2.1.1
- Jinja2 ==3.1.2
- MarkupSafe ==2.1.3
- PyYAML ==6.0.1
- Pygments ==2.17.2
- SecretStorage ==3.3.3
- annotated-types ==0.6.0
- anyio ==3.7.1
- autopep8 ==2.0.4
- cachetools ==5.3.2
- certifi ==2023.11.17
- cffi ==1.16.0
- charset-normalizer ==3.3.2
- click ==8.1.7
- cryptography ==41.0.7
- diskcache ==5.6.3
- distro ==1.9.0
- docopt ==0.6.2
- docutils ==0.20.1
- fastapi ==0.104.1
- google-auth ==2.26.2
- h11 ==0.14.0
- httpcore ==1.0.2
- httpx ==0.26.0
- idna ==3.4
- importlib-metadata ==7.0.1
- jaraco.classes ==3.3.0
- jeepney ==0.8.0
- keyring ==24.3.0
- kubernetes ==29.0.0
- llama_cpp_python ==0.2.14
- markdown-it-py ==3.0.0
- mdurl ==0.1.2
- more-itertools ==10.2.0
- nh3 ==0.2.15
- numpy ==1.26.1
- oauthlib ==3.2.2
- openai ==1.7.2
- pkginfo ==1.9.6
- pyasn1 ==0.5.1
- pyasn1-modules ==0.3.0
- pyautogen ==0.2.6
- pycodestyle ==2.11.1
- pycparser ==2.21
- pydantic ==2.4.2
- pydantic_core ==2.10.1
- python-dateutil ==2.8.2
- python-dotenv ==1.0.0
- readme-renderer ==42.0
- regex ==2023.12.25
- requests ==2.31.0
- requests-oauthlib ==1.3.1
- requests-toolbelt ==1.0.0
- rfc3986 ==2.0.0
- rich ==13.7.0
- rsa ==4.9
- six ==1.16.0
- sniffio ==1.3.0
- starlette ==0.27.0
- termcolor ==2.4.0
- tiktoken ==0.5.2
- tqdm ==4.66.1
- twine ==4.0.2
- typing_extensions ==4.8.0
- urllib3 ==2.1.0
- uvicorn ==0.24.0.post1
- websocket-client ==1.7.0
- zipp ==3.17.0