GitHub topics: litellm

Repositories

kaymen99/AI-Voice-assistant

AI Voice Assistant: Talk to an AI agent that helps you with event scheduling, contact management, accessing your knowledge base, and web searches using simple voice commands

Language: Python - Size: 22.5 KB - Last synced at: 1 day ago - Pushed at: 4 months ago - Stars: 38 - Forks: 17

Blacksuan19/structx

Type-safe structured data extraction from text using LLMs.

Language: Python - Size: 1.43 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 3 - Forks: 0

hienhayho/rag-colls

Collection of recent advanced RAG techniques.

Language: Python - Size: 10.1 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 12 - Forks: 4

tsmdt/dygest

Generate content insights for your documents with LLMs and NER

Language: Python - Size: 4.78 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 3 - Forks: 0

A simple Docker Compose boilerplate for deploying Open WebUI and LiteLLM with Traefik for personal LLM use. Securely manage and access language models via a user-friendly chat interface and a unified API proxy

Size: 8.79 KB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 5 - Forks: 0

phil65/llmling-agent

Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Human-in-the-loop integration.

Language: Python - Size: 3.64 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 16 - Forks: 3

morphik-org/morphik-core

Open source multi-modal RAG for building AI apps over private knowledge.

Language: Python - Size: 114 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1,049 - Forks: 54

jake83741/vnc-lm

A Discord bot for large language models. Add Gemini, Sonnet, DeepSeek, and other models. Easily change models, edit prompts, and enable web search.

Language: TypeScript - Size: 103 KB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 79 - Forks: 5

versionHQ/multi-agent-system

Autonomous agent networks for task automation that requires multi-step reasoning

Language: Python - Size: 3.58 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 15 - Forks: 3

Ahmet-Dedeler/ai-llm-comparison

A website where you can compare every AI Model ✨

Language: TypeScript - Size: 694 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 330 - Forks: 34

Rishang/deep-research

Python SDK for Deep-Research

Language: Python - Size: 196 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

The-Swarm-Corporation/Swarms-API

Build, deploy, and orchestrate AI agents at scale with ease. Swarms API provides a comprehensive suite of endpoints for creating and managing multi-agent systems.

Language: Python - Size: 2.61 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 7 - Forks: 1

Cyclenerd/google-cloud-litellm-proxy

🚅 LiteLLM Proxy for Google Cloud Generative AI

Language: Dockerfile - Size: 1.53 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 44 - Forks: 8

Whth/fabricatio

Fabricatio is a Python library designed for building applications that leverage Large Language Models (LLMs) using an event-based agent structure. It utilizes Handlebars for templating and provides a robust framework for managing tasks, workflows, and toolboxes, enabling developers to create intelligent and efficient applications.

Language: Python - Size: 1.12 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 1

KhurramDevOps/Quarter-02

Language: Jupyter Notebook - Size: 33.2 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 3 - Forks: 0

emilrueh/overlord

FastAPI SSE backend integrating Langfuse and LiteLLM

Language: Python - Size: 1.62 MB - Last synced at: 8 days ago - Pushed at: 9 days ago - Stars: 1 - Forks: 1

ChrispyBacon-dev/baconflip

BaconFlip - Your Personality-Driven, LiteLLM-Powered Discord Bot

Language: Python - Size: 423 KB - Last synced at: 7 days ago - Pushed at: 15 days ago - Stars: 4 - Forks: 0

dreadnode/rigging

Lightweight LLM Interaction Framework

Language: Python - Size: 3.95 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 263 - Forks: 18

QuiddityAI/LLMonkey

Minimal wrappers around LLM providers and models repository

Language: Python - Size: 104 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

Aak172003/Crew-Ai-Course

Language: Python - Size: 976 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

yjg30737/pyqt-openai

VividNode: Multi-purpose Text & Image Generation Desktop Chatbot (supporting various models including GPT).

Language: Python - Size: 24.8 MB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 135 - Forks: 24

Shekswess/synthgenai

SynthGenAI - Package for Generating Synthetic Datasets using LLMs.

Language: Python - Size: 1.64 MB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 31 - Forks: 3

Build5Nines/azd-litellm

An AZD template to deploy LiteLLM, open-source Python AI LLM Proxy API with support of 100+ LLMs, to Azure Container Apps with Azure Database for PostgreSQL.

Language: Bicep - Size: 463 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 2 - Forks: 1

prometheus-eval/prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4 💯

Language: Python - Size: 15 MB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 898 - Forks: 55

g1ibby/llm-deploy

Tool to manage ollama model on vast.ai

Language: Python - Size: 90.8 KB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 17 - Forks: 1

kaymen99/AI-Sales-agent

Sales AI agent that talks with your customers, recommend products, book consultations, and process Stripe payments

Language: Python - Size: 46.9 KB - Last synced at: 14 days ago - Pushed at: 4 months ago - Stars: 31 - Forks: 9

Fus3n/gem-assist

Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools

Language: Python - Size: 528 KB - Last synced at: 14 days ago - Pushed at: 22 days ago - Stars: 105 - Forks: 4

tdchaitanya/looplm

🔄 LoopLM: Command line tool accessing LLMs directly from your terminal

Language: Python - Size: 2.32 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0

valaises/llm-proxy

Unified interface server for various LLM providers with OpenAI API format

Language: Python - Size: 274 KB - Last synced at: 28 days ago - Pushed at: 29 days ago - Stars: 1 - Forks: 0

rihoneailabs/llmcall

A lite abstraction layer for structured LLM calls

Language: Python - Size: 220 KB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

CXwudi/litellm-config-generator

Fill up the `model_list` field in your LiteLLM proxy configuration file

Language: Python - Size: 146 KB - Last synced at: 7 days ago - Pushed at: 8 months ago - Stars: 10 - Forks: 1

jespimentel/analisador_lote_ip_colab

O programa emprega o poder do Python e das LLMs, mediadas pela biblioteca `litellm`, para analisar uma coleção de inquéritos policiais em formato PDF encontrados em determinada pasta (diretório).

Language: Jupyter Notebook - Size: 41 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

yorrickjansen/gen-ai-on-aws

Production grade deployment of GenAI on AWS

Language: Python - Size: 202 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

markolofsen/litellm2

A powerful AI framework with structured Pydantic responses, flexible LLM integration, and advanced agent capabilities

Language: Jupyter Notebook - Size: 155 KB - Last synced at: 12 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

HopMaster03/E-Commerce-Support-Agent-RAG

This AI Agent follows the best RAG practices to help E-commerce businesses solve their Customer Support Queries.

Language: Python - Size: 16.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

wajahattt-dot/MCP-Research-Work-PIAIC

The Model Context Protocol (MCP) project, developed by PIAIC Batch 61 Morning Boys (Team 2) and led by Wajahat Hussain, showcases an innovative approach to contextual AI. It demonstrates how MCP—an open standard by Anthropic—enables secure and streamlined connectivity between AI systems and various external data sources.

Language: Python - Size: 6.38 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

kaymen99/agentic-ai-projects

Collection of generative AI projects & applications including: multiple LLMs, AI agents, RAG

Language: Jupyter Notebook - Size: 1000 KB - Last synced at: 14 days ago - Pushed at: 9 months ago - Stars: 6 - Forks: 2

TheRealFREDP3D/George_Was_Right

AI agents, powered by CrewAI, to analyze recent world events through the lens of themes from George Orwell's *1984*.

Language: Python - Size: 37.9 MB - Last synced at: 13 days ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0

Likhithsai2580/Agent_Unknown

Automating Everything

Language: Python - Size: 6.18 MB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

phonhay103/BookAIReader

Language: Python - Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

abdulwasea89/News-Agent

AI News Agent is an automated news aggregation and summarization system powered by CrewAI. It uses AI agents to curate, analyze, and deliver personalized news articles based on user preferences. The system integrates NLP for topic extraction, real-time updates.

Language: Python - Size: 8.79 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

nomnomnonono/essay-generator

Language: Python - Size: 63.5 KB - Last synced at: 26 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Mj23978/OpenServer

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Language: Python - Size: 1.97 MB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 2

mimirtechco/dokploy-litellm

LiteLLM Docker Compose prepared for using on Dokploy

Size: 8.79 KB - Last synced at: 26 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 1

ccwutw/llm-demo

Language: Python - Size: 4.88 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

bmd1905/ChatOpsLLM

To simplify and streamline LLM operations, empowering developers and organizations to harness the full potential of large language models with ease.

Language: Svelte - Size: 24.6 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 87 - Forks: 22

tcsenpai/multi1 Fork of bklieger-groq/g1

multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at once.

Language: Python - Size: 1.3 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 345 - Forks: 23

rvanasa/pandas-gpt

Power up your data science workflow with ChatGPT.

Language: Jupyter Notebook - Size: 494 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 58 - Forks: 8

LubergAlexander/plexmuse

AI-powered playlist curator that uses LLMs to generate personalized playlists from your Plex music library based on natural language prompts

Language: Python - Size: 174 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

yamitzky/ailingo

A CLI Tool for Local File Translation Using Generative AI

Language: Python - Size: 188 KB - Last synced at: about 22 hours ago - Pushed at: 10 months ago - Stars: 4 - Forks: 0

dinhanhx/litellm-infinity-vllm-serving-local-models

docker compose to serve some local language models

Language: Python - Size: 4.88 KB - Last synced at: 22 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

justthecontent/api.webhook-ingest-csv

Flask microservice that logs Slack webhook events to CSV files. Features Docker deployment, persistent storage, and comprehensive test coverage.

Language: Python - Size: 7.81 KB - Last synced at: 26 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

stanford-oval/chainlite

LangChain + LiteLLM that works

Language: Python - Size: 464 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 23 - Forks: 3

AureliusIvan/remembear

An app for people with short-term-memory 🧠

Language: TypeScript - Size: 2.21 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 8 - Forks: 2

hsaeed3/zyx

super duper simple llm toolkit

Language: Python - Size: 15.3 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 4 - Forks: 0

mushinbush/discord-bot-hakkaLLM

Discord chat bot with LLMs API

Language: Python - Size: 14.6 KB - Last synced at: 21 days ago - Pushed at: 9 months ago - Stars: 7 - Forks: 0

Flowm/llm-stack

Docker compose config for local and hosted llms with multiple chat interfaces

Size: 20.5 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 4 - Forks: 2

nachiket273/unit_test_llm_agent

LLM Agent that will generate unit tests and test coverage report

Language: Python - Size: 10.7 KB - Last synced at: 11 days ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

akari2600/llm-engineer Fork of Doriandarko/claude-engineer

LLM Engineer: An interactive CLI leveraging multiple large language models for software development assistance. Combines AI capabilities with file system operations and web search functionality. Supports 100+ LLMs via LiteLLM integration.

Language: Python - Size: 180 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

Related Keywords

litellm 69 llm 31 openai 21 ai 16 python 12 ollama 11 gemini 11 rag 11 docker 9 chatbot 7 langchain 7 generative-ai 6 llms 6 groq 6 docker-compose 5 fastapi 5 llama3 5 chatgpt 5 gemini-api 5 langfuse 4 pydantic 4 openai-api 4 agents 4 llmops 4 anthropic 4 crewai 4 agentic-ai 4 vllm 3 gpt 3 uv 3 discord-bot 3 llm-agent 3 cohere 3 gemini-pro 3 embeddings 2 mem0ai 2 matplotlib 2 docling 2 shadcn-ui 2 autogen 2 workflow 2 chat-application 2 vector-database 2 o1 2 gpt4 2 mistral 2 openrouter 2 langgraph 2 chainlit 2 ai-agent 2 instructor 2 huggingface 2 openwebui 2 xata 2 vercel 2 agent 2 tailwindcss 2 artificial-intelligence 2 multimodal 2 llama 2 discord 2 customer-service 1 g4f 1 image-generation 1 llamacpp 1 proxy-server 1 stable 1 whisper 1 dokploy 1 aisuite 1 devops 1 lllmops 1 mlops 1 open-webui 1 api 1 chains 1 llm-inference 1 local 1 groq-api 1 remix 1 perplexity 1 novel 1 notion 1 customer-support-assistant 1 e-commerce 1 wip 1 modelcontextprotocol 1 assistant 1 retrieval-augmented-generation 1 1984 1 prompt-toolkit 1 prompt-generator 1 prompt-engineering 1 orwell 1 project 1 automation 1 open-interpreter 1 genetic-algorithm 1 os 1 streamlit 1