An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: llmops

sydverma123/awesome-ai-repositories

A curated list of open source repositories for AI Engineers

Size: 178 KB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 114 - Forks: 21

explodinggradients/ragas

Supercharge Your LLM Application Evaluations ๐Ÿš€

Language: Python - Size: 41 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 9,530 - Forks: 945

tensorchord/envd

๐Ÿ•๏ธ Reproducible development environment

Language: Go - Size: 3.41 MB - Last synced at: 6 days ago - Pushed at: 8 days ago - Stars: 2,119 - Forks: 159

NeumTry/NeumAI

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Language: Python - Size: 3.83 MB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 857 - Forks: 47

dot-agent/nextpy

๐Ÿค–Self-Modifying Framework from the Future ๐Ÿ”ฎ World's First AMS

Language: Python - Size: 56.6 MB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 2,292 - Forks: 168

maximhq/maxim-go

SDK to integrate Maxim in your Go app.

Language: Go - Size: 58.6 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 2 - Forks: 1

traceloop/hub

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

Language: Rust - Size: 634 KB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 102 - Forks: 16

Auto-Playground/ragrank

๐ŸŽฏ Your free LLM evaluation toolkit helps you assess the accuracy of facts, how well it understands context, its tone, and more. This helps you see how good your LLM applications are.

Language: Python - Size: 577 KB - Last synced at: 4 days ago - Pushed at: 14 days ago - Stars: 39 - Forks: 13

AkshaySyal/End-to-End-Basketball-QA-RAG-Capstone

Created a QA Chatbot powered by fine tuned text-to-sql LLM deployed on personal gaming laptop (Nvidia GTX 1650) using Ollama and Ngrok

Language: Jupyter Notebook - Size: 3.74 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 0 - Forks: 1

AGiXT/python-sdk

AGiXT is a dynamic AI Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

Language: Python - Size: 69.3 KB - Last synced at: 2 days ago - Pushed at: 3 months ago - Stars: 20 - Forks: 5

mcp-router/mcp-router

The MCP manager. Easily manage your MCP servers with enhanced security and customizability

Language: TypeScript - Size: 24.1 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 114 - Forks: 14

superlinked/VectorHub

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

Language: Jupyter Notebook - Size: 98.1 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 480 - Forks: 118

ThousandBirdsInc/chidori

A reactive runtime for building durable AI agents

Language: Rust - Size: 39.4 MB - Last synced at: 4 days ago - Pushed at: 6 months ago - Stars: 1,316 - Forks: 50

bosun-ai/swiftide

Fast, streaming indexing, query, and agentic LLM applications in Rust

Language: Rust - Size: 4.65 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 497 - Forks: 36

KazKozDev/LLMFlow

An extensible framework for building AI agents based on the GAME (Goals, Actions, Memory, Environment) methodology.

Language: Python - Size: 256 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

datadreamer-dev/DataDreamer

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. โ€€ ๐Ÿค–๐Ÿ’ค

Language: Python - Size: 895 KB - Last synced at: 3 days ago - Pushed at: 5 months ago - Stars: 1,026 - Forks: 54

shakil1819/Multi-Agent-Data-Analyst

This Agentic system is designed to handle complex data analysis tasks by breaking them down into smaller subtasks and delegating them to specialized agents. The system uses a multi-agent architecture to improve performance and scalability.

Language: HTML - Size: 1.92 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 2 - Forks: 0

chankeypathak/AuditSync-Pro

Gen AI application that automatically compares and analyzes audit reports from multiple sources (internal auditors, SEC filings, third-party vendors) to identify discrepancies, ensure compliance, and provide actionable insights using modern LLMOps practices.

Language: Python - Size: 32.2 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

unikill066/youtube_crewAI_scraper_mapper

An Agentic YouTube crewAI Scraper & Mapper - A Python tool that uses crewAI to scrape YouTube channel data and visualizes it geographically with interactive in maps.

Language: HTML - Size: 25.5 MB - Last synced at: 3 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

tensorchord/openmodelz

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

Language: Go - Size: 1010 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 269 - Forks: 25

CapgeminiInventUK/langscout

Open source LLM trace tool for Langchain built on MongoDB

Language: TypeScript - Size: 4.39 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 13 - Forks: 1

scitix/aegis

Aegis is an LLM-powered AI cluster autonomous operations system, focused on intelligent capabilities such as Fault Diagnosis, Self-healing, Root Cause Analysis, Cluster Inspection, and Alert Optimization.

Language: Go - Size: 1.14 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 7 - Forks: 1

Writesonic/GPTRouter

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Language: TypeScript - Size: 1.28 MB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 449 - Forks: 41

sunholo-data/sunholo-py

A python library to enable GenAI and LLMOps within Google Cloud Platform

Language: Python - Size: 49.6 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 13 - Forks: 1

dynamiq-ai/dynamiq

Dynamiq is an orchestration framework for agentic AI and LLM applications

Language: Python - Size: 4.78 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 872 - Forks: 96

EasyShopAI/rag-lab

Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot

Language: Python - Size: 33.1 MB - Last synced at: 11 days ago - Pushed at: 16 days ago - Stars: 46 - Forks: 8

traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Language: TypeScript - Size: 6.11 MB - Last synced at: 8 days ago - Pushed at: 15 days ago - Stars: 324 - Forks: 37

jina-ai/serve

โ˜๏ธ Build multimodal AI applications with cloud-native stack

Language: Python - Size: 1.57 GB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 21,607 - Forks: 2,229

openlit/helm

Helm Charts to deploy and manage OpenLIT in Kubernetes

Language: Smarty - Size: 177 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 5 - Forks: 6

adilsaid64/open-rag-stack

A playground for building and serving Retrieval-Augmented Generation (RAG) systems using best practices in MLOps and LLMOps, with open-source tools.

Language: Python - Size: 1.51 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 1

vincentkoc/tiny_qa_benchmark_pp

Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.

Language: Python - Size: 306 KB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 23 - Forks: 0

multi-modal-ai/.github

Size: 332 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

tensorchord/ai-infra-landscape

This is a landscape of the infrastructure that powers the generative AI ecosystem

Language: HTML - Size: 23.8 MB - Last synced at: 13 days ago - Pushed at: 8 months ago - Stars: 147 - Forks: 56

becloudready/ai-platform-engineering

AI Platform Engineering - LLMOps, DevOps, AIOps and SRE

Language: Python - Size: 76.2 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 3 - Forks: 2

friendliai/friendli-client

Friendli: the fastest serving engine for generative AI

Language: Python - Size: 4.88 MB - Last synced at: 1 day ago - Pushed at: 5 months ago - Stars: 47 - Forks: 7

mtuann/llm-updated-papers

Papers related to Large Language Models in all top venues

Size: 750 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 8 - Forks: 1

devsapp/agentcraft

agentcraft ๅฏไปฅๅธฎๅŠฉๆ‚จๅฟซ้€Ÿๆž„ๅปบๅ„็ฑปๅบ”็”จๅœบๆ™ฏ็š„ai agentๅบ”็”จ

Language: TypeScript - Size: 30.3 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 65 - Forks: 16

matdev83/llm-wrapper-mcp-server

Allow any MCP-capable LLM agent to communicate with or delegate tasks to any other LLM available through the OpenRouter.ai API.

Language: Python - Size: 202 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 1 - Forks: 0

ajndkr/lanarky

The web framework for building LLM microservices

Language: Python - Size: 22.9 MB - Last synced at: 16 days ago - Pushed at: 12 months ago - Stars: 993 - Forks: 78

ifsheldon/transprompt

Prompt-centric framework for developing LLM applications in Rust

Language: Rust - Size: 144 KB - Last synced at: 6 days ago - Pushed at: 17 days ago - Stars: 6 - Forks: 1

raga-ai-hub/RagaAI-Catalyst

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

Language: Python - Size: 55.8 MB - Last synced at: 17 days ago - Pushed at: 23 days ago - Stars: 16,191 - Forks: 3,780

mark5420/Prompt-Assistant

<div align="center"># ๐Ÿค– Prompt Assistant - AI Prompt Engineering Tool[![Chrome Web Store](https://img.shields.io/badge/Chrome%20Web%20Store-Available-brightgreen?style=for-the-badge&logo=google-chrome)](https://chromewebstore.google.com/detail/prompt-assistant-ai-promp/khjjnklmccfmbidflahakjameliioidm)[![Version](https://img.shields.io/badge/V

Size: 42 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

yukinagae/genkitx-promptfoo

Community Plugin for Genkit to use Promptfoo

Language: TypeScript - Size: 553 KB - Last synced at: 18 days ago - Pushed at: 6 months ago - Stars: 4 - Forks: 0

TonicAI/tonic_validate

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Language: Python - Size: 6.2 MB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 302 - Forks: 30

parea-ai/parea-sdk-py

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

Language: Python - Size: 5.48 MB - Last synced at: about 6 hours ago - Pushed at: 4 months ago - Stars: 78 - Forks: 7

jaschadub/AgentNull

AgentNull: AI System Security Threat Catalog + Proof-of-Concepts. Collection of PoCs for using Agents, MCP, and RAG in bad ways.

Language: Python - Size: 146 KB - Last synced at: 5 days ago - Pushed at: 18 days ago - Stars: 1 - Forks: 0

TensorOpsAI/LLMstudio

Framework to bring LLM applications to production

Language: Python - Size: 38.1 MB - Last synced at: 19 days ago - Pushed at: 20 days ago - Stars: 334 - Forks: 38

ruankie/langfuse-monitoring-eval

Monitoring and evaluating LLM apps with Langfuse. Presented at PyConZA 2024.

Language: HTML - Size: 14.5 MB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 5 - Forks: 1

KusionStack/kusion

Declarative Intent Driven Platform Orchestrator for Internal Developer Platform (IDP).

Language: Go - Size: 9.75 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 1,128 - Forks: 90

missingstudio/gateway

[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications

Language: Go - Size: 4.14 MB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 159 - Forks: 18

relari-ai/continuous-eval

Data-Driven Evaluation for LLM-Powered Applications

Language: Python - Size: 1.92 MB - Last synced at: 9 days ago - Pushed at: 5 months ago - Stars: 497 - Forks: 35

phospho-app/text-analytics-legacy

Text analytics for LLM apps. Cluster messages to detect use cases, outliers, power users. Detect intents and run evals with LLM (OpenAI, MistralAI, Ollama, etc.)

Language: Python - Size: 36.7 MB - Last synced at: 15 days ago - Pushed at: about 1 month ago - Stars: 437 - Forks: 34

Kenza-AI/sagify

LLMs and Machine Learning done easily

Language: Python - Size: 36.1 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 439 - Forks: 69

manufactai/finetuning-cookbook

A collection of practical examples and tutorials for fine-tuning large language models using Factory. Includes Docker images, Jupyter notebooks, and utility scripts for easy model training and deployment.

Language: Jupyter Notebook - Size: 1.55 MB - Last synced at: 21 days ago - Pushed at: 22 days ago - Stars: 2 - Forks: 0

Opla/opla

Empower Your Productivity with Local AI Assistants

Language: TypeScript - Size: 59.7 MB - Last synced at: 1 day ago - Pushed at: 8 days ago - Stars: 36 - Forks: 3

Redtius/livekit-mcp-client

A Package That Gives Your Livekit agents the ability To use Model Context Protocol Tools

Language: Python - Size: 65.4 KB - Last synced at: 14 days ago - Pushed at: 29 days ago - Stars: 2 - Forks: 1

farbodbj/llm-overflow

๐Ÿ”ฅ LLM Overflow: Scalability Testing for Language Model APIs Benchmark Your LLM API's Performance Under Load with Precision Metrics

Language: Python - Size: 183 KB - Last synced at: 22 days ago - Pushed at: 23 days ago - Stars: 1 - Forks: 0

stanford-oval/chainlite

LangChain + LiteLLM that works

Language: Python - Size: 597 KB - Last synced at: 10 days ago - Pushed at: about 1 month ago - Stars: 44 - Forks: 6

leaf68saw/alith-kuu

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Size: 2.93 KB - Last synced at: 22 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0

ash-hun/ash-hun

๐Ÿ‘‹ Hi, I'm Ash (a.k.a. Ash-Hun)

Size: 675 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 1

LangGraph-GUI/LangGraph-GUI

Visual node-edge graph GUI editor for LangGraph and run with local LLM or online API

Language: TypeScript - Size: 190 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 175 - Forks: 17

OpenMachine-ai/transformer-tricks

A collection of tricks and tools to speed up transformer models

Language: TeX - Size: 8.17 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 166 - Forks: 10

GetSoloTech/solo-server

Server for Physical AI Inference

Language: Python - Size: 128 MB - Last synced at: 24 days ago - Pushed at: about 2 months ago - Stars: 241 - Forks: 19

epuerta9/kitchenai

Open Source LLMOps tool for AI teams

Language: Python - Size: 19.5 MB - Last synced at: 22 days ago - Pushed at: 4 months ago - Stars: 120 - Forks: 6

phantasmlabs/phantasm

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

Language: Svelte - Size: 782 KB - Last synced at: 25 days ago - Pushed at: 7 months ago - Stars: 176 - Forks: 5

ianarawjo/ChainForge

An open-source visual programming environment for battle-testing prompts to LLMs.

Language: TypeScript - Size: 184 MB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 2,624 - Forks: 214

microsoft/aici

AICI: Prompts as (Wasm) Programs

Language: Rust - Size: 9.71 MB - Last synced at: 28 days ago - Pushed at: 5 months ago - Stars: 2,027 - Forks: 83

morsoli/llm-books

ๅˆฉ็”จLLMๆž„ๅปบๅบ”็”จๅฎž่ทต็ฌ”่ฎฐ

Language: Python - Size: 6.06 MB - Last synced at: 27 days ago - Pushed at: 7 months ago - Stars: 717 - Forks: 48

jimyoshida/dx-devops-landscape

Overview of technologies and concepts for DX and DevOps, with history; A mirror of https://gitlab.com/jimyoshida/dx-devops-landscape

Language: JavaScript - Size: 319 KB - Last synced at: 10 days ago - Pushed at: 29 days ago - Stars: 5 - Forks: 0

onlyphantom/llm-python

Large Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone

Language: Jupyter Notebook - Size: 2.13 MB - Last synced at: 27 days ago - Pushed at: about 2 months ago - Stars: 835 - Forks: 283

trubrics/trubrics-python

Product analytics for AI Assistants

Language: Python - Size: 9.24 MB - Last synced at: 16 days ago - Pushed at: 30 days ago - Stars: 153 - Forks: 26

Scale3-Labs/langtrace

Langtrace ๐Ÿ” is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. ๐Ÿš€๐Ÿ’ป๐Ÿ“Š

Language: TypeScript - Size: 3.69 MB - Last synced at: 27 days ago - Pushed at: about 2 months ago - Stars: 933 - Forks: 89

prometheus-eval/prometheus-eval

Evaluate your LLM's response with Prometheus and GPT4 ๐Ÿ’ฏ

Language: Python - Size: 15.1 MB - Last synced at: 29 days ago - Pushed at: 2 months ago - Stars: 946 - Forks: 54

Cre4T3Tiv3/mindweave

Modular framework for orchestrating autonomous multi-agent systems with planning, memory, and tool use.

Language: Python - Size: 8.79 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

arcee-ai/arcee-python

The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/

Language: Python - Size: 257 KB - Last synced at: 17 days ago - Pushed at: 9 months ago - Stars: 27 - Forks: 4

raeudigerRaeffi/turbular

A MCP server allowing LLM agents to easily connect and retrieve data from any database

Language: Python - Size: 410 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 52 - Forks: 9

empirical-run/empirical

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

Language: TypeScript - Size: 1.58 MB - Last synced at: 7 days ago - Pushed at: 10 months ago - Stars: 157 - Forks: 12

sugarcane-ai/sugarcane-ai

npm like package ecosystem for Prompts ๐Ÿค–

Language: TypeScript - Size: 11.5 MB - Last synced at: 4 days ago - Pushed at: 5 months ago - Stars: 49 - Forks: 14

star-whale/starwhale

an MLOps/LLMOps platform

Language: Java - Size: 70.6 MB - Last synced at: 16 days ago - Pushed at: 6 months ago - Stars: 228 - Forks: 37

evidentlyai/ml_observability_course

Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.

Language: Jupyter Notebook - Size: 25.2 MB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 85 - Forks: 30

icestorm397qh/alith

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

deadbits/vigil-llm

โšก Vigil โšก Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

Language: Python - Size: 548 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 385 - Forks: 39

truefoundry/cognita

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

Language: Python - Size: 50.4 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 4,073 - Forks: 333

kubeagi/arcadia

A diverse, simple, and secure all-in-one LLMOps platform

Language: Go - Size: 27.6 MB - Last synced at: about 15 hours ago - Pushed at: 9 months ago - Stars: 105 - Forks: 27

drop13carlaste/alith

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

liguodongiot/llm-resource

LLMๅ…จๆ ˆไผ˜่ดจ่ต„ๆบๆฑ‡ๆ€ป

Language: Shell - Size: 53.7 KB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 554 - Forks: 66

zippoqutlaptor85/alith-14

Simple, Composable, High-Performance, Safe and Web3 Friendly AI Agents and LazAI Gateway for Everyone

Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

zenml-io/mcp-zenml

MCP server to connect an MCP client (Cursor, Claude Desktop etc) with your ZenML MLOps and LLMOps pipelines

Language: Python - Size: 559 KB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 18 - Forks: 8

aiplanethub/genai-stack ๐Ÿ“ฆ

An End to End GenAI Framework

Language: Jupyter Notebook - Size: 3.43 MB - Last synced at: 1 day ago - Pushed at: 12 months ago - Stars: 131 - Forks: 45

msoedov/langcorn

โ›“๏ธ Serving LangChain LLM apps and agents automagically with FastApi. LLMops

Language: Python - Size: 850 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 926 - Forks: 72

AgiFlow/agiflow-sdks

LLM QA, Observability, Evaluation and User Feedback

Language: TypeScript - Size: 2.5 MB - Last synced at: 22 days ago - Pushed at: 11 months ago - Stars: 23 - Forks: 1

athina-ai/athina-sdk

LLM Testing SDK that helps you write and run tests to monitor your LLM app in production

Language: Python - Size: 119 KB - Last synced at: 29 days ago - Pushed at: over 1 year ago - Stars: 130 - Forks: 1

decodingml/llm-twin-course

๐Ÿค– ๐—Ÿ๐—ฒ๐—ฎ๐—ฟ๐—ป for ๐—ณ๐—ฟ๐—ฒ๐—ฒ how to ๐—ฏ๐˜‚๐—ถ๐—น๐—ฑ an end-to-end ๐—ฝ๐—ฟ๐—ผ๐—ฑ๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป-๐—ฟ๐—ฒ๐—ฎ๐—ฑ๐˜† ๐—Ÿ๐—Ÿ๐—  & ๐—ฅ๐—”๐—š ๐˜€๐˜†๐˜€๐˜๐—ฒ๐—บ using ๐—Ÿ๐—Ÿ๐— ๐—ข๐—ฝ๐˜€ best practices: ~ ๐˜ด๐˜ฐ๐˜ถ๐˜ณ๐˜ค๐˜ฆ ๐˜ค๐˜ฐ๐˜ฅ๐˜ฆ + 12 ๐˜ฉ๐˜ข๐˜ฏ๐˜ฅ๐˜ด-๐˜ฐ๐˜ฏ ๐˜ญ๐˜ฆ๐˜ด๐˜ด๐˜ฐ๐˜ฏ๐˜ด

Language: Python - Size: 9.78 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 3,887 - Forks: 645

dr-gareth-roberts/LLM-Dev

Python Tools for Developing with LLMs (cloud & offline)

Language: Python - Size: 286 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

YeonwooSung/ai_book

AI book for everyone

Language: Jupyter Notebook - Size: 631 MB - Last synced at: 1 day ago - Pushed at: about 1 month ago - Stars: 28 - Forks: 5

Devinterview-io/llmops-interview-questions

๐ŸŸฃ LLMOps interview questions and answers to help you prepare for your next machine learning and data science interview in 2025.

Size: 30.3 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 13 - Forks: 2

pathwaycom/llm-app

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. ๐ŸณDocker-friendly.โšกAlways in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

Language: Jupyter Notebook - Size: 59.8 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 24,193 - Forks: 423

NEU-Solution/evaluating_cluster

Evaluation service of LLMOps

Language: Python - Size: 611 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0

TransformerOptimus/SuperAGI

<โšก๏ธ> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Language: Python - Size: 60.5 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 16,311 - Forks: 1,968

NEU-Solution/training_cluster

Training service of LLMOps

Language: Python - Size: 501 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 0