inference-api | Topic | Ecosyste.ms: Repos

roboflow/inference

Turn any computer or edge device into a command center for your computer vision projects.

Language: Python - Size: 181 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 2,119 - Forks: 235

basetenlabs/truss

The simplest way to serve AI/ML models in production

Language: Python - Size: 21 MB - Last synced at: 6 days ago - Pushed at: 8 days ago - Stars: 1,100 - Forks: 93

BMW-InnovationLab/BMW-TensorFlow-Training-GUI

This repository allows you to get started with a gui based training a State-of-the-art Deep Learning model with little to no configuration needed! NoCode training with TensorFlow has never been so easy.

Language: Python - Size: 260 MB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 979 - Forks: 164

quic/ai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Language: Python - Size: 261 MB - Last synced at: 18 days ago - Pushed at: 23 days ago - Stars: 867 - Forks: 151

quic/ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Language: Java - Size: 28 MB - Last synced at: 18 days ago - Pushed at: 22 days ago - Stars: 350 - Forks: 88

Michael-OvO/Yolov7-Flask

A Beautiful Flask Web API for Yolov7 (and custom) models

Language: Python - Size: 1.59 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 202 - Forks: 11

pszemraj/textsum

CLI & Python API to easily summarize text-based files with transformers

Language: Python - Size: 70.3 KB - Last synced at: 8 months ago - Pushed at: about 1 year ago - Stars: 129 - Forks: 8

mustafamerttunali/deep-learning-training-gui

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

Language: Python - Size: 393 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 120 - Forks: 31

inference-gateway/inference-gateway

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Language: Go - Size: 2.21 MB - Last synced at: 5 days ago - Pushed at: 15 days ago - Stars: 88 - Forks: 14

BMW-InnovationLab/BMW-Classification-Training-GUI

This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.

Language: Python - Size: 1.07 GB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 73 - Forks: 2

intelligencedev/eternal 📦

Eternal is an experimental platform for machine learning models and workflows.

Language: Go - Size: 73.9 MB - Last synced at: 9 months ago - Pushed at: 10 months ago - Stars: 68 - Forks: 5

Kardbord/hfapigo

Unofficial (Golang) Go bindings for the Hugging Face Inference API

Language: Go - Size: 3.35 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 62 - Forks: 5

BMW-InnovationLab/BMW-Classification-Inference-GPU-CPU

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

Language: Python - Size: 3.04 MB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 49 - Forks: 0

hupe1980/go-huggingface

🤗 Hugging Face Inference Client written in Go

Language: Go - Size: 64.5 KB - Last synced at: 9 months ago - Pushed at: almost 2 years ago - Stars: 48 - Forks: 6

Prismadic/magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Language: Python - Size: 11.8 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 31 - Forks: 3

TimMikeladze/huggingface 📦

Typescript wrapper for the Hugging Face Inference API.

Language: TypeScript - Size: 1.22 MB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 28 - Forks: 2

ferranpons/Llamatik

LLM inference library for Kotlin Multiplatform (Android, iOS and Desktop)

Language: HTML - Size: 137 MB - Last synced at: 1 day ago - Pushed at: 4 days ago - Stars: 26 - Forks: 1

stephanj/Llama3JavaChatCompletionService

Llama3.java Inference engine with OpenAI Chat Completion REST API/

Language: Java - Size: 146 KB - Last synced at: 8 months ago - Pushed at: 11 months ago - Stars: 25 - Forks: 2

decisionfacts/semantic-ai

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

Language: Python - Size: 4.53 MB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 22 - Forks: 1

TommyLemon/CVAuto

👁 零代码零标注 CV AI 自动化测试工具 🚀 免除大量人工画框和打标签等，直接零代码快速自动化测试 CV 计算机视觉 AI 人工智能图像识别算法：行人检测、动植物分类、人脸识别、OCR 车牌识别、旋转校正、舞蹈姿态、抠图分割等，还可一键下载测试报告、导出训练和测试数据集

Language: JavaScript - Size: 117 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 21 - Forks: 2

BorjaOteroFerreira/IALab-Suite

Tool for test diferents large language models without code.

Language: Python - Size: 30.6 MB - Last synced at: 26 days ago - Pushed at: 3 months ago - Stars: 19 - Forks: 0

yas-sim/openvino-ep-enabled-onnxruntime

Describing How to Enable OpenVINO Execution Provider for ONNX Runtime

Language: C++ - Size: 18.6 MB - Last synced at: 9 months ago - Pushed at: over 5 years ago - Stars: 19 - Forks: 1

RageAgainstThePixel/com.rest.huggingface

A Non-Official HuggingFace Rest Client for Unity (UPM)

Language: C# - Size: 2.28 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 1

jparkerweb/bedrock-proxy-endpoint

🔀 Bedrock Proxy Endpoint ⇢ Spin up your own custom OpenAI API server endpoint for easy AWS Bedrock inference (using standard baseUrl, and apiKey params)

Language: JavaScript - Size: 875 KB - Last synced at: 2 days ago - Pushed at: about 1 month ago - Stars: 15 - Forks: 6

kyryl-opens-ml/ml-in-production-practice

Practice for Machine Learning in Production course

Language: Python - Size: 11.3 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 12 - Forks: 5

shivamMg/stable-diffusion-on-azureml

REST APIs for StableDiffusion. Inferencing support on AzureML

Language: Jupyter Notebook - Size: 1.34 MB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 4

SaeedNajafi/infer-pytorch-pyspark

Coupling PySpark with PyTorch Models

Size: 130 KB - Last synced at: almost 2 years ago - Pushed at: almost 6 years ago - Stars: 11 - Forks: 6

LynxAIeu/goinfer

Local LLM proxy, DevOps friendly

Language: Go - Size: 3.73 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 8 - Forks: 2

PromptOn/prompton

Chat prompt template evaluation and inference monitoring

Language: Python - Size: 16.7 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 8 - Forks: 0

pandruszkow/whisper-inference-server

A networked inference server for Whisper speech recognition

Language: Python - Size: 9.77 KB - Last synced at: 2 months ago - Pushed at: 7 months ago - Stars: 8 - Forks: 0

defenseunicorns/leapfrogai-api 📦

LeapfrogAI API

Language: Python - Size: 551 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 2

gmkung/Cheemera

A Node.js backend that exposes a Typescript implementation of the deCheem inference engine.

Language: Python - Size: 7.09 MB - Last synced at: 6 months ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 2

sunra-ai/sunra-clients

Language: TypeScript - Size: 1.75 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 6 - Forks: 1

YAV-AI/NodeJS-Stable-Diffusion-XL-Base-1.0-Hugging-Face-Inference-API

A simple node.js example that generates an image using StableDiffusion via Hugging Face Inference API.

Language: JavaScript - Size: 297 KB - Last synced at: 9 months ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 1

geniusrise/text 📦

Text components powering LLMs & SLMs for geniusrise framework

Language: Python - Size: 15.6 MB - Last synced at: 23 days ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 2

pchandrasekaran1595/Computer-Vision-API-V2

Computer Vision API V2 - FastAPI & ONNX Models

Language: Python - Size: 143 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 4 - Forks: 0

ededddy/groq-api-rs

A Rust Client For groq Inference API

Language: Rust - Size: 77.1 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 3

QubridAI-Inc/qubrid-cookbook

A collection of recipes/notebooks showcasing use-cases of open-source models with Qubrid AI.

Language: Python - Size: 704 KB - Last synced at: 15 days ago - Pushed at: 20 days ago - Stars: 3 - Forks: 0

SocAIty/socaity

SDK for generative AI.

Language: Python - Size: 28.2 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

lordofthejars-ai/event-driven-ai

Language: HTML - Size: 4.67 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

scattering-ai/MLDrop

MLDrop model serving for Pytorch

Size: 33.2 KB - Last synced at: 23 days ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0

ChildishGirl/monitoring-lambda-ml-inference

Monitor Lambda ML inference with CloudWatch Dashboard using AWS CDK (Python)

Language: Python - Size: 265 KB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

RamboRogers/cyber-inference

Cyber-Inference is a web GUI management tool for running OpenAI-compatible inference servers. Built on llama.cpp, it provides automatic model management, dynamic resource allocation, and a beautiful cyberpunk-themed interface designed for edge deployment.

Language: Python - Size: 1.69 MB - Last synced at: 15 days ago - Pushed at: 16 days ago - Stars: 2 - Forks: 0

Trojan3877/Facial-Emotion-Recognition-System

The **Facial Emotion Recognition System** is a robust computer vision pipeline that detects and classifies human emotions (e.g., happy, sad, angry, surprised) from facial images and video streams. It leverages transfer learning with state-of-the-art convolutional neural networks (e.g., ResNet, EfficientNet) in PyTorch, fine-tuned on the FER2013 ben

Language: Python - Size: 22.1 MB - Last synced at: 23 days ago - Pushed at: 25 days ago - Stars: 2 - Forks: 0

RichNasz/vLLMSwiftApp

Contains a simple macOS/iOS chatbot connection to vLLM using llama-stack or OpenAI APIs

Language: Swift - Size: 454 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

yas-sim/OpenVINO_Asynchronous_API_Performance_Demo

This project demonstrates the high performance of OpenVINO asynchronous inference API

Language: Python - Size: 28.5 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

pchandrasekaran1595/Computer-Vision-API 📦

Computer VIsion API built using FastAPI and pretrained models converted to ONNX format

Language: Python - Size: 39.9 MB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 0

xx025/cvmd

A Computer Vision Model Development toolkit. cvmd uses NumPy arrays as both input and output, aiming to provide a unified and concise model inference interface.

Language: Python - Size: 497 KB - Last synced at: 1 day ago - Pushed at: 3 days ago - Stars: 1 - Forks: 0

Twixie5/OpenVINO_Asynchronous_API_Performance_Demo

This project demonstrates the high performance of OpenVINO asynchronous inference API

Language: Python - Size: 28.5 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 1 - Forks: 0

pablo-reyes8/unet3d-medseg

End-to-end UNet3D stack for volumetric medical segmentation: training utilities, FastAPI inference API, Streamlit review UI, Docker deployment, and a model card. Upload NIfTI volumes, get masks back, and visualize slices/IoU plots from experiments. Built for reproducible research and production-grade serving

Language: Python - Size: 452 KB - Last synced at: 24 days ago - Pushed at: 26 days ago - Stars: 1 - Forks: 0

tmcarmichael/fabricai-inference-server

A hackable, modular, containerized inference server for deploying large language models in local or hybrid environments.

Language: Python - Size: 190 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

adv-11/SmallLanguageModelsPOC

Use this app to run any Hugging Face model you want with a StreamlitUI . Adding a model requires only +3 Lines of addition :D

Language: Python - Size: 60.5 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

bilguun0203/buuz-api

Автомат бууз тоологчийн inference API 🥟

Language: Python - Size: 21.5 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

extrawest/flutter-podcast-to-blog-ai-app

This app is designed to provide a way to cooperate with PodcastIndex.org. You can listen to podcasts, get text version, short summary, audio file based on summary, and AI chat on the subject of podcast

Language: Dart - Size: 9.19 MB - Last synced at: 9 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

M-YasirGhaffar/flux.1-schnell-ai-image-generator

FLUX.1-schnell is a state-of-the-art image generation tool powered by an AI model from Black Forest Labs, available through Hugging Face’s inference API. Generate high-quality, unique images from text prompts with ease. This application is a MERN stack implementation of the model.

Language: JavaScript - Size: 111 KB - Last synced at: 6 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

peb-peb/shravan

Unlocking Value from Customer Call Data

Language: Python - Size: 41 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

dimdasci/apartment-price-model

A pricing model, which can predict the acceptable per night price for Airbnb apartment based on its properties and the offered amenities

Language: Jupyter Notebook - Size: 38.6 MB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

LaurentVeyssier/Dynamic_risk_assessment_system

Project #4 from Udacity's ML DevOps engineer Nanodegree

Language: Jupyter Notebook - Size: 283 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

fractal360/EEG-MI-API

Inference-only FastAPI service for EEG motor-imagery classification using CSP features and an LDA model.

Language: Python - Size: 167 KB - Last synced at: 13 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

boozallen/aissemble-open-inference-protocol

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference.

Language: Python - Size: 1.95 MB - Last synced at: 17 days ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0

Jayaragul/INFERENCING-LLM-LAMA

⚡ A privacy-first, local AI platform with Agentic capabilities (Web Search, RAG, Tools). Runs entirely offline using Ollama & FastAPI. 🦙🔒

Language: Python - Size: 610 KB - Last synced at: 25 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

pogzyb/llmabda

Run llama.cpp server on aws lambda for cheap

Language: HCL - Size: 174 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Sameeh07/Code_Generator

Tool to convert Python code to high-performance C++ code using Opensource model

Language: Jupyter Notebook - Size: 13.7 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

ai4os-hub/diamorph-detection

Diamorph object detection

Language: Dockerfile - Size: 523 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

samoilenkoalex/flutter-podcast-to-blog-ai-app

This app is designed to provide a way to cooperate with PodcastIndex.org. You can listen to podcasts, get text version, short summary, audio file based on summary, and AI chat on the subject of podcast

Language: Dart - Size: 9.19 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

davidmontoyago/pulumi-gcp-ai-endpoint

Deploy a model and an internet-facing Vertex AI endpoint for real-time predictions with Pulumi and Go.

Language: Go - Size: 21.5 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

pchandrasekaran1595/Yolo-Inference-API

Yolo Inference API built using FastAPI

Language: Python - Size: 211 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

53gf4u1t/liteflow-python

The Python SDK for LiteFlow - a platform to easily build production-grade yet cost efficient apps.

Language: Python - Size: 12.7 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

amotivv-inc/memory-box-inference

Enterprise AI Governance Platform: A secure, multi-tenant infrastructure for LLM deployment with comprehensive authentication, cost management, usage analytics, and semantic memory integration. Transforms stateless LLM calls into an organizational AI brain that gets smarter over time.

Language: Python - Size: 182 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0