inference-api | Topic | Ecosyste.ms: Repos

Topic: "inference-api"

roboflow/inference

Turn any computer or edge device into a command center for your computer vision projects.

Language: Python - Size: 129 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,735 - Forks: 188

basetenlabs/truss

The simplest way to serve AI/ML models in production

Language: Python - Size: 17.2 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,002 - Forks: 85

BMW-InnovationLab/BMW-TensorFlow-Training-GUI

This repository allows you to get started with a gui based training a State-of-the-art Deep Learning model with little to no configuration needed! NoCode training with TensorFlow has never been so easy.

Language: Python - Size: 260 MB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 980 - Forks: 163

quic/ai-hub-models

The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Language: Python - Size: 255 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 709 - Forks: 115

quic/ai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Language: Java - Size: 27.9 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 210 - Forks: 50

Michael-OvO/Yolov7-Flask

A Beautiful Flask Web API for Yolov7 (and custom) models

Language: Python - Size: 1.59 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 202 - Forks: 11

SearchSavior/OpenArc

Lightweight Inference server for OpenVINO

Language: Python - Size: 2.33 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 186 - Forks: 5

pszemraj/textsum

CLI & Python API to easily summarize text-based files with transformers

Language: Python - Size: 70.3 KB - Last synced at: 29 days ago - Pushed at: 7 months ago - Stars: 129 - Forks: 8

mustafamerttunali/deep-learning-training-gui

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

Language: Python - Size: 393 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 120 - Forks: 31

BMW-InnovationLab/BMW-Classification-Training-GUI

This repository allows you to get started with training a State-of-the-art Deep Learning model with little to no configuration needed! You provide your labeled dataset and you can start the training right away. You can even test your model with our built-in Inference REST API. Training classification models with GluonCV has never been so easy.

Language: Python - Size: 1.07 GB - Last synced at: 7 days ago - Pushed at: about 3 years ago - Stars: 73 - Forks: 2

intelligencedev/eternal 📦

Eternal is an experimental platform for machine learning models and workflows.

Language: Go - Size: 73.9 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 68 - Forks: 5

Kardbord/hfapigo

Unofficial (Golang) Go bindings for the Hugging Face Inference API

Language: Go - Size: 3.35 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 62 - Forks: 5

BMW-InnovationLab/BMW-Classification-Inference-GPU-CPU

This is a repository for an image classification inference API using the Gluoncv framework. The inference REST API works on CPU/GPU. It's supported on Windows and Linux Operating systems. Models trained using our Gluoncv Classification training repository can be deployed in this API. Several models can be loaded and used at the same time.

Language: Python - Size: 3.04 MB - Last synced at: 7 days ago - Pushed at: about 3 years ago - Stars: 49 - Forks: 0

hupe1980/go-huggingface

🤗 Hugging Face Inference Client written in Go

Language: Go - Size: 64.5 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 48 - Forks: 6

inference-gateway/inference-gateway

An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

Language: Go - Size: 1.71 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 34 - Forks: 1

Prismadic/magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

Language: Python - Size: 11.8 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 31 - Forks: 3

TimMikeladze/huggingface 📦

Typescript wrapper for the Hugging Face Inference API.

Language: TypeScript - Size: 1.22 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 2

stephanj/Llama3JavaChatCompletionService

Llama3.java Inference engine with OpenAI Chat Completion REST API/

Language: Java - Size: 146 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 25 - Forks: 2

decisionfacts/semantic-ai

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

Language: Python - Size: 4.53 MB - Last synced at: 2 days ago - Pushed at: 11 months ago - Stars: 21 - Forks: 1

yas-sim/openvino-ep-enabled-onnxruntime

Describing How to Enable OpenVINO Execution Provider for ONNX Runtime

Language: C++ - Size: 18.6 MB - Last synced at: about 2 months ago - Pushed at: almost 5 years ago - Stars: 19 - Forks: 1

BorjaOteroFerreira/IALab-Suite

Tool for test diferents large language models without code.

Language: JavaScript - Size: 28.5 MB - Last synced at: 2 days ago - Pushed at: 5 months ago - Stars: 18 - Forks: 0

RageAgainstThePixel/com.rest.huggingface

A Non-Official HuggingFace Rest Client for Unity (UPM)

Language: C# - Size: 2.28 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 1

kyryl-opens-ml/ml-in-production-practice

Practice for Machine Learning in Production course

Language: Python - Size: 11.3 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 12 - Forks: 5

shivamMg/stable-diffusion-on-azureml

REST APIs for StableDiffusion. Inferencing support on AzureML

Language: Jupyter Notebook - Size: 1.34 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 11 - Forks: 4

SaeedNajafi/infer-pytorch-pyspark

Coupling PySpark with PyTorch Models

Size: 130 KB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 11 - Forks: 6

jparkerweb/bedrock-proxy-endpoint

🔀 Bedrock Proxy Endpoint ⇢ Spin up your own custom OpenAI API server endpoint for easy AWS Bedrock inference (using standard baseUrl, and apiKey params)

Language: JavaScript - Size: 509 KB - Last synced at: 2 days ago - Pushed at: 17 days ago - Stars: 9 - Forks: 5

pandruszkow/whisper-inference-server

A networked inference server for Whisper speech recognition

Language: Python - Size: 6.84 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 8 - Forks: 0

defenseunicorns/leapfrogai-api 📦

LeapfrogAI API

Language: Python - Size: 551 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 8 - Forks: 2

gmkung/Cheemera

A Node.js backend that exposes a Typescript implementation of the deCheem inference engine.

Language: Python - Size: 7.09 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 2

PromptOn/prompton

Chat prompt template evaluation and inference monitoring

Language: Python - Size: 16.7 MB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 0

YAV-AI/NodeJS-Stable-Diffusion-XL-Base-1.0-Hugging-Face-Inference-API

A simple node.js example that generates an image using StableDiffusion via Hugging Face Inference API.

Language: JavaScript - Size: 297 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 1

geniusrise/text

Text components powering LLMs & SLMs for geniusrise framework

Language: Python - Size: 15.6 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 5 - Forks: 2

ededddy/groq-api-rs

A Rust Client For groq Inference API

Language: Rust - Size: 77.1 KB - Last synced at: 26 days ago - Pushed at: 12 months ago - Stars: 3 - Forks: 3

lordofthejars-ai/event-driven-ai

Language: HTML - Size: 4.67 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

pchandrasekaran1595/Computer-Vision-API-V2

Computer Vision API V2 - FastAPI & ONNX Models

Language: Python - Size: 143 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1

scattering-ai/MLDrop

MLDrop model serving for Pytorch

Size: 33.2 KB - Last synced at: 25 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

ChildishGirl/monitoring-lambda-ml-inference

Monitor Lambda ML inference with CloudWatch Dashboard using AWS CDK (Python)

Language: Python - Size: 265 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

yas-sim/OpenVINO_Asynchronous_API_Performance_Demo

This project demonstrates the high performance of OpenVINO asynchronous inference API

Language: Python - Size: 28.5 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

SocAIty/socaity

SDK for generative AI.

Language: Python - Size: 24.2 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

pchandrasekaran1595/Computer-Vision-API 📦

Computer VIsion API built using FastAPI and pretrained models converted to ONNX format

Language: Python - Size: 39.9 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

RichNasz/vLLMSwiftApp

Contains a simple macOS/iOS chatbot connection to vLLM using llama-stack or OpenAI APIs

Language: Swift - Size: 68.4 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

tmcarmichael/fabricai-inference-server

A hackable, modular, containerized inference server for deploying large language models in local or hybrid environments.

Language: Python - Size: 190 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

bilguun0203/buuz-api

Автомат бууз тоологчийн inference API 🥟

Language: Python - Size: 21.5 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

extrawest/flutter-podcast-to-blog-ai-app

This app is designed to provide a way to cooperate with PodcastIndex.org. You can listen to podcasts, get text version, short summary, audio file based on summary, and AI chat on the subject of podcast

Language: Dart - Size: 9.19 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

M-YasirGhaffar/flux.1-schnell-ai-image-generator

FLUX.1-schnell is a state-of-the-art image generation tool powered by an AI model from Black Forest Labs, available through Hugging Face’s inference API. Generate high-quality, unique images from text prompts with ease. This application is a MERN stack implementation of the model.

Language: JavaScript - Size: 111 KB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0