GitHub topics: onnx-runtime

Repositories

Shannon-Data/ShannonBase

The Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.

Language: C++ - Size: 716 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 126 - Forks: 18

snakers4/silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

Language: Python - Size: 115 MB - Last synced at: 6 days ago - Pushed at: 8 days ago - Stars: 7,772 - Forks: 710

dme-compunet/YoloSharp

🚀 A high performance real-time object detection solution using YOLO11 ⚡️ powered by ONNX-Runtime

Language: C# - Size: 63 MB - Last synced at: 4 days ago - Pushed at: 14 days ago - Stars: 509 - Forks: 88

royshil/obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Language: C++ - Size: 99.2 MB - Last synced at: 7 days ago - Pushed at: 9 days ago - Stars: 4,010 - Forks: 256

KvaytG/ru-chat-bot

An intelligent chatbot.

Language: Python - Size: 3.71 MB - Last synced at: 7 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

KvaytG/ru-toxicity-detector

A simple toxicity detector.

Language: Python - Size: 732 KB - Last synced at: 11 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0

FaceONNX/FaceONNX

Face recognition and analytics library based on deep neural networks and ONNX runtime

Language: C# - Size: 19.7 MB - Last synced at: 16 days ago - Pushed at: 19 days ago - Stars: 261 - Forks: 46

NickSwardh/YoloDotNet

YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and live video streams.

Language: C# - Size: 421 MB - Last synced at: 22 days ago - Pushed at: 24 days ago - Stars: 660 - Forks: 117

PT-Perkasa-Pilar-Utama/ppu-yolo-onnx-inference

Easily run YOLOv11 object detection models in a TypeScript Bun environment. No Python, PyTorch, or heavy dependencies needed.

Language: TypeScript - Size: 8.91 MB - Last synced at: 24 days ago - Pushed at: 26 days ago - Stars: 35 - Forks: 2

PT-Perkasa-Pilar-Utama/ppu-uniface

A type-safe, opinionated port of python's uniface: A Comprehensive Library for Face Detection, Recognition

Language: TypeScript - Size: 96.1 MB - Last synced at: 30 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0

STAR-REIN/ONNX-Detect

A general object detection application supporting ONNX models, image/video/camera inputs, with one-shot and real-time inference modes, and an intuitive GUI.

Language: Python - Size: 4.99 MB - Last synced at: 9 days ago - Pushed at: 11 days ago - Stars: 2 - Forks: 0

nbigaouette/onnxruntime-rs

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

Language: Rust - Size: 568 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 315 - Forks: 104

FilipFan/PolyEngineInfer

Run LLM inference in an Android app with llama.cpp, ExecuTorch, LiteRT, ONNX, and more.

Language: Kotlin - Size: 42.3 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 1

triton-inference-server/onnxruntime_backend

The Triton backend for the ONNX Runtime.

Language: C++ - Size: 282 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 168 - Forks: 74

Graiphic/Nest

Sovereign AI for smart, self-learning buildings • Edge-native • 25–35 % energy savings

Size: 1.35 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

umitkacar/sam2-edge-cpp

Real-time SAM2 segmentation on edge devices - 40x faster C++ inference with ONNX Runtime for iOS/Android deployment

Language: C++ - Size: 65.8 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

namas191297/rtmo-ort

RTMO pose estimation with pure ONNX Runtime — tiny class + CLI (webcam/image/video). Models via Releases. No MMPose/MMDeploy.

Language: Python - Size: 22.2 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 5 - Forks: 0

Maxime-Cllt/yolo-rs

A Rust runtime for YOLOv8 and YOLOv10 object detection using ONNX Runtime

Language: Rust - Size: 13.4 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Ave-Sergeev/Dictator

Offline STT & VAD Service (Rust, Tonic) (Q1:2025)

Language: Rust - Size: 49.3 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 8 - Forks: 0

emptysoal/tensorrt-experiment

Base on tensorrt version 8.2.4, compare inference speed for different tensorrt api.

Language: Python - Size: 92.1 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 50 - Forks: 4

josephrocca/super-resolution-js

SOTA image super-resolution in JavaScript/Wasm using an ONNX-ported SwinIR model

Language: HTML - Size: 47.9 KB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 35 - Forks: 9

mehdi-jafarov/mehdi-jafarov.github.io

My personal website.

Language: CSS - Size: 63.5 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

jobergum/browser-ml-inference

Edge Inference in Browser with Transformer NLP model

Language: Jupyter Notebook - Size: 77.5 MB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 314 - Forks: 57

dineshsoudagar/local-llms-on-android

Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat - powered by ONNX Runtime.

Language: Kotlin - Size: 23.3 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 24 - Forks: 4

CartesianXR7/scout-vision

Real-time computer vision for embedded Rust with OpenCV and YOLOv8 built with resource-constrained devices such as the Raspberry Pi Zero 2W in mind.

Language: Makefile - Size: 351 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

High-performance C++17 engine for real-time, stateful log anomaly detection. Uses a multi-tiered system combining heuristics, statistical Z-scores, and ONNX machine learning to find threats. Features flexible alerting (JSON, Syslog, HTTP) and live configuration reloading for operational maturity.

Language: C++ - Size: 8.64 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

johnnyau19/load-balancer

Inspired by checkout line assignments, this project simulates advanced load balancing in cloud systems, using reinforcement learning to assign jobs with uncertain workloads across servers.

Language: Python - Size: 350 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

Mobile-Artificial-Intelligence/babylon.cpp

Babylon.cpp is a C and C++ library for grapheme to phoneme conversion and text to speech synthesis. For phonemization a ONNX runtime port of the DeepPhonemizer model is used. For speech synthesis VITS models are used. Piper models are compatible after a conversion script is run.

Language: Python - Size: 324 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 23 - Forks: 3

LIU42/FlowerClassify

基于 ResNet 的花卉分类识别系统。

Language: Python - Size: 7.81 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 27 - Forks: 1

HexaForge-1/highperf-ai-ml-inference

High-perf C++ AI/ML inference engine with ONNX Runtime & LibTorch. CPU default, GPU opt-in. CLI + REST API, cross-platform via CMake/Docker. Auto-fetch models/assets, CUDA runtime check, CI merge gating, future multi-model & GPU training support.

Language: C++ - Size: 19.5 KB - Last synced at: 4 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

itlab-vision/dl-benchmark

Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apache TVM, ncnn, PaddlePaddle, etc.

Language: HTML - Size: 141 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 32 - Forks: 38

jonathanpeppers/inclusive-code-reviews-ml

Machine learning for code reviews!

Language: C# - Size: 18 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 16 - Forks: 7

zz990099/EasyDeploy

C++ implementations of YOLOv8, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.

Language: C++ - Size: 33.3 MB - Last synced at: 5 months ago - Pushed at: 7 months ago - Stars: 27 - Forks: 2

RolandoAndrade/D-FINE-onnx-runtime

This repository contains the code to run the D-FINE object detection model using ONNX Runtime in a Node.js environment. The script processes an input image, performs inference to detect objects, and saves the image with bounding boxes drawn around the detected objects

Language: JavaScript - Size: 31.2 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

alinabil74568/onnxruntime

ONNX Runtime is a powerful tool for accelerating machine learning tasks across various platforms. It enhances both inference and training, making it easier to deploy models from popular frameworks like PyTorch and TensorFlow. 🐙💻

Language: Dockerfile - Size: 9.77 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Fayzan6717/ppu-yolo-onnx-inference

Easily integrate YOLOv11 object detection into your TypeScript projects without heavy dependencies. This library supports multiple instances, allowing for efficient and independent inference sessions. 🐙✨

Language: TypeScript - Size: 98.6 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

ZygoteCode/RmbgSharp

Enterprise-unique blazing-fast & precise C# .NET 9.0 library for background removal in C# using ONNX Runtime with DirectML. FP32 and FP16 versions! Always open for PRs.

Language: C# - Size: 7.81 KB - Last synced at: 5 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

chinoll/deepdanbooru_onnx

Easy-to-use danbooru anime image classification model

Language: Python - Size: 25.4 KB - Last synced at: 4 months ago - Pushed at: over 3 years ago - Stars: 28 - Forks: 1

JavaAIDev/bird-classifier

Bird classifier using Onnx Java runtime

Language: Java - Size: 29.2 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 2 - Forks: 0

ZygoteCode/VadSharp

Enterprise VAD (Voice Activity Detection) in C#.NET (.NET 6.0+) with Microsoft.ML.Net, ONNXRuntime and DirectML. The easiest, efficient, and performant Silero VAD implementation! Always open for PRs.

Language: C# - Size: 354 KB - Last synced at: 6 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 1

pranta-barua007/yolo11s-seg-web-onnx

Language: TypeScript - Size: 33.8 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

belajarqywok/onnxruntime_go

[ Thesis Part ] A Go (golang) library wrapping microsoft/onnxruntime [for onnx version: 1.21] [just in case a problem occurs]

Language: Go - Size: 91.7 MB - Last synced at: 6 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

NANEXLABS/Nanex-AI

Enterprise multi-agent framework for secure, borderless data collaboration with zero-trust and federated learning-lightweight edge-ready.

Language: Python - Size: 119 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 4 - Forks: 0

ykumards/dwriter

A minimalist journal written in React with emotion detection

Language: JavaScript - Size: 12 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0

nidhiyashwanth/onnx-runtime-web-mnist

Vibe code a project demonstrates how to run machine learning models using the ONNX Runtime Web framework.

Language: JavaScript - Size: 74.7 MB - Last synced at: 7 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

pranta-barua007/yolo11-segment-onnx

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

NoWon1/LexiFlow

Dyslexia-Friendly AI Reading Coach: Empowering Inclusive Web Browsing

Language: TypeScript - Size: 18.5 MB - Last synced at: 9 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 2

renesas-rz/meta-renesas-ai

Renesas RZ/G AI BSP

Language: Shell - Size: 578 MB - Last synced at: 10 months ago - Pushed at: about 1 year ago - Stars: 25 - Forks: 14

light-magician/rust-ml-inference

A library for running GPU accelerated Neural Networks on the web via webassembly. Train your Neural Net in PyTorch, convert it to ONNX, then do GPU accelerated inference on it via rust WASM.

Language: Jupyter Notebook - Size: 349 KB - Last synced at: 10 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

kaiidams/Voice100AndroidApp

Voice100 Android App is a TTS/ASR sample app that uses ONNX Runtime and Voice100 neural TTS/ASR models on Xamarin. Inference of Voice100 is low cost as its models are tiny and only depend on CNN without recursion.

Language: C# - Size: 82.8 MB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 2

HoangHPham/Table-Detection-From-YOLOv7-to-Flask

A Flask app that detects table using ONNX model exported from YOLOv7

Language: Python - Size: 554 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

ms-iot/ros_msft_onnx 📦

ONNX Runtime for the Robot Operating System (ROS), works on ROS1 and ROS2

Language: C++ - Size: 9.47 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 35 - Forks: 12

M-M-Akash/Real-Time-Object-Detection-Distance-Measurement-System

Language: Python - Size: 80.6 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 1

EWAalEx/PhishTackle-API

PhishTackle-API is a powerful machine learning-driven API designed to combat phishing attacks by analysing email content and URLs. Using machine learning algorithms, this API offers superior phishing detection to enhance your email security. Integrate PhishTackle-API into your applications to help detect and prevent phishing threats.

Language: JavaScript - Size: 96.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

Yulv-git/Model-Inference-Deployment

A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.

Language: Python - Size: 125 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 32 - Forks: 6