GitHub topics: onnxruntime

Repositories

thewh1teagle/kokoro-onnx

TTS with kokoro and onnx runtime

Language: Python - Size: 411 KB - Last synced at: about 4 hours ago - Pushed at: about 1 month ago - Stars: 2,031 - Forks: 197

dirkjbosman/ml-inference-benchmarks

Compare inference performance of ML models across C++ vs Python

Language: C++ - Size: 14.6 KB - Last synced at: about 6 hours ago - Pushed at: about 7 hours ago - Stars: 0 - Forks: 0

pykeio/ort

Fast ML inference & training for ONNX models in Rust

Language: Rust - Size: 6.43 MB - Last synced at: about 3 hours ago - Pushed at: 5 days ago - Stars: 1,346 - Forks: 136

⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

Language: C++ - Size: 38.6 MB - Last synced at: about 16 hours ago - Pushed at: about 16 hours ago - Stars: 3,203 - Forks: 477

PhamHuynhAnh16/Vietnamese-RVC

Dự án công cụ chuyển đổi giọng nói dành cho người Việt

Language: Python - Size: 6.94 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 0

ibaiGorordo/ONNX-SAM2-Segment-Anything

Python scripts for the Segment Anythin 2 (SAM2) model in ONNX

Language: Python - Size: 13.1 MB - Last synced at: about 9 hours ago - Pushed at: 10 months ago - Stars: 250 - Forks: 15

Kazuhito00/Image-Processing-Node-Editor

処理の検証や比較検討での用途を想定したノードエディターベースの画像処理アプリ(A node editor-based image processing application intended for use in processing verification and comparison studies)

Language: Python - Size: 393 MB - Last synced at: 1 day ago - Pushed at: about 1 month ago - Stars: 536 - Forks: 77

rnchg/Apt

AI Productivity Tool - Free and open source, improve user productivity, protect privacy and data security. Provide efficient and convenient AI solutions, built-in local exclusive ChatGPT, Phi, DeepSeek, one-click batch intelligent processing of pictures, videos, audio, etc.

Language: C# - Size: 358 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 691 - Forks: 74

menloresearch/cortex.cpp

Local AI API Platform

Language: C++ - Size: 139 MB - Last synced at: 2 days ago - Pushed at: 25 days ago - Stars: 2,726 - Forks: 170

lemonade-sdk/lemonade

Local LLM Server with NPU Acceleration

Language: Python - Size: 2.92 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 41 - Forks: 6

Telosnex/fonnx

ONNX runtime for Flutter.

Language: Dart - Size: 101 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 273 - Forks: 20

StarlightSearch/EmbedAnything

Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Language: Rust - Size: 30.5 MB - Last synced at: 3 days ago - Pushed at: 6 days ago - Stars: 601 - Forks: 52

RapidAI/RapidOCR

📄 Awesome OCR multiple programing languages toolkits based on ONNXRuntime, OpenVINO, PaddlePaddle and PyTorch.

Language: Python - Size: 19.7 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 4,229 - Forks: 450

PINTO0309/sit4onnxw

Tools for simple inference testing using CPU, WebGL, WebGPU. Simple Inference Test for onnxruntime-web.

Language: Python - Size: 17.6 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

ibaiGorordo/ONNX-Unidepth-Monocular-Metric-Depth-Estimation

Python scripts performing Metric Monocular Depth Estimation using the Unidepth model in ONNX.

Language: Python - Size: 17.2 MB - Last synced at: about 9 hours ago - Pushed at: 11 months ago - Stars: 86 - Forks: 5

huggingface/optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

Language: Python - Size: 5.52 MB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 2,934 - Forks: 542

royshil/obs-backgroundremoval

An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.

Language: C++ - Size: 84.5 MB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 3,351 - Forks: 224

doondigangadhar30/Ghiblify-AnimeGANv3

A creative tool that generates beautiful Ghibli-style artwork from your image input.

Language: Jupyter Notebook - Size: 5.5 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

georg-jung/FaceAiSharp

State-of-the-art face detection and face recognition for .NET.

Language: C# - Size: 1.52 MB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 93 - Forks: 13

microsoft/ai-dev-gallery

An open-source project for Windows developers to learn how to add AI with local models and APIs to Windows apps.

Language: C# - Size: 38.4 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,094 - Forks: 137

sinterwong/android-infer-sdk

This is a cross-platform inference SDK for Android. It supports ONNX Runtime and NCNN.

Language: C++ - Size: 599 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2 - Forks: 0

felixdittrich92/docling-OCR-OnnxTR

OnnxTR OCR plugin for Docling

Language: Python - Size: 1.47 MB - Last synced at: 3 days ago - Pushed at: 13 days ago - Stars: 7 - Forks: 0

TensorStack-AI/OnnxStack 📦

C# Stable Diffusion using ONNX Runtime

Language: C# - Size: 90.3 MB - Last synced at: about 4 hours ago - Pushed at: 12 months ago - Stars: 229 - Forks: 37

felixdittrich92/OnnxTR

OnnxTR a docTR (Document Text Recognition) library Onnx pipeline wrapper - for seamless, high-performing & accessible OCR

Language: Python - Size: 2.93 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 116 - Forks: 9

zhiqwang/yolort

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Language: Python - Size: 22.9 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 730 - Forks: 152

thewh1teagle/vad-rs

Speech detection using silero vad in Rust

Language: Rust - Size: 140 KB - Last synced at: about 4 hours ago - Pushed at: 6 months ago - Stars: 22 - Forks: 4

ZygoteCode/RmbgSharp

Enterprise-unique blazing-fast & precise C# .NET 9.0 library for background removal in C# using ONNX Runtime with DirectML. FP32 and FP16 versions! Always open for PRs.

Language: C# - Size: 7.81 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Puiching-Memory/GM-OnnxRuntime

OnnxRuntime for GameMaker

Language: C++ - Size: 132 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

thewh1teagle/pyannote-rs

pyannote audio diarization in rust

Language: Rust - Size: 141 KB - Last synced at: about 4 hours ago - Pushed at: 6 months ago - Stars: 64 - Forks: 9

jamjamjon/usls

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.

Language: Rust - Size: 22.6 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 167 - Forks: 22

orchidsziyou/astrbot_plugin_seiadetect

用于检测发送的图片是否含有百合园圣娅

Language: Python - Size: 166 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

huggingface/optimum-benchmark

🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

Language: Python - Size: 8.3 MB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 302 - Forks: 58

cansik/onnxruntime-silicon

ONNX Runtime prebuilt wheels for Apple Silicon (M1 / M2 / M3 / ARM64)

Language: Shell - Size: 15.6 KB - Last synced at: 2 days ago - Pushed at: 11 months ago - Stars: 214 - Forks: 18

ibelem/web-ai-test

Web AI

Language: JavaScript - Size: 832 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 5 - Forks: 3

eloy13rayo/st-kjv-vis

A collection of King James Version (KJV) Bible analysis and visualization

Size: 1.95 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

yuzawa-san/onnxruntime-java

A type-safe, lightweight, modern, and performant binding Java binding of Microsoft's ONNX Runtime

Language: Java - Size: 2.44 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 25 - Forks: 0

idsia-robotics/navground_onnx

Provides a C++ navigation behavior that evaluates a ONNX model.

Language: C++ - Size: 492 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

NobuoTsukamoto/meta-onnxruntime

Yocto layer for ONNX Runtime.

Language: BitBake - Size: 93.8 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 3

pyronear/pyro-engine

Wildfire detection on edge devices

Language: Python - Size: 6.94 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 8 - Forks: 6

neodyland/sbv2-api

Infer only tts

Language: Rust - Size: 4.56 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 37 - Forks: 6

helloooideeeeea/RealTimeCutVADLibraryForAndroid

Real-time Voice Activity Detection (VAD) library for Android using Silero models powered by ONNX Runtime. Includes advanced noise suppression and audio preprocessing with WebRTC APM, supporting seamless WAV data output with header metadata.

Language: Kotlin - Size: 4.09 MB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

PaddlePaddle/Paddle2ONNX

ONNX Model Exporter for PaddlePaddle

Language: C++ - Size: 5.55 MB - Last synced at: 6 days ago - Pushed at: 14 days ago - Stars: 821 - Forks: 178

sevagh/basicpitch.cpp

C++20 inference for Spotify's basic-pitch AMT/MIDI generator model with ONNXRuntime and libremidi

Language: C++ - Size: 1.12 MB - Last synced at: 1 day ago - Pushed at: 7 months ago - Stars: 22 - Forks: 1

LolipopJ/dupimg-finder

A tool to find duplicate image pairs or the most similar images of target image in your file system.

Language: TypeScript - Size: 911 KB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

thewh1teagle/dicta-onnx

Add diacritics to Hebrew text using Dicta model

Language: Python - Size: 222 KB - Last synced at: about 4 hours ago - Pushed at: 10 days ago - Stars: 8 - Forks: 0

deepjavalibrary/djl

An Engine-Agnostic Deep Learning Framework in Java

Language: Java - Size: 46.5 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 4,484 - Forks: 700

gutenye/ocr

High accurate text detection (OCR) Javascript/Typescript library that runs on Node.js, Browser, React Native and C++. Based on PaddleOCR and ONNX runtime

Language: C++ - Size: 3.81 MB - Last synced at: 9 days ago - Pushed at: 4 months ago - Stars: 88 - Forks: 22

isaiahbjork/expo-kokoro-onnx

Run Kokoro TTS locally on device using Expo & ONNX Runtime

Language: TypeScript - Size: 1.49 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 15 - Forks: 2

heabeounMKTO/soma_microservice

a bunch of microservices for self hosting that i use personally :)

Language: Rust - Size: 66.4 KB - Last synced at: 8 days ago - Pushed at: 11 days ago - Stars: 1 - Forks: 0

LowinLi/stable-diffusion-streamlit

Quantized stable-diffusion cutting down memory 75%, testing in streamlit, deploying in container

Language: Python - Size: 53.6 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 53 - Forks: 7

xlite-dev/lite.ai.toolkit

🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, FaceFusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TensorRT.

Language: C++ - Size: 448 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 4,110 - Forks: 742

yalue/onnxruntime_go

A Go (golang) library wrapping microsoft/onnxruntime.

Language: Go - Size: 158 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 318 - Forks: 46

ibaiGorordo/ONNX-NeuFlowV2-Optical-Flow

Python scripts performing optical flow estimation using the NeuFlowV2 model in ONNX.

Language: Python - Size: 14.6 KB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 47 - Forks: 3

AmpereComputingAI/ampere_model_library

AML's goal is to make benchmarking of various AI architectures on Ampere CPUs a pleasurable experience :)

Language: Python - Size: 1.36 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 22 - Forks: 7

fabio-sim/Depth-Anything-ONNX

ONNX-compatible Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data

Language: Python - Size: 6.81 MB - Last synced at: 8 days ago - Pushed at: 8 months ago - Stars: 345 - Forks: 29

lucasgelfond/webgpu-sam2

Segment Anything 2, 100% in the browser (with WebGPU!)

Language: TypeScript - Size: 582 MB - Last synced at: about 11 hours ago - Pushed at: 6 months ago - Stars: 130 - Forks: 8

georg-jung/explain-face-rec

Language: HTML - Size: 1.57 MB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 7

PriesiaMioShirakana/DragonianVoice

多个SVC/TTS的C++推理库

Language: C - Size: 101 MB - Last synced at: 11 days ago - Pushed at: 23 days ago - Stars: 1,077 - Forks: 126

helloooideeeeea/RealTimeCutVADCXXLibrary

C++ implementation of real-time Voice Activity Detection (VAD) using Silero models with ONNX Runtime and WebRTC Audio Processing. Provides precise voice segmentation and cross-platform XCFramework support.

Language: C++ - Size: 4.05 MB - Last synced at: 8 days ago - Pushed at: 2 months ago - Stars: 6 - Forks: 3

remsky/Kokoro-FastAPI

Dockerized FastAPI wrapper for Kokoro-82M text-to-speech model w/CPU ONNX and NVIDIA GPU PyTorch support, handling, and auto-stitching

Language: Python - Size: 59.4 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 2,851 - Forks: 401

PT-Perkasa-Pilar-Utama/ppu-paddle-ocr

A lightweight, PaddleOCR implementation in Bun/Node.js for text detection and recognition in JavaScript environments.

Language: TypeScript - Size: 10.2 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 11 - Forks: 0

emilianavt/OpenSeeFace

Robust realtime face and facial landmark tracking on CPU with Unity integration

Language: Python - Size: 212 MB - Last synced at: 12 days ago - Pushed at: 9 months ago - Stars: 1,596 - Forks: 158

sevagh/demucs.onnx

C++ ONNX/ORT inference for Demucs

Language: Python - Size: 159 KB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 16 - Forks: 4

notAI-tech/NudeNet

Lightweight nudity detection

Language: Python - Size: 70.3 MB - Last synced at: 12 days ago - Pushed at: 10 months ago - Stars: 2,038 - Forks: 381

shubham0204/Sentence-Embeddings-Android

Embeddings from sentence-transformers in Android! Supports all-MiniLM-L6-V2, bge-small-en, snowflake-arctic, model2vec models and more

Language: Kotlin - Size: 42 MB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 46 - Forks: 6

RapidAI/RapidTableDetection

检测和提取各种场景图片中的表格区域，并纠正透视和旋转问题 Detect and extract table regions from images in various scenarios, and correct perspective and rotation issues.

Language: Python - Size: 7.91 MB - Last synced at: 10 days ago - Pushed at: 6 months ago - Stars: 92 - Forks: 4

raidionics/Raidionics

Software for automatic segmentation and generation of standardized clinical reports of brain tumors from MRI volumes

Language: Python - Size: 84.9 MB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 39 - Forks: 5

Babyhamsta/Yoable

An easy to use C# open source image labeler for YOLO with AI auto label abilities via YOLO/Onnx models.

Language: C# - Size: 207 KB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 18 - Forks: 3

helloooideeeeea/RealTimeCutVADLibrary

A real-time Voice Activity Detection (VAD) library for iOS and macOS using Silero models powered by ONNX Runtime. Includes advanced noise suppression and audio preprocessing with WebRTC APM, supporting seamless WAV data output with header metadata.

Language: Swift - Size: 3.97 MB - Last synced at: 8 days ago - Pushed at: about 2 months ago - Stars: 16 - Forks: 7

thewh1teagle/piper-rs

Use piper TTS models in Rust

Language: Rust - Size: 162 KB - Last synced at: about 4 hours ago - Pushed at: 6 months ago - Stars: 28 - Forks: 13

Ar-Ray-code/YOLOX-ROS

YOLOX + ROS2 object detection package (C++ only support)

Language: C++ - Size: 21.9 MB - Last synced at: 15 days ago - Pushed at: 2 months ago - Stars: 288 - Forks: 58

LIU42/TrafficRules

基于 YOLO11 的路口交通信号灯通行规则识别

Language: Python - Size: 565 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 27 - Forks: 5

olilarkin/ort-builder

ONNX Runtime static library builder

Language: C++ - Size: 48.2 MB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 58 - Forks: 15

ZhongkuiMa/slimonnx

SlimONNX is a tool to simplify or optimize an ONNX model.

Language: Python - Size: 32.6 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 2 - Forks: 0

AmusementClub/vs-mlrt

Efficient CPU/GPU ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet, ArtCNN and more!)

Language: C++ - Size: 536 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 346 - Forks: 24

daviddaytw/react-native-transformers

Run local LLM from Huggingface in React-Native or Expo using onnxruntime.

Language: TypeScript - Size: 2.37 MB - Last synced at: 15 days ago - Pushed at: 17 days ago - Stars: 99 - Forks: 9

anira-project/anira

an architecture for neural network inference in real-time audio applications

Language: C++ - Size: 911 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 148 - Forks: 7

Torsion-Audio/nn-inference-template

Neural network inference template for real-time cricital audio environments - presented at ADC23

Language: C++ - Size: 18.6 MB - Last synced at: 14 days ago - Pushed at: 9 months ago - Stars: 110 - Forks: 5

mohamedsamirx/YOLOv12-ONNX-CPP

YOLOv12 Inference Using CPP and ONNX Runtime

Language: C++ - Size: 12.6 MB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 34 - Forks: 6

zz990099/sam2_cpp

SAM2 Track implementation with TensorRT & OnnxRuntime

Language: C++ - Size: 4.36 MB - Last synced at: 10 days ago - Pushed at: 18 days ago - Stars: 4 - Forks: 0

yinguobing/head-pose-estimation

Realtime human head pose estimation with ONNXRuntime and OpenCV.

Language: Python - Size: 3.69 MB - Last synced at: 18 days ago - Pushed at: 9 months ago - Stars: 1,290 - Forks: 292

ZhongkuiMa/torchonnx

TorchONNX is a tool to convert an ONNX model to a pytorch model.

Language: Python - Size: 26.8 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 2 - Forks: 0

ZhongkuiMa/shapeonnx

ShapeONNX is to infer the shape of an ONNX model when the official tool being down.

Language: Python - Size: 19.5 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 2 - Forks: 0

Parabul/Reinforce4J

Reinforce4j is a Java library designed for implementing reinforcement learning algorithms, with a primary focus on Monte Carlo Tree Search (MCTS). It provides tools and frameworks for building agents that can learn to play games, demonstrated with examples like Tic-Tac-Toe and Connect 4. The library supports integration with machine learning models

Language: Java - Size: 2.8 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0