GitHub topics: on-device-ai
woheller69/whisperIME
Android Input Method Editor (IME) based on Whisper
Language: Java - Size: 2 MB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 286 - Forks: 12

jeho-lee/Awesome-On-Device-AI-Systems
Size: 25.4 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 30 - Forks: 1

Samsung/ONE
On-device Neural Engine
Language: C++ - Size: 971 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 462 - Forks: 161

QiuYannnn/Local-File-Organizer
An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.
Language: Python - Size: 27.2 MB - Last synced at: 10 days ago - Pushed at: 6 months ago - Stars: 2,198 - Forks: 179

BrutalCoding/aub.ai
AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
Language: Dart - Size: 119 MB - Last synced at: 6 days ago - Pushed at: 12 months ago - Stars: 279 - Forks: 24

gkonovalov/android-vad
Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Language: C - Size: 5.18 MB - Last synced at: 12 days ago - Pushed at: 3 months ago - Stars: 323 - Forks: 69

ubicomplab/rppg-web
This is a web demo for camera-based PPG sensing (rPPG).
Language: TypeScript - Size: 103 MB - Last synced at: 8 days ago - Pushed at: about 4 years ago - Stars: 75 - Forks: 14

NexaAI/nexa-sdk
Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.
Language: Python - Size: 195 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 4,483 - Forks: 625

mit-han-lab/proxylessnas
[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware
Language: C++ - Size: 260 MB - Last synced at: 14 days ago - Pushed at: 8 months ago - Stars: 1,436 - Forks: 287

azuregray/ODIA-Agentic-Interface
An On-Device completely offline personal AI Agent that has both user interface and an always-active kernel-level interface that can interact with the programs you write and the apps you run.
Size: 8.79 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

volverjs/ai
Hugging Face Transformers.js wrapper for on-device AI with web-workers
Language: TypeScript - Size: 1.21 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 7 - Forks: 2

baochuquan/ios-vad
iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.
Language: Swift - Size: 4.5 MB - Last synced at: 20 days ago - Pushed at: 5 months ago - Stars: 10 - Forks: 0

Picovoice/pico-cookbook
Recipes for on-device voice AI and local LLM
Language: Python - Size: 56.9 MB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 80 - Forks: 7

bd4sur/Nano
电子鹦鹉 / Toy Language Model
Language: Python - Size: 27.2 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 160 - Forks: 10

hissain/AndroidSemanticSearch
A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.
Language: Java - Size: 78.2 MB - Last synced at: 15 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

chongzhou96/EdgeSAM
Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"
Language: Jupyter Notebook - Size: 24.5 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 967 - Forks: 45

Hugo-Dz/on-device-transcription
A ready-to-use, minimal app that converts any speech into text.
Language: JavaScript - Size: 2.95 MB - Last synced at: 6 days ago - Pushed at: 10 months ago - Stars: 363 - Forks: 27

hollance/coreml-training
Source code for my blog post series "On-device training with Core ML"
Language: Jupyter Notebook - Size: 9.27 MB - Last synced at: 15 days ago - Pushed at: over 5 years ago - Stars: 101 - Forks: 11

theonlyasdk/backsolate-win
Image subject isolation/background removal using CNNs on device (WinForms frontend)
Language: C# - Size: 630 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Michaelgathara/gemini-rec-search
Rediscover the web by browsing the web and get recommendations of new webpages to explore - powered by Gemini Nano
Language: TypeScript - Size: 4.63 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 1

ascendho/Introduction-to-On-Device-AI
DeepLearning.AI course Introduction to On-Device AI by Krishna Sridhar
Language: Jupyter Notebook - Size: 7.85 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

afondiel/Intro-to-On-Device-AI-Qualcomm
A comprehensive set of notes and resources for a crash course on deploying AI models on edge devices, provided by DeepLearningAI and taught by Krishna Sridhar from Qualcomm.
Language: Jupyter Notebook - Size: 30.6 MB - Last synced at: 24 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

afondiel/awesome-smol
An awesome list of "small but mighty" models and resources.
Size: 142 KB - Last synced at: 10 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Shubh-Bharadwaj/on-device-AI
Language: Python - Size: 7.81 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner
Simplified AI runtime integration for mobile app development
Language: C++ - Size: 33.2 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 64 - Forks: 3

nagababumo/-on-device-AI
Language: Jupyter Notebook - Size: 12.3 MB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

mit-han-lab/TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
Language: C++ - Size: 83.3 MB - Last synced at: 5 months ago - Pushed at: 10 months ago - Stars: 745 - Forks: 72

Mattjesc/DQE-QaQ-OD
Double Quantization Experiment: Quantizing a Quantized model for On-device Deployment
Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner-android
Kotlin bindings for Edgerunner
Language: Kotlin - Size: 9.76 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 26 - Forks: 0

Dcom-KHU/AEye-Android
2022 D.Com 동아리 대항전 Team "AEye" - Android Native App 개발을 위한 Repo.
Language: Kotlin - Size: 54.7 MB - Last synced at: 8 days ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

mit-han-lab/amc
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
Language: Python - Size: 17.6 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 416 - Forks: 108

xliucs/MTTS-CAN
Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)
Language: Python - Size: 17.6 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 152 - Forks: 46

mit-han-lab/amc-models
[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices
Language: Python - Size: 37.1 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 164 - Forks: 27

mit-han-lab/bnn-icestick
Binary Neural Network on IceStick FPGA.
Language: Jupyter Notebook - Size: 229 KB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 47 - Forks: 11

roboflow/inference-server-old 📦
Object detection inference with Roboflow Train models on NVIDIA Jetson devices.
Language: JavaScript - Size: 85 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 3

luix/SponsorMe
SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.
Language: Kotlin - Size: 2.32 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 0

megh1241/blockset
BLOCKSET: Efficient out of core tree ensemble inference
Language: C++ - Size: 117 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 1

cryptoboid/mytag
A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.
Language: JavaScript - Size: 2.67 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 10 - Forks: 2

ivelin/fall-detection Fork of ambianic/fall-detection
Python ML library for person fall detection. Intended for IoT deployments with on-device inference and on-device transfer learning.
Language: Jupyter Notebook - Size: 159 MB - Last synced at: 1 day ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

hav4ik/eyesight
A python framework for designing high-performance Computer Vision pipelines at the Edge. Supports Coral Edge TPU, Raspberry Pi Camera, and more.
Language: Python - Size: 176 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

azzeddineCH/Firebase-MLkit-vision-demo-app
Firebase MLkit vision demo app
Language: Java - Size: 144 KB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0
