An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: on-device-ai

woheller69/whisperIME

Android Input Method Editor (IME) based on Whisper

Language: Java - Size: 2 MB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 286 - Forks: 12

jeho-lee/Awesome-On-Device-AI-Systems

Size: 25.4 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 30 - Forks: 1

Samsung/ONE

On-device Neural Engine

Language: C++ - Size: 971 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 462 - Forks: 161

QiuYannnn/Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

Language: Python - Size: 27.2 MB - Last synced at: 10 days ago - Pushed at: 6 months ago - Stars: 2,198 - Forks: 179

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Language: Dart - Size: 119 MB - Last synced at: 6 days ago - Pushed at: 12 months ago - Stars: 279 - Forks: 24

gkonovalov/android-vad

Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

Language: C - Size: 5.18 MB - Last synced at: 12 days ago - Pushed at: 3 months ago - Stars: 323 - Forks: 69

ubicomplab/rppg-web

This is a web demo for camera-based PPG sensing (rPPG).

Language: TypeScript - Size: 103 MB - Last synced at: 8 days ago - Pushed at: about 4 years ago - Stars: 75 - Forks: 14

NexaAI/nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Language: Python - Size: 195 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 4,483 - Forks: 625

mit-han-lab/proxylessnas

[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Language: C++ - Size: 260 MB - Last synced at: 14 days ago - Pushed at: 8 months ago - Stars: 1,436 - Forks: 287

azuregray/ODIA-Agentic-Interface

An On-Device completely offline personal AI Agent that has both user interface and an always-active kernel-level interface that can interact with the programs you write and the apps you run.

Size: 8.79 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0

volverjs/ai

Hugging Face Transformers.js wrapper for on-device AI with web-workers

Language: TypeScript - Size: 1.21 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 7 - Forks: 2

baochuquan/ios-vad

iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

Language: Swift - Size: 4.5 MB - Last synced at: 20 days ago - Pushed at: 5 months ago - Stars: 10 - Forks: 0

Picovoice/pico-cookbook

Recipes for on-device voice AI and local LLM

Language: Python - Size: 56.9 MB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 80 - Forks: 7

bd4sur/Nano

电子鹦鹉 / Toy Language Model

Language: Python - Size: 27.2 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 160 - Forks: 10

hissain/AndroidSemanticSearch

A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.

Language: Java - Size: 78.2 MB - Last synced at: 15 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

chongzhou96/EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

Language: Jupyter Notebook - Size: 24.5 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 967 - Forks: 45

Hugo-Dz/on-device-transcription

A ready-to-use, minimal app that converts any speech into text.

Language: JavaScript - Size: 2.95 MB - Last synced at: 6 days ago - Pushed at: 10 months ago - Stars: 363 - Forks: 27

hollance/coreml-training

Source code for my blog post series "On-device training with Core ML"

Language: Jupyter Notebook - Size: 9.27 MB - Last synced at: 15 days ago - Pushed at: over 5 years ago - Stars: 101 - Forks: 11

theonlyasdk/backsolate-win

Image subject isolation/background removal using CNNs on device (WinForms frontend)

Language: C# - Size: 630 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Michaelgathara/gemini-rec-search

Rediscover the web by browsing the web and get recommendations of new webpages to explore - powered by Gemini Nano

Language: TypeScript - Size: 4.63 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 1

ascendho/Introduction-to-On-Device-AI

DeepLearning.AI course Introduction to On-Device AI by Krishna Sridhar

Language: Jupyter Notebook - Size: 7.85 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

afondiel/Intro-to-On-Device-AI-Qualcomm

A comprehensive set of notes and resources for a crash course on deploying AI models on edge devices, provided by DeepLearningAI and taught by Krishna Sridhar from Qualcomm.

Language: Jupyter Notebook - Size: 30.6 MB - Last synced at: 24 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

afondiel/awesome-smol

An awesome list of "small but mighty" models and resources.

Size: 142 KB - Last synced at: 10 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Shubh-Bharadwaj/on-device-AI

Language: Python - Size: 7.81 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner

Simplified AI runtime integration for mobile app development

Language: C++ - Size: 33.2 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 64 - Forks: 3

nagababumo/-on-device-AI

Language: Jupyter Notebook - Size: 12.3 MB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

Language: C++ - Size: 83.3 MB - Last synced at: 5 months ago - Pushed at: 10 months ago - Stars: 745 - Forks: 72

Mattjesc/DQE-QaQ-OD

Double Quantization Experiment: Quantizing a Quantized model for On-device Deployment

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner-android

Kotlin bindings for Edgerunner

Language: Kotlin - Size: 9.76 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 26 - Forks: 0

Dcom-KHU/AEye-Android

2022 D.Com 동아리 대항전 Team "AEye" - Android Native App 개발을 위한 Repo.

Language: Kotlin - Size: 54.7 MB - Last synced at: 8 days ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

mit-han-lab/amc

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Language: Python - Size: 17.6 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 416 - Forks: 108

xliucs/MTTS-CAN

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)

Language: Python - Size: 17.6 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 152 - Forks: 46

mit-han-lab/amc-models

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Language: Python - Size: 37.1 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 164 - Forks: 27

mit-han-lab/bnn-icestick

Binary Neural Network on IceStick FPGA.

Language: Jupyter Notebook - Size: 229 KB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 47 - Forks: 11

roboflow/inference-server-old 📦

Object detection inference with Roboflow Train models on NVIDIA Jetson devices.

Language: JavaScript - Size: 85 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 3

luix/SponsorMe

SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.

Language: Kotlin - Size: 2.32 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 0

megh1241/blockset

BLOCKSET: Efficient out of core tree ensemble inference

Language: C++ - Size: 117 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 1

cryptoboid/mytag

A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.

Language: JavaScript - Size: 2.67 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 10 - Forks: 2

ivelin/fall-detection Fork of ambianic/fall-detection

Python ML library for person fall detection. Intended for IoT deployments with on-device inference and on-device transfer learning.

Language: Jupyter Notebook - Size: 159 MB - Last synced at: 1 day ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

hav4ik/eyesight

A python framework for designing high-performance Computer Vision pipelines at the Edge. Supports Coral Edge TPU, Raspberry Pi Camera, and more.

Language: Python - Size: 176 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

azzeddineCH/Firebase-MLkit-vision-demo-app

Firebase MLkit vision demo app

Language: Java - Size: 144 KB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0