NativeMindBrowser/NativeMindExtension

NativeMind: Your fully private, open-source, on-device AI assistant

Language: TypeScript - Size: 7.43 MB - Last synced at: about 20 hours ago - Pushed at: about 21 hours ago - Stars: 43 - Forks: 2

NexaAI/nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Language: Python - Size: 195 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 4,578 - Forks: 637

DZAAAAH/OtosakuFeatureExtractor-iOS

OtosakuFeatureExtractor is a Swift library that simplifies the process of converting raw audio into log-Mel spectrograms for machine learning applications. This tool streamlines audio processing, making it ideal for on-device inference. 🐙📦

Language: Swift - Size: 12.7 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

esdraskololo/File-Organizer-Tool

Organize your files effortlessly with the File Organizer Tool, which sorts them into subdirectories based on their prefixes. This versatile tool offers both GUI and command-line interfaces, supporting multiple languages and themes for a personalized experience. 🗂️💻

Language: Python - Size: 64.5 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

dineshsoudagar/local-llms-on-android

Run large language models like Qwen and LLaMA locally on Android for offline, private, real-time question answering and chat — powered by ONNX Runtime.

Language: Kotlin - Size: 9.91 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1 - Forks: 2

AnyLifeZLB/FaceVerificationSDK

Android on_device 1:1 Face Recognition 、 Liveness detection and 1:N & M:N Face Search SDK 🧒 离线版设备端Android1:1人脸识别 动作活体、静默活体、近红外双目活体检测 以及1:N M:N 人脸搜索算法SDK 封装。全程可开飞行模式不用联网

Language: Java - Size: 25.7 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 745 - Forks: 149

Hugo-Dz/on-device-transcription

A ready-to-use, minimal app that converts any speech into text.

Language: JavaScript - Size: 2.95 MB - Last synced at: 4 days ago - Pushed at: 12 months ago - Stars: 369 - Forks: 28

Samsung/ONE

On-device Neural Engine

Language: C++ - Size: 1000 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 487 - Forks: 164

AliasUruz/whisper-flash-transcriber

Instant offline audio transcription using OpenAI's Whisper AI at the power of your fingers!

Language: Python - Size: 3.42 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

Tehreem-here24/LiteRT-for-Android

Image Classification with LiteRT

Language: Kotlin - Size: 13.4 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

lookr-fyi/job-application-bot-by-ollama-ai

The world’s #1 end-to-end job agent: semantic filters, ATS-optimized resumes, referrals from hiring managers — 100% hands-free.

Size: 30.7 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 261 - Forks: 11

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Language: Dart - Size: 119 MB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 288 - Forks: 26

Picovoice/pico-cookbook

Recipes for on-device voice AI and local LLM

Language: Python - Size: 57.8 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 87 - Forks: 9

ubicomplab/rppg-web

This is a web demo for camera-based PPG sensing (rPPG).

Language: TypeScript - Size: 103 MB - Last synced at: 2 days ago - Pushed at: over 4 years ago - Stars: 83 - Forks: 15

Otosaku/OtosakuFeatureExtractor-iOS

Lightweight Swift library for log-Mel spectrogram extraction with Accelerate & CoreML)

Language: Swift - Size: 10.7 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 1 - Forks: 0

jc2409/Andrew-Choi-Portfolio

This repository highlights my work as an embedded systems/AI developer and software engineer, alongside meaningful personal experiences such as volunteering and participating in hackathons.

Language: HTML - Size: 195 MB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

afondiel/Fundamentals-of-Qualcomm-AI

Fundamentals of Qualcomm AI: A crash course

Size: 63.1 MB - Last synced at: 6 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0

jeho-lee/Awesome-On-Device-AI-Systems

Size: 26.4 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 43 - Forks: 1

callstackincubator/ai

On-device LLM execution in React Native with Vercel AI SDK compatibility

Language: Objective-C++ - Size: 2 MB - Last synced at: 22 days ago - Pushed at: 23 days ago - Stars: 378 - Forks: 12

mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

Language: C++ - Size: 83.3 MB - Last synced at: 27 days ago - Pushed at: 12 months ago - Stars: 852 - Forks: 85

QiuYannnn/Local-File-Organizer

An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes files for quick, seamless access and easy retrieval.

Language: Python - Size: 27.2 MB - Last synced at: 28 days ago - Pushed at: 8 months ago - Stars: 2,323 - Forks: 199

stevan-milovanovic/LiteRT-for-Android

Image Classification with LiteRT

Language: Kotlin - Size: 171 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

woheller69/whisperIME

Android Input Method Editor (IME) based on Whisper

Language: Java - Size: 2.02 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 334 - Forks: 15

gkonovalov/android-vad

Android Voice Activity Detection (VAD) library. Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

Language: C - Size: 5.18 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 342 - Forks: 76

bd4sur/Nano

电子鹦鹉 / Toy Language Model

Language: C - Size: 28.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 170 - Forks: 12

azuregray/ODIA-Agentic-Interface

An On-Device completely offline personal AI Agent that has both user interface and an always-active kernel-level interface that can interact with the programs you write and the apps you run.

Size: 3.62 MB - Last synced at: 20 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

facebookresearch/EdgeTAM

[CVPR 2025] Official PyTorch implementation of "EdgeTAM: On-Device Track Anything Model"

Language: Jupyter Notebook - Size: 163 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 216 - Forks: 15

baochuquan/ios-vad

iOS Voice Activity Detection (VAD). Supports WebRTC VAD GMM, Silero VAD DNN, Yamnet VAD DNN models.

Language: Swift - Size: 4.5 MB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 15 - Forks: 0

mit-han-lab/proxylessnas

[ICLR 2019] ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware

Language: C++ - Size: 260 MB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 1,440 - Forks: 287

volverjs/ai

Hugging Face Transformers.js wrapper for on-device AI with web-workers

Language: TypeScript - Size: 1.53 MB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 7 - Forks: 2

mit-han-lab/amc-models

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Language: Python - Size: 37.1 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 167 - Forks: 27

mit-han-lab/amc

[ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Language: Python - Size: 17.6 KB - Last synced at: 25 days ago - Pushed at: over 1 year ago - Stars: 441 - Forks: 115

afondiel/awesome-smol

An awesome list of "small but mighty" models and resources.

Size: 142 KB - Last synced at: 2 days ago - Pushed at: 6 months ago - Stars: 1 - Forks: 2

mit-han-lab/bnn-icestick

Binary Neural Network on IceStick FPGA.

Language: Jupyter Notebook - Size: 229 KB - Last synced at: about 1 month ago - Pushed at: almost 7 years ago - Stars: 52 - Forks: 12

hissain/AndroidSemanticSearch

A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.

Language: Java - Size: 78.2 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

chongzhou96/EdgeSAM

Official PyTorch implementation of "EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM"

Language: Jupyter Notebook - Size: 24.5 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 967 - Forks: 45

hollance/coreml-training

Source code for my blog post series "On-device training with Core ML"

Language: Jupyter Notebook - Size: 9.27 MB - Last synced at: 3 months ago - Pushed at: over 5 years ago - Stars: 101 - Forks: 11

theonlyasdk/backsolate-win

Image subject isolation/background removal using CNNs on device (WinForms frontend)

Language: C# - Size: 630 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

Michaelgathara/gemini-rec-search

Rediscover the web by browsing the web and get recommendations of new webpages to explore - powered by Gemini Nano

Language: TypeScript - Size: 4.63 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 5 - Forks: 1

ascendho/Introduction-to-On-Device-AI

DeepLearning.AI course Introduction to On-Device AI by Krishna Sridhar

Language: Jupyter Notebook - Size: 7.85 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

afondiel/Intro-to-On-Device-AI-Qualcomm

A comprehensive set of notes and resources for a crash course on deploying AI models on edge devices, provided by DeepLearningAI and taught by Krishna Sridhar from Qualcomm.

Language: Jupyter Notebook - Size: 30.6 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

Shubh-Bharadwaj/on-device-AI

Language: Python - Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner

Simplified AI runtime integration for mobile app development

Language: C++ - Size: 33.2 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 64 - Forks: 3

nagababumo/-on-device-AI

Language: Jupyter Notebook - Size: 12.3 MB - Last synced at: 4 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0

Mattjesc/DQE-QaQ-OD

Double Quantization Experiment: Quantizing a Quantized model for On-device Deployment

Language: Jupyter Notebook - Size: 18.6 KB - Last synced at: 4 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

neuralize-ai/edgerunner-android

Kotlin bindings for Edgerunner

Language: Kotlin - Size: 9.76 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 26 - Forks: 0

Dcom-KHU/AEye-Android

2022 D.Com 동아리 대항전 Team "AEye" - Android Native App 개발을 위한 Repo.

Language: Kotlin - Size: 54.7 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

xliucs/MTTS-CAN

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement (NeurIPS 2020)

Language: Python - Size: 17.6 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 152 - Forks: 46

roboflow/inference-server-old 📦

Object detection inference with Roboflow Train models on NVIDIA Jetson devices.

Language: JavaScript - Size: 85 KB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 13 - Forks: 3

luix/SponsorMe

SponsorMe is a project to help provide access to digital tools for learning, powered by on-device machine learning, innovation and willingness, to those people that have limited access to technology due to demographics, disabilities, economy or other multiple reasons.

Language: Kotlin - Size: 2.32 MB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

megh1241/blockset

BLOCKSET: Efficient out of core tree ensemble inference

Language: C++ - Size: 117 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 1

cryptoboid/mytag

A Google Photos alternative, where your pictures never leave your phone! Classification happens on-device, leveraging pre-trained models. Available for Android and iOS.

Language: JavaScript - Size: 2.67 MB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 10 - Forks: 2

ivelin/fall-detection Fork of ambianic/fall-detection

Python ML library for person fall detection. Intended for IoT deployments with on-device inference and on-device transfer learning.

Language: Jupyter Notebook - Size: 159 MB - Last synced at: 4 days ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

hav4ik/eyesight

A python framework for designing high-performance Computer Vision pipelines at the Edge. Supports Coral Edge TPU, Raspberry Pi Camera, and more.

Language: Python - Size: 176 KB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 0

azzeddineCH/Firebase-MLkit-vision-demo-app

Firebase MLkit vision demo app

Language: Java - Size: 144 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0