GitHub topics: on-device

Repositories

Picovoice/porcupine

On-device wake word detection powered by deep learning

Language: Python - Size: 340 MB - Last synced at: about 15 hours ago - Pushed at: 2 days ago - Stars: 4,358 - Forks: 546

ambv231/tinyllama-coreml-ios18-quantization

Quantize TinyLlama-1.1B-Chat from PyTorch to CoreML (float16, int8, int4) for efficient on-device inference on iOS 18+.

Language: Python - Size: 7.81 KB - Last synced at: about 18 hours ago - Pushed at: about 20 hours ago - Stars: 1 - Forks: 0

BrutalCoding/aub.ai

AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.

Language: Dart - Size: 119 MB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 302 - Forks: 27

NexaAI/Awesome-LLMs-on-device

Awesome LLMs on Device: A Comprehensive Survey

Size: 1.31 MB - Last synced at: 2 days ago - Pushed at: 8 months ago - Stars: 1,193 - Forks: 107

Picovoice/picovoice 📦

On-device voice assistant platform powered by deep learning

Language: Python - Size: 421 MB - Last synced at: 6 days ago - Pushed at: 5 months ago - Stars: 666 - Forks: 116

bd4sur/Nano

电子鹦鹉 / Toy Language Model

Language: C - Size: 30.5 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 195 - Forks: 11

mozilla/DeepSpeech 📦

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Language: C++ - Size: 48.2 MB - Last synced at: 11 days ago - Pushed at: 3 months ago - Stars: 26,577 - Forks: 4,075

bhanuka96/face_verification

Face verification for Flutter using on-device FaceNet-style embeddings (offline TFLite), with local storage and cosine matching.

Language: Dart - Size: 64.5 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0

BoltUIX/TFLite-Text-Classifier-Android-App

This Android app leverages a TensorFlow Lite model for on-device classification of social media posts into 11 categories, including technology, sports, finance, and more. Built with Kotlin and Jetpack Compose, it ensures efficient, privacy-focused inference without server dependencies.

Language: Jupyter Notebook - Size: 1.6 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 1 - Forks: 1

VerisimilitudeX/DNAnalyzer

Precision genomics for everyone, everywhere. Powered by private AI.

Language: HTML - Size: 164 MB - Last synced at: 8 days ago - Pushed at: 14 days ago - Stars: 160 - Forks: 69

Picovoice/rhino

On-device Speech-to-Intent engine powered by deep learning

Language: Python - Size: 272 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 676 - Forks: 92

mikerosy10/gemini-gpt-hybrid

🐙 Gemini-GPT Hybrid Agent for Claude routes tasks between Gemini and GPT models, using model-aware orchestration to boost accuracy and speed in AI workflows.

Language: Shell - Size: 30.3 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

Picovoice/cobra

On-device voice activity detection (VAD) powered by deep learning

Language: Python - Size: 43.2 MB - Last synced at: 16 days ago - Pushed at: 25 days ago - Stars: 227 - Forks: 14

Q2-Development/q2-edge-chat

Chat with on-device LLM's on iPhone

Language: Swift - Size: 9.05 MB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 7 - Forks: 2

Picovoice/leopard

On-device speech-to-text engine powered by deep learning

Language: Python - Size: 419 MB - Last synced at: 29 days ago - Pushed at: 30 days ago - Stars: 459 - Forks: 29

context-sdk/context-sdk-releases

Real-world context insights SDK for Swift apps, enhancing user experience and engagement with a privacy-first approach

Language: Swift - Size: 179 MB - Last synced at: 6 days ago - Pushed at: about 1 month ago - Stars: 16 - Forks: 0

Picovoice/falcon

On-device speaker diarization powered by deep learning

Language: Python - Size: 22.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 52 - Forks: 6

Picovoice/koala

On-device noise suppression powered by deep learning

Language: Python - Size: 29 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 73 - Forks: 4

context-sdk/react-native

Real-world context insights SDK for React Native apps, enhancing user experience and engagement with a privacy-first approach

Language: TypeScript - Size: 2.26 MB - Last synced at: 18 days ago - Pushed at: 4 months ago - Stars: 4 - Forks: 1

adobe-research/convmelspec

Convmelspec: Convertible Melspectrograms via 1D Convolutions

Language: Python - Size: 183 KB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 145 - Forks: 11

Natxo09/Eris.

Eris is a private AI chat application that runs entirely on your device using Apple's MLX framework. Named after the dwarf planet that challenged our understanding of the solar system, Eris challenges the notion that AI must live in the cloud.

Language: Swift - Size: 5.48 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 52 - Forks: 10

PTEz/LumberjackConsole

On-device CocoaLumberjack console with support for search, adjust levels, copying and more.

Language: Objective-C - Size: 1.37 MB - Last synced at: 21 days ago - Pushed at: almost 2 years ago - Stars: 202 - Forks: 49

arghyasur1991/Spark-TTS Fork of SparkAudio/Spark-TTS

Spark-TTS Inference Code and Export to Onnx. The exported onnx models can be used for on-device inference like in https://github.com/arghyasur1991/Spark-TTS-Unity

Language: Python - Size: 10.6 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

arghyasur1991/LiveTalk-Unity

LiveTalk is a unified, high-performance talking head generation system that combines the power of LivePortrait and MuseTalk open-source repositories. The PyTorch models from these projects have been ported to ONNX format and optimized for CoreML to enable efficient on-device inference in Unity.

Language: C# - Size: 1.69 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

selmonix/OtosakuKWS-iOS

OtosakuKWS is a lightweight, on-device keyword spotting engine for iOS that detects speech commands in real time. This project relies on a CRNN CoreML model for efficient and accurate voice command recognition. 🐙🌟

Language: Swift - Size: 1.24 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

arghyasur1991/Spark-TTS-Unity

Unity package for using Spark-TTS on-device models. This is a C# port of https://github.com/SparkAudio/Spark-TTS by SparkAudio team and uses converted ONNX models instead of the PyTorch models in the original repo

Language: C# - Size: 128 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 4 - Forks: 0

context-sdk/flutter

Real-world context insights SDK for apps using Flutter, enhancing user experience and engagement with a privacy-first approach

Language: Dart - Size: 76.2 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

nikkiw/smart-feed

Android MVP article feed with on-device recommendation system using Kotlin, MVVM & Coroutines

Language: Kotlin - Size: 661 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Otosaku/OtosakuKWS-iOS

Lightweight on-device keyword spotting engine for iOS using CoreML and real-time audio streaming.

Language: Swift - Size: 3.91 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

tucan9389/PoseEstimation-TFLiteSwift

The baseline project for inferencing various Pose Estimation tflite models with TFLiteSwift on iOS

Language: Swift - Size: 23.9 MB - Last synced at: 26 days ago - Pushed at: about 3 years ago - Stars: 154 - Forks: 20

v-code01/edgetrain

WebGPU-based on-device neural network training framework

Language: TypeScript - Size: 44.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

GreenBull31/tinyllama-coreml-ios18-quantization

Quantize TinyLlama-1.1B-Chat from PyTorch to CoreML (float16, int8, int4) for efficient on-device inference on iOS 18+.

Language: Python - Size: 6.84 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

MiniAiLive/FaceLivenessDetection-SDK-Docker

iBeta (Level 2) Certified, Single-Image Based Face Liveness Detection (Face Anti Spoofing) Server SDK

Language: Python - Size: 993 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 4 - Forks: 4

drewster99/MLXTranslate

On-device high speed text translation for macOS and iOS running local LLM using Apple's MLX for Apple Silicon

Language: Swift - Size: 43 KB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

hissain/AndroidSemanticSearch

A minimalistic Android app showcasing semantic search using ObjectBox and Lucene KNN, leveraging the MiniLM-L6-V2 embedding model and bert_vocab.txt for efficient retrieval.

Language: Java - Size: 78.2 MB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

azuregray/Interactive-Image-Processor 📦

A very interactive, single-file, integrated and optimized python-based image converter script used to recursively process images on-device, removing the need to third-party complex application installs.

Language: Python - Size: 11.7 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

keenresearch/KeenASR-Android-PoC

A proof-of-concept app using KeenASR SDK on Android. WE ARE HIRING: https://keenresearch.com/careers.html

Language: Java - Size: 484 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 26 - Forks: 9

EesunMoon/On-device_Multimodal_ER

[Research - MINES Lab] Multimodal Emotion Recognition for On-device AI

Language: Python - Size: 56.6 KB - Last synced at: 5 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

nagababumo/-on-device-AI

Language: Jupyter Notebook - Size: 12.3 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

chakkritte/PKD

[IEEE TII] On-Device Saliency Prediction Based on Pseudoknowledge Distillation

Language: Python - Size: 316 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

aqibsaeed/On-device-activity-recognition

Personalized machine learning on the smartphone

Language: Java - Size: 107 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 59 - Forks: 18

RiS3-Lab/ShadowNet

Open-source code and data for ShadowNet(S&P Oakland'23)

Language: Java - Size: 186 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

JaeBinCHA7/Nested-U-Net-based-Real-time-Speech-Enhancement-Mobile-App

Real-time speech enhancement mobile app using Nested U-Net

Language: Python - Size: 31.2 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 28 - Forks: 4

rishabh01solanki/PixeLearner

Combining the power of MobileNetV2 with the privacy of on-device learning. Benefit from real-time updates and efficient image processing, all while ensuring your data remains securely on your device. Experience precision, speed, and trust with PixeLearner.

Language: Swift - Size: 64 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Related Keywords

on-device 49 machine-learning 11 speech-recognition 10 ios 9 ai 9 deep-learning 9 coreml 9 swift 6 android 6 privacy 6 llm 6 voice-assistant 6 real-time 5 voice-recognition 5 offline 5 voice-commands 4 on-device-ai 4 nlp 4 pytorch 4 quantization 4 artificial-intelligence 4 onnx 4 speech-to-text 4 tensorflow 4 gpt 3 gpu 3 python 3 tensorflow-lite 3 voice-control 3 audio 3 ml 3 tflite 3 onnxruntime 3 llama 3 speech 3 keyword-spotting 3 dart 3 flutter 3 tts 3 texttospeech 2 int8 2 edge-computing 2 training 2 int4 2 huggingface 2 speech-enhancement 2 apple-silicon 2 voicecloning 2 neural-networks 2 wake-word-detection 2 unity 2 voice-chat 2 knowledge-distillation 2 wakeword 2 kws 2 face-detection 2 signal-processing 2 open-source 2 sparktts 2 gemini 2 transformers 2 tinyllama 2 secure 2 mobile 2 noise-reduction 2 mlx 2 npu 2 natural-language-understanding 2 nlu 2 speech-processing 2 mlpackage 2 voice-command 2 ios18 2 voice-user-interface 2 face-alignment 1 biometrics 1 authentication 1 face-anti-spoofing 1 face-liveness 1 face-matching 1 face-recognition 1 face-tracking 1 ibeta 1 kyc-service 1 liveness-detection 1 nist-frvt 1 on-premise 1 passive-liveness 1 verification 1 apple 1 mml 1 translation 1 unity3d 1 voice 1 recommendation-system 1 smart-feed 1 3d-pose-estimation 1 cpm 1 hourglass 1 mobilenetv2 1