Clear ×

On device ai

18 repositories found

software-mansion

software-mansion

react-native-executorch
C++ AI analysis

React Native ExecuTorch enables on-device AI model inference in React Native applications using Meta's ExecuTorch framework, supporting computer...

Production ready Niche use case
computer-vision executorch image-embeddings
1.6k
87
73
28/wk
active
7/10 Mobile
cactus-compute

cactus-compute

needle
Python AI analysis

Needle is a 26-parameter distilled language model optimized for function calling on resource-constrained devices like phones and watches. It excels...

Production ready Beginner friendly Single maintainer Niche use case
cactus gemini gemma
2.7k
184
19
40/wk
recent
7/10 AI & ML
callstackincubator

callstackincubator

ai
TypeScript AI analysis

React Native AI provides on-device LLM execution and AI primitives (text generation, embeddings, transcription, speech synthesis) for React Native...

Production ready Niche use case
ai llm on-device-ai
1.4k
53
7
16/wk
active
8/10 Mobile
fikrikarim

fikrikarim

parlor
HTML AI analysis

Parlor is a self-contained, on-device multimodal AI assistant that runs voice and vision conversations entirely locally using Gemma 4 E2B and Kokoro...

Beginner friendly Single maintainer Niche use case
apple-silicon gemma kokoro
1.9k
240
7
24/wk
slow
7/10 AI & ML
qualcomm

qualcomm

GenieX
Rust AI analysis

GenieX is an on-device inference runtime for running large language models and vision models locally on Qualcomm Snapdragon devices (NPU, GPU, CPU)....

Production ready Niche use case
gemma4 go gpt-oss
8.2k
1k
60
53/wk
active
8/10 AI & ML
google-ai-edge

google-ai-edge

LiteRT-LM
C++ AI analysis

LiteRT-LM is Google's production inference framework for deploying Large Language Models on edge devices across Android, iOS, Web, Desktop, and IoT...

Production ready Niche use case
edge-ai on-device-ai on-device-llm
5.8k
621
408
57/wk
active
8/10 AI & ML
ARahim3

ARahim3

mlx-tune
Python AI analysis

MLX-Tune enables fine-tuning of large language models, vision models, and audio systems directly on Apple Silicon Macs using the native MLX...

Production ready Single maintainer Niche use case
apple-silicon deep-learning huggingface
1.3k
88
11
11/wk
recent
7/10 AI & ML
kellyvv

kellyvv

PhoneClaw
Swift AI analysis

PhoneClaw transforms iPhones into local AI agent runtimes that execute on-device tasks through native mobile Skills (calendar, reminders, contacts,...

Production ready Single maintainer Niche use case Hidden gem
agent-framework ai-agent gemma
1.1k
155
1
9/wk
active
8/10 AI & ML
nobodywho-ooo

nobodywho-ooo

nobodywho
Rust AI analysis

NobodyWho is a multi-platform inference engine written in Rust that enables running LLMs locally and offline across Kotlin, Swift, Python, Flutter,...

Production ready Beginner friendly Niche use case
ai flutter godot
1k
70
36
8/wk
active
8/10 AI & ML
cactus-compute

cactus-compute

cactus
C++ AI analysis

Cactus is a low-latency AI inference engine purpose-built for mobile devices and wearables, enabling on-device LLM, vision, and speech processing via...

Production ready Niche use case
ai android arm
5.4k
435
69
24/wk
active
7/10 Mobile
nicedreamzapp

nicedreamzapp

claude-code-local
Python AI analysis

Claude Code Local enables running Claude Code 100% on-device using local AI models (Qwen 3.5, Llama 3.3, Gemma 4, DeepSeek V4 Flash) on Apple Silicon...

Production ready Single maintainer Niche use case
abliterated ai-privacy airgap
2.9k
560
21/wk
recent
8/10 AI & ML
rudrankriyam

rudrankriyam

Foundation-Models-Framework-Lab
Swift AI analysis

Foundation Lab is a native iOS and macOS workbench for learning, testing, and building applications with Apple's Foundation Models framework. It...

Production ready Beginner friendly Single maintainer Niche use case
ai apple-foundation-models apple-intelligence
1.1k
68
8/wk
active
8/10 AI & ML
Mininglamp-AI

Mininglamp-AI

Mano-P
AI analysis

Mano-P is an open-source GUI-VLA (Vision-Language-Action) agent designed for edge devices, enabling local GUI automation on Apple Silicon Macs...

Production ready Niche use case
computer-use-agents desktop-automation edge-computing
2.4k
224
25
16/wk
recent
8/10 AI & ML
RunanywhereAI

RunanywhereAI

runanywhere-sdks
C++ AI analysis

RunAnywhere is a production-ready SDK for running AI models (LLMs, vision, speech) entirely on-device across iOS, Android, Flutter, React Native, and...

Production ready Niche use case
android apple-intelligence cpp
10.3k
364
23
15/wk spike
active
8/10 AI & ML
NativeMindBrowser

NativeMindBrowser

NativeMindExtension
TypeScript AI analysis

NativeMind is a browser extension (Chrome and Firefox) that brings local AI models directly into your browser using Ollama and WebLLM, enabling...

Production ready Single maintainer Niche use case
ai chrome-extension llm
1.1k
101
17
5/wk
slow
7/10 AI & ML
FaceAISDK

FaceAISDK

FaceAISDK_Android
Java AI analysis

FaceAISDK is an on-device Android face recognition, liveness detection, and face search library supporting 1:1 and 1:N/M:N scenarios entirely offline...

Production ready Single maintainer Niche use case
anti-spoofing binocular color-flash
1.2k
240
4
2/wk
active
7/10 AI & ML
thunderbird

thunderbird

thunderbolt
TypeScript AI analysis

Thunderbolt is an open-source, cross-platform AI client designed for on-premise deployment that lets users choose their model providers, retain data...

Production ready Niche use case
ai ai-agents llms
4.7k
317
33
1/wk
active
7/10 AI & ML
RunanywhereAI

RunanywhereAI

RCLI
C++ AI analysis

RCLI is a voice-activated AI assistant for macOS that runs entirely on-device without cloud services, combining speech-to-text, LLM inference,...

Production ready Beginner friendly Single maintainer Niche use case
ai-assistant apple-silicon kitten-tts
1.5k
83
12
1/wk
slow
8/10 AI & ML