ondevice

The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Diffusion, tool calling, and local-network servers. Runs on your CPU, GPU, or NPU. No account, no API key, zero data leaves your device.

On-device speech-to-text for iOS/macOS powered by NVIDIA NeMo Conformer CTC Small (13M params). Pure Swift + CoreML implementation with automatic audio padding, chunking for long audio, and real-time recognition.

OnDevice Local AI Studio — run LLMs on iPhone offline. SwiftUI workbench with MLX, llama.cpp, whisper.cpp, RAG, and authenticated OpenAI/Anthropic/Ollama-compatible local APIs.

On-device AI framework inspired by LangChain, purpose-built for mobile. Build, compose, and extend AI features using platform-native models — all processing happens locally on the device.

Dreamcraft AI Studio - Ai Game Maker

Fully offline on-device Korean STT for Android (whisper.cpp + RNNoise).

Feedy EXT - Brand Sentiment Analysis

Offline-first AI-powered medical triage app that analyzes symptoms in real time to provide first-aid guidance, emergency severity assessment, and validated emergency protocols without requiring an internet connection.

Unity OnDevice DeepLearning SDK

Local gesture recognition for ESP32 powered by a custom-written neural network. Capture movements, train in PyTorch, and run inference 100% locally on device.

🎙️ Enable accurate speech recognition on iOS/macOS using NVIDIA NeMo Conformer CTC with smart segmentation and timestamped results in pure Swift.

Muesli for Android: custom keyboard and on-device dictation app

On-device image similarity search