商业产业 Hacker News AI 2026-07-13T20:36 正文 ok 1300 words

🔶 Open source on-device AI apps (and counting), no cloud, works offline

英文标题:🔶 Open source on-device AI apps (and counting), no cloud, works offline

⬆️ 5 pts | 💬 4 comments | by rishabh121108
打开原文相关 2 · 机会 2
media4.8 MB media1.7 MB media432.5 KB media1.7 MB media612 B media620 B media553 B media2.4 KB media659 B media12.2 KB media56.1 KB

中文

⬆️ 5 pts | 💬 4 comments | by rishabh121108

中文全文翻译正在补齐,可先查看下方英文原文。

English / 原文

English · German · Spanish · French · Japanese · Korean · Portuguese · Chinese

On-device is a business decision, not just a technical one.

Every app here runs the model on the phone itself. Nothing goes to a server. That one fact rewrites the economics:

  • 🛡️ No compliance wall. No user data in the cloud means no GDPR, HIPAA, or data-residency blocker between you and launch. Put AI into health, finance, and enterprise products, and actually charge for it.
  • 💸 $0 marginal cost. No per-token bill, no inference servers. Your margins hold as you scale from 1 to 10 million users.
  • 🔒 Private by design. Nothing leaves the device, so there is no cloud dataset to breach, leak, or get audited over.
  • ⚡ Instant and offline. Runs on the phone's NPU with no network round-trip, on a plane, a subway, or a factory floor with no signal.

And these are not snippets. Every folder is a finished app you clone and run on a real device today.

Pick any app, clone, and run it on a real device. No ML setup, no model conversion, no C++.

git clone https://github.com/zetic-ai/awesome-on-device-ai-apps.git
cd awesome-on-device-ai-apps

# A free key lets the app pull its NPU-optimized weights on first launch
# (30 seconds, no card): mlange.zetic.ai -> Settings -> Personal Access Token
./scripts/adapt_mlange_key.sh

# Open an app on a REAL device (the NPU isn't in the simulator):
#   Android:  apps/<AppName>/Android    in Android Studio
#   iOS:      apps/<AppName>/iOS        in Xcode
#   Flutter:  cd apps/<AppName>/Flutter && flutter run

Auto-generated from each app's meta.json. Run python3 scripts/generate_catalog.py after adding one.

Jump to: 💬 Language & Text · 👁️ Vision · ❤️ Health & Wellbeing · 🔊 Audio · 📈 Forecasting

App What it does Model Platforms Try it
Brew AI Notes Records, transcribes & summarizes meetings, then lets you ask anything. Granola, but fully private. Gemma-4-E2B iOS Model ↗
CherryPad An AI keyboard that rewrites, replies, translates, and fixes grammar, all on-device. No text ever leaves the phone. LFM2.5-350M Android iOS Model ↗
Grammar Fixer Real-time grammar correction as you type T5-base Android iOS Model ↗
HY-MT Translator Streaming offline machine translation with instant language swap Tencent HY-MT Android iOS Model ↗
MedASR Medical-domain speech recognition, fully on-device. MedASR Android Model ↗
Offline Translator Translate by text, voice, or camera/OCR, with real-time streaming and instant language swap Tencent HY-MT Android iOS Model ↗
PromptGuard Flags prompt-injection and jailbreak text as benign or malicious, on-device via CoreML. Llama Prompt Guard 2 iOS Model ↗
Qwen3 Chat A private ChatGPT in your pocket, with real-time token streaming Qwen3-4B Android iOS Model ↗
SayRight Reads a sentence aloud and scores your pronunciation per word and per phoneme, fully offline. Citrinet-256 (phoneme CTC) Flutter Model ↗
Text Anonymizer Auto-detects & masks PII (names, emails, phones) before any data moves tanaos-anonymizer-v1 Android iOS Model ↗
VoxScribe Transcribes speech and labels who spoke, fully offline. pyannote + Whisper Flutter Model ↗
Whisper ASR High-accuracy speech-to-text, fully offline Whisper Tiny Android iOS Model ↗
App What it does Model Platforms Try it
Emotion Recognition Real-time facial emotion from the camera Emo-AffectNet Android iOS Model ↗
Face Detection Ultra-fast selfie-range face detection BlazeFace Android iOS Model ↗
Face Landmarker 468-point face mesh tracking MediaPipe Android iOS Model ↗
GlyphGo Point your camera at a sign or menu and read the text live, fully offline. Built for travelers with no signal. PP-OCRv5 (DBNet + SVTR) Flutter Model ↗
PlateHawk Detects license plates in the live camera feed, frame by frame, entirely on-device. YOLOv8n Flutter Model ↗
RedactLens Auto-redacts name, date-of-birth, and ID fields on IDs and forms live in the camera preview, before anything is stored. PP-OCRv5 (DBNet + CRNN) Flutter Model ↗
ShelfSense Counts and boxes every product facing on a dense retail-shelf photo, on-device. YOLO11s (SKU-110K) Flutter Model ↗
SiteGuard Real-time worker PPE compliance: detects helmets, vests, and violations live on the camera feed. YOLOv8s (PPE) Flutter Model ↗
SkyScout Real-time aerial and drone object detection across 10 VisDrone classes, live on-device. YOLOv8s (VisDrone) Flutter Model ↗
YOLO26 Next-gen NMS-free object detection YOLO26 Android iOS Model ↗
YOLOv26-Seg Real-time instance segmentation on-device with YOLOv26-Seg Nano. YOLOv26-Seg Nano Android Model ↗
YOLOv8 Real-time object detection & tracking in milliseconds YOLOv8n Android iOS Model ↗
App What it does Model Platforms Try it
Camera Vitals Contactless heart-rate from the front camera; frames never leave the phone EfficientPhys-rPPG Android iOS Model ↗
FundusGate Screens fundus photos for referable diabetic retinopathy, on-device (non-diagnostic). MobileNetV2 Flutter Model ↗
GradeVue Grades diabetic-retinopathy severity from a fundus photo, on-device (non-diagnostic). MobileNetV2 Flutter Model ↗
OraLens Detects caries and periapical lesions on a dental X-ray you upload, on-device (non-diagnostic). YOLO11n Flutter Model ↗
Skin Classifier On-device skin-lesion classification with severity-aware guidance (non-diagnostic) Skin-Cancer ViT Android iOS Model ↗
Voice Biomarker Speech-emotion + respiratory event detection (cough, wheeze) from mic audio wav2vec2 · YAMNet Android iOS Model ↗
Wellbeing Screener Fuses live face- and voice-emotion into an explainable mood check-in wav2vec2 · Emo-AffectNet Android iOS Model ↗
App What it does Model Platforms Try it
NeuTTS Nano On-device text-to-speech with voice cloning, via a three-stage NeuTTS Nano pipeline. NeuTTS Nano iOS Model ↗
Qwen TTS On-device text-to-speech with a custom voice, running the Qwen3-TTS pipeline on the NPU. Qwen3-TTS-0.6B iOS Model ↗
YamNet Classifies environmental sounds & audio events YAMNet Android iOS Model ↗
App What it does Model Platforms Try it
Chronos Forecast Probabilistic time-series forecasting with CSV import & interactive charts Chronos-Bolt Android iOS Model ↗
SentryWave Streams live sensor data, forecasts it with a quantile fan, and flags anomalies that break the band. Chronos-Bolt-tiny Flutter Model ↗

🧩 Build your own, by vibe-coding it

Claude Code, Codex, and Cursor will vibe-code you a web app in minutes. Ask them for an app that runs a model on the phone's NPU and they stall, because on-device deployment is not something they know how to do.

That is the gap Melange fills, and it is the easiest way in the world to put AI on-device today. Every app in this repo was built the same way: generate the integration code with Melange, paste it in, done. Copy a use case from here and the on-device feature drops straight into your app, the same vibe-coding loop you already use.

Dropping it into an existing project is about 3 lines:

Android , in build.gradle.kts:

dependencies { implementation("com.zeticai.mlange:mlange:+") }


val model = ZeticMLangeModel(context = this, tokenKey = "YOUR_KEY", modelName = "Team_ZETIC/YOLO26")
val outputs = model.run(inputs)   // NPU-accelerated, on-device

iOS , via Swift Package Manager → https://github.com/zetic-ai/ZeticMLangeiOS.git:

let model = try ZeticMLangeModel(tokenKey: "YOUR_KEY", name: "Team_ZETIC/YOLO26", version: 1)
let outputs = try model.run(inputs: inputs)

Bring your own model: upload it to Melange, it converts and NPU-optimizes automatically, then hands you back a phone-ready build in about an hour, not months of hardware tuning.

This gallery grows by contribution, and the bar is one question: would a stranger clone this and actually use it?

  1. Drop your app in apps/<YourApp>/ with Android/ and/or iOS/
  2. Add a meta.json (see any existing app) and a README.md
  3. Run python3 scripts/generate_catalog.py to add it to the catalog
  4. Prove it runs on a real device (demo GIF in the PR)

Full guide → CONTRIBUTING.md. Questions → Discord.

Star History

Built by ZETIC · Powered by Melange

Contributors

If a phone-native AI app made you go "wait, that runs offline?" , then ⭐ star it. It's how the next dev finds it.

App source is Apache 2.0 : use it commercially or privately, however you like. The Melange SDK itself is a proprietary library under the ZETIC Terms of Service.