gallery

Model Serving & MLOps

A mobile app that lets you run powerful open‑source large language models entirely on‑device for private, offline AI.

Track releases GitHub

Kotlin Latest 1.0.15 · 13d ago Security brief →

Features

Run state‑of‑the‑art LLMs (e.g., Gemma 4) fully offline on Android/iOS
Agent Skills – augment the model with tools like Wikipedia, maps, and visual cards
Thinking Mode – view step‑by‑step reasoning for supported models
Multimodal Ask Image – analyze photos or camera input locally
Audio Scribe – real‑time transcription and translation of voice recordings

Recent releases

View all 6 releases →

No immediate action

1.0.15 New feature 13d

Dynamic system prompt adjustment

Open

Config change

1.0.14 New feature 15d

Auth

MCP support + agent skills

Open

1.0.13 Feature 29d

Notable features

Support Gemma 4 built‑in Multi Token Prediction (MTP) for faster decoding in AI Chat, Ask Image, Ask Audio, and Prompt Lab

Full changelog

Support Gemma 4's built-in Multi Token Prediction (MTP) to accelerate decoding. Check out the blog post for more details. Try it in AI Chat, Ask Image, Ask Audio, and Prompt Lab (turn on the "Support speculative decoding" in the config dialog).
Bug fixes.

View release on GitHub

1.0.12 New feature 1mo

Notable features

Gemma3 1B NPU support for Snapdragon SoCs

Full changelog

Add Gemma3 1B NPU support for Qualcomm Technologies SoCs. Try it in Prompt Lab! Check out the blog post for more info.

If your device is supported, you will see a new "NPU" option in PromptLab -> Gemma3-1B-IT model card:
- Installing via Play Store? No action needed; the correct libraries are bundled with the app automatically for supported SoCs.
- Installing via APK here? Check the supported device list below for each file to ensure compatibility with your device.
  
  ai-edge-gallery-sm8550.apk:
  - Samsung: Galaxy S23, S23+, S23 Ultra, Galaxy Z Fold 5, Galaxy Z Flip 5, Galaxy Tab S9 Series.
  - OnePlus: OnePlus 11, OnePlus 12R.
  - Xiaomi: Xiaomi 13, 13 Pro, 13 Ultra.
  - Motorola: Edge 40 Pro (Edge+ 2023), Razr 40 Ultra (Razr+).
  - Gaming/Niche: ASUS ROG Phone 7, RedMagic 8 Pro, Sony Xperia 1 V, iQOO 11.
  ai-edge-gallery-sm8650.apk:
  - Samsung: Galaxy S24 Ultra (globally), Galaxy S24/S24+ (US/Canada/China versions), Galaxy Z Fold 6, Galaxy Z Flip 6.
  - OnePlus: OnePlus 12.
  - Xiaomi: Xiaomi 14, 14 Pro, 14 Ultra.
  - ASUS: Zenfone 11 Ultra, ROG Phone 8 / 8 Pro.
  - Others: RedMagic 9 Pro, Honor Magic 6 Pro, iQOO 12, Nubia Z60 Ultra.
  ai-edge-gallery-sm8750.apk:
  - Samsung: Galaxy S25 Ultra (and S25/S25+ in most regions).
  - Xiaomi: Xiaomi 15, 15 Pro.
  - OnePlus: OnePlus 13.
  - Realme: GT 7 Pro.
  - ASUS: ROG Phone 9 Series.
  - Others: RedMagic 10 Pro, iQOO 13, Honor Magic 7 Series.
  ai-edge-gallery-sm8850.apk:
  - Samsung: Galaxy S26, S26+, and S26 Ultra (Snapdragon version used globally for Ultra; regional for S26/S26+).
  - OnePlus: OnePlus Ace 6T (released late 2025), OnePlus 15R.
  - Vivo: Vivo S50 Pro Mini, Vivo X300 FE.
  - iQOO: iQOO 15R, iQOO Z11 Turbo.
  - Honor: Honor GT 2 Pro.
  - Motorola: Motorola Signature, Motorola Razr Fold (2026 models).