gallery

Model Serving & MLOps

A mobile app that runs powerful open‑source Large Language Models (LLMs) entirely on‑device, offering private, offline generative AI with features like Agent Skills, multimodal image handling, audio transcription, and model benchmarking.

Track releases GitHub

Kotlin Latest 1.0.16 · 1mo ago Security brief →

Features

Run state‑of‑the‑art LLMs fully offline on mobile (Android/iOS) for private inference
Agent Skills: extend the model with tools such as Wikipedia lookup, maps, and custom community skills
Multimodal capabilities – Ask Image for object detection/visual puzzle solving
Audio Scribe: real‑time voice transcription and translation using on‑device models
Prompt Lab & Model Management: test prompts, tune parameters, download/benchmark a variety of open‑source models

Recent releases

View all 7 releases →

No immediate action

1.0.16 New feature 1mo

Model import UI enhancements

Open

No immediate action

1.0.15 New feature 2mo

Dynamic system prompt adjustment

Open

Config change

1.0.14 New feature 2mo

Auth

MCP support + agent skills

Open

1.0.13 Feature 2mo

Notable features

Support Gemma 4 built‑in Multi Token Prediction (MTP) for faster decoding in AI Chat, Ask Image, Ask Audio, and Prompt Lab

Full changelog

Support Gemma 4's built-in Multi Token Prediction (MTP) to accelerate decoding. Check out the blog post for more details. Try it in AI Chat, Ask Image, Ask Audio, and Prompt Lab (turn on the "Support speculative decoding" in the config dialog).
Bug fixes.

View release on GitHub

1.0.12 New feature 3mo

Notable features

Gemma3 1B NPU support for Snapdragon SoCs

Full changelog

Add Gemma3 1B NPU support for Qualcomm Technologies SoCs. Try it in Prompt Lab! Check out the blog post for more info.

If your device is supported, you will see a new "NPU" option in PromptLab -> Gemma3-1B-IT model card:
- Installing via Play Store? No action needed; the correct libraries are bundled with the app automatically for supported SoCs.
- Installing via APK here? Check the supported device list below for each file to ensure compatibility with your device.
  
  ai-edge-gallery-sm8550.apk:
  - Samsung: Galaxy S23, S23+, S23 Ultra, Galaxy Z Fold 5, Galaxy Z Flip 5, Galaxy Tab S9 Series.
  - OnePlus: OnePlus 11, OnePlus 12R.
  - Xiaomi: Xiaomi 13, 13 Pro, 13 Ultra.
  - Motorola: Edge 40 Pro (Edge+ 2023), Razr 40 Ultra (Razr+).
  - Gaming/Niche: ASUS ROG Phone 7, RedMagic 8 Pro, Sony Xperia 1 V, iQOO 11.
  ai-edge-gallery-sm8650.apk:
  - Samsung: Galaxy S24 Ultra (globally), Galaxy S24/S24+ (US/Canada/China versions), Galaxy Z Fold 6, Galaxy Z Flip 6.
  - OnePlus: OnePlus 12.
  - Xiaomi: Xiaomi 14, 14 Pro, 14 Ultra.
  - ASUS: Zenfone 11 Ultra, ROG Phone 8 / 8 Pro.
  - Others: RedMagic 9 Pro, Honor Magic 6 Pro, iQOO 12, Nubia Z60 Ultra.
  ai-edge-gallery-sm8750.apk:
  - Samsung: Galaxy S25 Ultra (and S25/S25+ in most regions).
  - Xiaomi: Xiaomi 15, 15 Pro.
  - OnePlus: OnePlus 13.
  - Realme: GT 7 Pro.
  - ASUS: ROG Phone 9 Series.
  - Others: RedMagic 10 Pro, iQOO 13, Honor Magic 7 Series.
  ai-edge-gallery-sm8850.apk:
  - Samsung: Galaxy S26, S26+, and S26 Ultra (Snapdragon version used globally for Ultra; regional for S26/S26+).
  - OnePlus: OnePlus Ace 6T (released late 2025), OnePlus 15R.
  - Vivo: Vivo S50 Pro Mini, Vivo X300 FE.
  - iQOO: iQOO 15R, iQOO Z11 Turbo.
  - Honor: Honor GT 2 Pro.
  - Motorola: Motorola Signature, Motorola Razr Fold (2026 models).