Skip to content

Localaik

LLM Frameworks
Go Latest v0.2.1 · 2mo ago Security brief →

Features

  • Runs a single Docker container that emulates both Gemini and OpenAI API endpoints
  • Provides deterministic local inference using llama.cpp with Gemma models (4B/12B)
  • Supports PDF upload handling via internal pdftoppm conversion

Recent releases

View all 5 releases →
No immediate action
v0.2.1 New feature

Models API endpoints added

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
15
Forks
2
Languages
Go Shell Makefile

Install & Platforms

Install via
docker docker-compose

Beta — feedback welcome: [email protected]