LocalAI Chat — Offline GGUF Assistant

About

LocalAI Chat lets you load and chat with any GGUF language model 
directly in your browser — no internet connection required after 
the extension is installed.

HOW IT WORKS
- Click the extension icon → a new tab opens automatically
- Drop any .gguf model file onto the page
- The model loads locally using WebAssembly (llama.cpp)
- Chat with full streaming output, just like ChatGPT — but 100% private

FEATURES
✓ Fully offline — zero network requests during inference
✓ Works with any GGUF model (Llama 3, Mistral, Qwen, Gemma, Phi, and more)
✓ Streaming token output with live tokens-per-second display
✓ Adjustable temperature, top-p, max tokens, context length, CPU threads
✓ Custom system prompt
✓ Chat history with copy button on every message
✓ Stop generation at any time
✓ New chat / change model buttons
✓ No account, no API key, no subscription

RECOMMENDED MODELS
Any Q4_K_M quantized model works well. Good starting points:
- Llama-3.2-1B-Instruct-Q4_K_M (fast, ~800 MB)
- Llama-3.2-3B-Instruct-Q4_K_M (balanced, ~2 GB)
- Mistral-7B-Instruct-Q4_K_M (powerful, ~4 GB)

Download models from: huggingface.co

PRIVACY
Your conversations and model files never leave your computer.
No analytics. No tracking. No telemetry. Ever.