Project Caitlin
Web applicationWeb App
Built as a local, sovereign command mind that reasons, sees, remembers, and self-improves on a single workstation

Project Caitlin

Local-first / Windows / RTX 3080/Hero still selected/2026
← All Projects
Context
Local-first / Windows / RTX 3080
Audience
Operator / single user / sovereign
Format
Local AI command system
Production
Local backend on 127.0.0.1:8765
Web AppAI SystemLocal-FirstMission Control
Case study deck

Application Design Narrative

Built for clarity
01

Mission Control

The Mission Control GUI surfaces every layer of Caitlin in one terminal-style interface: chat with streaming tool calls, memory, runtime health, vision, self-upgrades, log taxonomy and sovereignty policies.

02

Challenge

Build a local-first command mind that can reason, see, remember and self-improve on a single workstation without leaking sensitive context out to the cloud, while staying governed by explicit sovereignty rules.

03

Product Strategy

A ThreadingHTTPServer backend on 127.0.0.1:8765 routes intent through tiered model profiles (router, brain_fast, brain_deep) with Caitlin as the command mind coordinating Brandon (code worker) and Baba (analysis worker). The CustomTkinter Mission Control surfaces every layer, Chat, Memory, Runtime, Vision, Upgrades, Logs and Policies, behind a calm terminal-style design.

04

Capabilities

Mission Control GUIChromaDB vector memoryLocal vision pipelineSelf-upgrade sandboxSovereignty policy engineHero stills and image set
05

Product Surfaces

  • Mission Control GUI (CustomTkinter)
  • Chat, Memory, Runtime, Vision tabs
  • Upgrades, Logs, Policies tabs
  • ChromaDB vector store with RAG
  • Local Ollama model orchestration
06

Outcome / Intended Impact

A working hybrid cognitive engine: ChromaDB vector memory with RAG and archivist pruning, local vision through moondream2 and qwen3vl-fast, a sandbox-gated self-upgrade pipeline with pytest matrix and approval workflow, and YAML-based sovereignty policies constraining autonomous behaviour, all observable through one local Mission Control GUI.

A local, Windows-first AI command system. A hybrid cognitive engine pairing a local RTX 3080 for vision and fallback with high-context API models for reasoning, run entirely on localhost through a CustomTkinter Mission Control GUI, a Streamlit dashboard and a ChromaDB-backed vector memory powered by Ollama.

Built to make a workstation think, see, and remember on its own.

KREO local AI system case study

Interface stills - click to expand

Caitlin Mission Control chat interface with streaming tool calls and recalled memory
Caitlin memory tab with ChromaDB vector embedding plot
Caitlin runtime doctor showing VRAM, tier SLO budgets and model residency
Caitlin vision tab for screen and image analysis through the VRAM airlock
Caitlin self-upgrade review queue with shadow-branch sandbox gate
Caitlin live log stream filtered by routing, memory, orchestration, safety and health
Caitlin sovereignty policy viewer with approval queue and self-upgrade test matrix
Caitlin Mission Control chat interface with streaming tool calls and recalled memory

Chat: conversational command interface with streaming responses, tool-call tracking and memory recall.

Caitlin memory tab with ChromaDB vector embedding plot

Memory: ChromaDB-backed vector store with embedding map, archivist maintenance and Obsidian vault sync.

Caitlin runtime doctor showing VRAM, tier SLO budgets and model residency

Runtime: doctor checks, tier SLO budgets, VRAM airlock and live model residency across the worker pool.

Caitlin vision tab for screen and image analysis through the VRAM airlock

Vision: local moondream2 and qwen3vl-fast for screen capture and image analysis through the VRAM airlock.

Caitlin self-upgrade review queue with shadow-branch sandbox gate

Upgrades: sandbox-verified self-upgrade pipeline with shadow-branch gate and human approval on every diff.

Caitlin live log stream filtered by routing, memory, orchestration, safety and health

Logs: streaming agent event taxonomy filtered across routing, memory, orchestration, safety and health.

Caitlin sovereignty policy viewer with approval queue and self-upgrade test matrix

Policies: sovereignty gates, runtime profile, approval queue and the self-upgrade pytest matrix.