Skip to content

Ambient RAG

Repo: savvydealer-adam/ambient-rag · Path: not cloned to ~/ · Owner: Adam Status: Prototype (Phase 4 in progress) · % Done: 30 · Last commit: 2026-03-05 Deployed: not deployed (local Windows daemon)

What it is

Local-first Windows capture + memory pipeline for an always-on assistant brain. Records desktop focus, screenshots, and optional audio, OCRs / transcribes, redacts PII, and makes it all searchable via a local FastAPI.

Why it exists

An always-on personal context layer for Adam — capture what he's been working on, extract action items and reminders, and let downstream tools query that context without cloud upload. Everything stays on the machine.

How it works

Python capture daemon + FastAPI + SQLite + local embeddings. - Capture: mss+Pillow screenshots, active-window metadata, optional audio - Pipeline: OCR (tesseract stub), STT (stub or faster-whisper), PII redaction (email/phone/SSN) - Storage: SQLite with timeline/query/search, local semantic embeddings for /ask - Analysis: daily rollup action-item extractor (owner/speaker/due-hint), tasks table, reminders - Quality-gate telemetry at /metrics - Endpoints: /health /status /metrics /ask /timeline /search /daily-rollup /daily-narrative /tasks /reminders /retention/sweep /events/mock - Windows startup task scripts for auto-run on login

What's done

  • All Phase 1–3 endpoints live
  • PII redaction before persistence
  • Task + reminder extraction from daily rollup
  • Post-capture cleanup, dedupe, entity extraction, confidence scoring

What's next

  • Finish Phase 4 quality-gate work
  • Tighten Whisper STT path (currently optional)
  • Decide long-term: own product vs. feeder into Core Data API

Where the code lives

  • Repo: savvydealer-adam/ambient-rag
  • Entry: uvicorn ambient_rag.api.main:app --reload --app-dir src
  • Capture daemon: scripts/run_capture.ps1
  • Install startup: scripts/install_startup_task.ps1

Integrations

  • Potential feeder into core-data-api (tasks, reminders, decisions)
  • Adjacent to meet-assistant (deprecated) and Spinach call pipeline

Don't rebuild this — extend it

If you want local desktop capture + search for anything on Adam's machine, extend this pipeline rather than spinning up another capture daemon.