MarginData Labs • Private Build

Margin Assistant

Private local-first AI companion in final tuning for notes, recall and comprehension

› Screenshots

3 planned
Local user interface displaying real-time speech pulse and structured context indicators.

Local user interface displaying real-time speech pulse and structured context indicators.

PREVIEW
#01

Setup/onboarding wizard with safe data.

· coming soon ·
#02

Live transcription/notes HUD.

· coming soon ·

› Technical Stack

Local LLMs RAG OCR Hybrid AI

› Architecture Pipeline

Audio/OCR Context →RAG Retrieval →Local/Cloud LLM Router →Notes & Recall →Meeting Pulse

› The Problem

A real-time meeting companion must help with transcription, recall and live notes while staying local-first, packageable and careful with private context.

› What I Built

I built Margin Assistant as a private local-first meeting companion in final tuning: Whisper transcription, Ollama/Groq routing, RAG document import, OCR/text capture, setup wizard, watchdog boot, installer build and integrity checks.

› Core Capabilities

  • Real-time Whisper transcription with speaker-turn oriented notes.
  • Hybrid local/cloud routing through Ollama and Groq modes.
  • Five-step setup/onboarding wizard with audio diagnostics and RAG import.
  • OCR/text capture and private project/document recall.
  • Tamper/integrity verification and secure build scripts.
  • Status HUD and visual indicators for conversation assistance.

› Technical Decisions

01

Keep the public release private until packaging, privacy and reliability controls are stable.

02

Start Ollama only when local/hybrid mode needs it, allowing cloud-only operation too.

03

Use explicit RAG/import flows so the assistant grounds answers in known documents.

04

Add integrity verification and installer scripts because distribution changes the threat model.

05

Avoid emotion-detection claims; position meeting outputs as notes, recall and support signals.

› What This Demonstrates

Local AI desktop engineering: Whisper, RAG, OCR, hybrid model routing, setup automation, packaging, integrity checks and responsible release discipline.

› Limitations & Next Steps

  • Finalize packaging and update flow before wider release.
  • Tighten security controls around captured context and screen/OCR workflows.

› Project Links