From b9e0dfa1c925651ac455e15ec81f7b778cec9f21 Mon Sep 17 00:00:00 2001 From: Mathias Date: Thu, 1 Oct 2026 23:27:47 +0200 Subject: [PATCH] docs(homelab): two-engine mode, its settings and why every model must be local Co-Authored-By: Claude Sonnet 5.5 --- docs/homelab-integration.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/homelab-integration.md b/docs/homelab-integration.md index 3a003b9..8181592 100644 --- a/docs/homelab-integration.md +++ b/docs/homelab-integration.md @@ -28,6 +28,14 @@ it** — endpoints and aliases drift, and this file is a snapshot (2026-06-06), `iguana/gemma4-26b`, which silently drops the head above it), `TAPIR_UPLOAD_CHAT_MODEL` (`iguana/gemma4-26b`; `koala/phi4-mini`'s 8,192-token context 400s on an hour of speech). Needs `ffmpeg` + `ffprobe` in the runtime image; Tapir's own ingress body limit for a 200 MB upload is unverified (infra). + **Two-engine mode (ADR-034), off unless `TAPIR_RECONCILE_BASE_MODEL` is set:** it runs + `iguana/pianissimo` (the base text) and `TAPIR_TRANSCRIBE_MODEL` (kb-whisper) on the same audio, then a + LOCAL chat model (`TAPIR_RECONCILE_MODEL`, e.g. `iguana/gemma4-26b`: 92% against a speaker's blind answers + at ~2 s a call; `iguana/gemma4-31b` 97% but ~5x slower) chooses between their disagreements. + `TAPIR_RECONCILE_CHECK_ORDER=true` asks twice per dispute with the order swapped (doubles the time). + Every model must start `koala/` or `iguana/`: a cloud alias is a start-up error. The default job timeout is + 60 minutes. `iguana/pianissimo` is KlangAI's Swedish ASR (a Parakeet/FastConformer on MLX, served by a small + FastAPI shell on iguana:8102) and speaks the same `/v1/audio/transcriptions` API. - **Auth key:** treat as a secret via the SecretStore port; do not hardcode in committed code. NOTE: the documented `sk-local-123` returned `401` on `30401/v1/models` (2026-06-02) — it is stale or the gateway now enforces the `LITELLM_MASTER_KEY` (1Password `op://HomeLab/LITELLM_MASTER_KEY`).