Why it matters
Instrumentation is part of the design.
Suppression accuracy, citation coverage, triage SLA, groundedness, moat-share of impressions, and cost/reliability all need to be observable if this surface is going to behave like a clinical product rather than a content feed. These dashboards are intentionally low fidelity — they are there to make the gates legible, not beautiful.
Operations
Dashboard wireframes
Select a dashboard below. Dashboard A covers product metrics and feed health. Dashboard B is owned by clinical ops and the medical director. Dashboard C is for engineering and finance.
Operational dashboards
| Source | Fires | SLA | Compliance |
|---|---|---|---|
| 1.2 “Worse” responses | 64 | 4 min | 99% |
| 2.3 Check-in free text | 38 | 11 min | 98% |
| 1.1 Out-of-range trend | 12 | 3 min | 100% |
| Failure | Rate | Degradation path shown to user |
|---|---|---|
| EHR fetch failure | 0.8% | Trend cards withheld · freshness note on record data |
| Retrieval failure | 0.3% | Card dropped · quiet-state floor applies |
| Guardrail rejection | 1.9% | Replaced by escalation or quiet-state card |
| Stale-data threshold | 1.1% | “As of your May 12 visit” framing · no trend rendered |
| Vendor | p95 | Status |
|---|---|---|
| LLM gateway · primary | 870ms | Healthy |
| LLM gateway · fallback | — | Standby |
| EHR integration (FHIR) | 1.2s | Degraded |
| Citation corpus / RAG | 210ms | Healthy |
Dashboard A
Feed health
Moat-card share, follow-up loop closure, feed-to-agent rate, journey open rate, and ranking-eligibility funnel. Product and engineering.
Dashboard B
Clinical safety
Suppression accuracy (release gate), citation coverage, groundedness sampling, and triage SLA. Clinical ops and medical director.
Dashboard C
Cost and reliability
LLM spend by card type, template vs generation mix, pipeline error rates, and vendor health. Engineering and finance.