Self-built · not client work biotech-rag-assistant · v1
Biotech RAG assistant: controls before the model
- Problem
- A controlled-document assistant that ranks by relevance alone will answer from a retired SOP when it is the closest match. And in my own workspace, AI agents produced 107 fabricated citations because a rule I wrote gave them no honest way to say "found nothing".
- What I did
- I designed and built the assistant trust layer first: validation, a status gate before ranking, a relevance gate that refuses, exact-span citations, and an ablation test that removes the status gate to show what breaks.
- Evidence you can inspect
- Live demo with deep links to the trap questions, public code, tests, the decision record, and a known gap pinned as a test.
- Limits
- Synthetic 10-document corpus. Deterministic retrieval: no language model writes answers yet. Not validated, not in production.