A retrieval system over contested clinical literature. It maps a debate; it does not resolve one.
A question-answering system over the clinical literature on post-traumatic stress, built around the fact that the literature does not agree with itself. An answer here sets out what the sources hold in common, where they part company, what remains unsettled, and — given the same prominence as the rest — what this corpus has nothing to say about.
Answers are built from retrieved passages and cited back to them. The system can still reach for something it knows rather than something it read — when it does, the review pass printed under every answer is where you find out. It is a reader rather than an authority, and it is checked rather than trusted.
The corpus is held in four separate layers rather than one pool. They are not tiers of authority, and they are not a quality ranking. They are positions in an argument, and they are kept apart so that each one has to be heard rather than being outvoted by whichever has the most pages.
A single pool would bury layers 3 and 4 under layers 1 and 2, because the establishment publishes more and is cited more. Giving each layer its own retrieval quota is what makes a disagreement visible instead of averaged away.
A question then moves through four stages:
Then a critic re-reads the finished answer against the passages it was built from and against the diagnostic criteria, looking for claims the sources do not support. Its findings are published alongside the answer under Self-review, rather than used to quietly revise it. An answer that needed correcting is more informative than one that appears not to have.
Three hosts in AWS, provisioned with Terraform and configured with Ansible: one for ingestion, one for the vector store, one serving the site. Postgres holds the chunked corpus and is the system of record; Chroma holds the embeddings and is rebuildable from it. A FastAPI service sits behind nginx and TLS.
Images are built, tagged and pushed to a private registry by a single script, which checks the working tree against the remote first and declines to deploy when nothing has changed, verifies the built artifact actually contains the change it was asked for, and bumps the version only once the deploy has succeeded.
Monitoring runs on a separate Kubernetes cluster that probes this site from outside it — Prometheus and Alertmanager, with alerts for a dead probe as well as a failing one, on the principle that a system should not be the only witness to its own health.
Answers are graded against a hand-written answer key: a set of questions with the responses a careful reader of this corpus should give, written down before the system was asked them. A harness runs the whole set and reports where the answers drifted from what the sources support.
That harness exists to find faults rather than to confirm good behaviour, and it has. A retrieval distance threshold that turned out never to be applied. Prompt scaffolding leaking into text meant for readers. A reviewer that could not see the diagnostic criteria it was reviewing against, and so reported correct citations as fabrications. A tendency to state facts about diagnostic manuals this corpus does not contain, and then cite a source that says nothing of the kind.
Each one is written up with how to reproduce it and what the fix would cost, whether or not the fix has shipped. The self-review printed under every answer is that same discipline running live, in public, on the answer you just read.
Not medical advice. This is a research tool: it reports what the literature says and where it disagrees. It does not diagnose and does not recommend treatment.
Julien Radoff · production build unknown · deployed 2026-11-03