When evaluation becomes intervention in clinical AI
📅
👥 13 authors
arXiv:2611.18297v1
Authors
Anthony Abou MradAviona ContiSamuel SchmidgallJayanth PratapRuhika IyerJoseph KimKing ShiYann SakrefLuis M. AhumadaLisa KnowltonAndrew M. CameronKhyzer AzizJeffrey K. Jopling
Abstract
AI judges, models that grade another system's output against a rubric, extend clinical review to the scale at which clinical AI writes. When teams use judge assessments to select a prompt or train a model, the judge becomes part of the intervention. Selection can then favor errors the judge overlooks. We describe what a judge's report must contain and the independent clinical test each judge-driven change needs.
Paper Information
- arXiv ID:
- 2611.18297v1
- Published: