When evaluation becomes intervention in clinical AI

📅 👥 13 authors arXiv:2611.18297v1

Authors

Abstract

AI judges, models that grade another system's output against a rubric, extend clinical review to the scale at which clinical AI writes. When teams use judge assessments to select a prompt or train a model, the judge becomes part of the intervention. Selection can then favor errors the judge overlooks. We describe what a judge's report must contain and the independent clinical test each judge-driven change needs.

Paper Information

arXiv ID:
2611.18297v1
Published:

Related Categories