Evaluating Large Language Models on Real Clinician Chats.
525 physician-authored tasks spanning three clinician-facing use cases: care consult, writing and documentation, and medical research. Each example is designed to evaluate the next model response in a single-turn or multi-turn conversation between a clinician and a model.