Simulated clinical encounters where the model must gather information over several turns rather than answer one question.
Audited by MedCheckSchmidgall et al., 2024
Key facts
| What it measures | Simulated clinical encounters where the model must gather information over several turns rather than answer one question. |
| Who should care | Teams building agents rather than chatbots. |
| Use it when | Evaluating sequential decision making and information gathering. |
| Do not use it for | You want a fast single-number comparison. |
| Score scale | Task success rate across simulated encounters. |
| Grader method | unknown |
| First released | 2024 |
| Languages | English |
| Use cases | agentic, clinical decision support |
| Citation | Schmidgall et al., 2024 |
| Status | active |
Frequently asked questions
What does AgentClinic measure?
Simulated clinical encounters where the model must gather information over several turns rather than answer one question.
Who should use AgentClinic?
Teams building agents rather than chatbots. Evaluating sequential decision making and information gathering.
What should AgentClinic not be used for?
You want a fast single-number comparison.
How are AgentClinic scores reported?
Task success rate across simulated encounters. Scores from different benchmarks are not comparable to each other.
Is AgentClinic independent?
No conflicts of interest have been verified for AgentClinic in this registry as of 2026-08-05. Absence of a recorded conflict means none has been verified, not that none exists.
Compare with
Clinical reasoning in the emergency room, built from real de-identified ER records.
A realistic virtual electronic health record environment where agents must complete tasks by taking actions, n
Compares thinking models and multi-agent frameworks on complex medical reasoning that single-pass answering fa
Interactive sequential benchmarking that follows a case through stages the way a real clinic does.
Whether a model asks the right follow-up question when it does not have enough information, instead of guessin
A multi-agent simulator where models play clinician, patient and examiner roles through a full interaction.
