Interactive sequential benchmarking that follows a case through stages the way a real clinic does.
Audited by MedCheckLiu et al., 2024
Key facts
| What it measures | Interactive sequential benchmarking that follows a case through stages the way a real clinic does. |
| Who should care | Teams building multi-turn clinical tools. |
| Use it when | Testing whether performance holds across a whole encounter, not one question. |
| Do not use it for | Single-turn comparison. |
| Score scale | Stage-level and end-to-end accuracy. |
| Grader method | unknown |
| First released | 2024 |
| Languages | Chinese, English |
| Use cases | agentic, clinical decision support |
| Citation | Liu et al., 2024 |
| Status | active |
Frequently asked questions
What does MedChain measure?
Interactive sequential benchmarking that follows a case through stages the way a real clinic does.
Who should use MedChain?
Teams building multi-turn clinical tools. Testing whether performance holds across a whole encounter, not one question.
What should MedChain not be used for?
Single-turn comparison.
How are MedChain scores reported?
Stage-level and end-to-end accuracy. Scores from different benchmarks are not comparable to each other.
Is MedChain independent?
No conflicts of interest have been verified for MedChain in this registry as of 2026-08-05. Absence of a recorded conflict means none has been verified, not that none exists.
Compare with
Simulated clinical encounters where the model must gather information over several turns rather than answer on
Clinical reasoning in the emergency room, built from real de-identified ER records.
A realistic virtual electronic health record environment where agents must complete tasks by taking actions, n
Compares thinking models and multi-agent frameworks on complex medical reasoning that single-pass answering fa
Whether a model asks the right follow-up question when it does not have enough information, instead of guessin
A multi-agent simulator where models play clinician, patient and examiner roles through a full interaction.
