Multilingual medical benchmark covering six widely spoken languages, built to widen access beyond English.
Audited by MedCheckWang et al., 2024
Key facts
| What it measures | Multilingual medical benchmark covering six widely spoken languages, built to widen access beyond English. |
| Who should care | Teams deploying outside English-speaking markets. |
| Use it when | Cross-language medical capability comparison. |
| Do not use it for | Depth in any single language. |
| Score scale | Percent accuracy per language. |
| Grader method | unknown |
| First released | 2024 |
| Languages | English, Chinese, Spanish, French, Hindi, Arabic |
| Use cases | exam knowledge, equity |
| Citation | Wang et al., 2024 |
| Status | active |
Frequently asked questions
What does XMedBench measure?
Multilingual medical benchmark covering six widely spoken languages, built to widen access beyond English.
Who should use XMedBench?
Teams deploying outside English-speaking markets. Cross-language medical capability comparison.
What should XMedBench not be used for?
Depth in any single language.
How are XMedBench scores reported?
Percent accuracy per language. Scores from different benchmarks are not comparable to each other.
Is XMedBench independent?
No conflicts of interest have been verified for XMedBench in this registry as of 2026-08-05. Absence of a recorded conflict means none has been verified, not that none exists.
Compare with
Multi-specialty medical questions written by clinicians and students across African countries, built to test w
Chinese-language evaluation of physical and mental health knowledge in large models.
Comprehensive Chinese medical benchmark spanning exam knowledge and clinical case work.
Chinese medical licensing exam questions with expert annotations for reasoning and difficulty.
Evaluation framework and dataset covering several medical specialties, built around clinician-style diagnostic
Spanish healthcare specialization exam questions requiring multi-step reasoning.
