Chinese medical licensing exam questions with expert annotations for reasoning and difficulty.
Audited by MedCheckLiu et al., NeurIPS 2023
Key facts
| What it measures | Chinese medical licensing exam questions with expert annotations for reasoning and difficulty. |
| Who should care | Researchers benchmarking Chinese medical knowledge. |
| Use it when | Licensing-level knowledge comparison in Chinese. |
| Do not use it for | Predicting clinical performance. Exam scores correlate poorly with real utility. |
| Score scale | Percent accuracy, multiple choice. |
| Grader method | unknown |
| First released | 2023 |
| Languages | Chinese |
| Use cases | exam knowledge |
| Citation | Liu et al., NeurIPS 2023 |
| Status | active |
Frequently asked questions
What does CMExam measure?
Chinese medical licensing exam questions with expert annotations for reasoning and difficulty.
Who should use CMExam?
Researchers benchmarking Chinese medical knowledge. Licensing-level knowledge comparison in Chinese.
What should CMExam not be used for?
Predicting clinical performance. Exam scores correlate poorly with real utility.
How are CMExam scores reported?
Percent accuracy, multiple choice. Scores from different benchmarks are not comparable to each other.
Is CMExam independent?
No conflicts of interest have been verified for CMExam in this registry as of 2026-08-05. Absence of a recorded conflict means none has been verified, not that none exists.
Compare with
Multi-specialty medical questions written by clinicians and students across African countries, built to test w
Chinese-language evaluation of physical and mental health knowledge in large models.
Comprehensive Chinese medical benchmark spanning exam knowledge and clinical case work.
Evaluation framework and dataset covering several medical specialties, built around clinician-style diagnostic
Spanish healthcare specialization exam questions requiring multi-step reasoning.
Indian medical entrance exam questions across many subjects. Very large and very widely used.
