Medical EvalsBenchmark analysis
DDXPlus: a correct top diagnosis can hide a weak differential
Interpret differential recall, precision and pathology accuracy as different diagnostic targets.
Original analysis / Medical Evals
Read the benchmark closely.
DDXPlus separates a simulated pathology from its reference differential. MedR-Bench separates examination gathering, diagnosis, treatment and written reasoning. We analyze those task boundaries and the original scoring rules, with selected version-matched historical results. Our coverage explorer and guides are original analytical resources. The benchmarks and experiments belong to their credited authors; this site has not run the displayed models or created a new patient dataset.
5 min read
Benchmark analysis
MedR-Bench: read the gap between requested and supplied examinations
Understand what changes between one-turn, free-turn and oracle diagnosis conditions.
Benchmark analysis
MedR-Bench reasoning scores: three denominators, three questions
Analyze efficiency, factuality and completeness without treating written explanations as hidden model reasoning.