Can "Articulate Medical Intelligence Explorer" Outperform Primary Care Physicians?

A study suggests Articulate Medical Intelligence Explorer, a large language model (LLM)-based AI system optimized for diagnostic purposes, might perform better than primary care physicians.

 

The study included 159 case scenarios from providers in Canada, the United Kingdom and India, 20 primary care physicians compared to AMIE, and evaluations by specialist physicians and patient-actors. 

“AMIE demonstrated greater diagnostic accuracy and superior performance on 30 out of 32 axes according to the specialist physicians and 25 out of 26 axes according to the patient-actors,” researchers say. 

The randomized, double-blind crossover study found AMIE achieved higher top-1 and top-3 “differential diagnosis accuracy,” with the correct diagnosis ranked first in 29 percent of cases and within the top 10 in 59 percent of cases, the study found.