Health Systems Launch Challenge To Compare, Rank AI Models

Modern Healthcare (11/13, Turner, Subscription Publication) reports that Mass General Brigham, Emory Healthcare, University of Wisconsin School of Medicine and Public Health, University of Washington School of Medicine’s Department of Radiology and industry group American College of Radiology have “launched an interactive challenge where clinicians can compare and rank how different AI models perform in clinical settings.” Called the Healthcare AI Challenge Collaborative, “participating clinicians from those organizations will initially examine radiology AI models but Mass General Brigham Chief Data Science Officer Dr. Keith Dreyer said there are plans to expand to other specialties.” The aim “is to create an arena environment to evaluate how models perform on real cases seen by clinicians, Dreyer said.” Dreyer also “said the group plans an additional three or four competitions by early next year that will focus on pathology and clinical notetaking.”