Research
Explore our publications and preprints advancing healthcare through rigorous AI evaluation.
Building The Health Chatbot Users’ Guide
General-purpose large language models (LLMs) are now commonplace throughout society, becoming de facto health advisors for millions worldwide1. The public […]
MedAgentBrief for Hospital Course Summarization: Safety, Use, and Discharge Documentation Burden
mportance: High-quality discharge summaries are essential for safe care transitions but contribute substantially to clinician documentation burden and burnout. While […]
Scaling medical AI across clinical contexts
Medical artificial intelligence (AI) tools, including clinical language models, vision–language models and multimodal health record models, are used to summarize […]
Uses of generative AI by non-clinician staff at an academic medical center
Large language model (LLM) chat tools have the potential to transform healthcare workflows by improving efficiency and reducing administrative burdens. […]
Adoption and Use of LLMs at an Academic Medical Center
While large language models (LLMs) can support clinical documentation needs, standalone tools struggle with “workflow friction” from manual data entry. […]
“I Double Checked It with My Own Knowledge:” Physician Perspectives on the Use of AI Chatbots for Clinical Decision-Making
AI chatbots are proliferating in healthcare systems. It is essential to explore how physicians use these tools in order to […]
Elevating Management Reasoning to Preserve Professional Identity in the AI Era
AI systems are rapidly approaching expert-level diagnostic reasoning; however, management reasoning —the art of translating diagnoses into personalized care—remains distinctly […]
Holistic evaluation of large language models for medical tasks with MedHELM
While large language models (LLMs) achieve near-perfect scores on medical licensing exams, these evaluations inadequately reflect the complexity and diversity […]
MedAgentBench v2: Improving Medical LLM Agent Design
MedAgentBench is the first benchmark for evaluating LLM agents on clinical tasks in a FHIR-compliant EHR. In this paper, we […]
Parallel pressures: the common roots of doctor bullshit and large language model hallucinations
The phenomenon of doctors presenting unfounded statements with unwavering arrogance—colloquially known as “bullshit”—has long been recognised in medical practice. In […]
Latest News
View allGet the latest on our studies, grant awards, and media coverage.
