Johri, Shreya https://orcid.org/0000-0002-2388-3913
Jeong, Jaehwan
Tran, Benjamin A.
Schlessinger, Daniel I. https://orcid.org/0000-0001-5736-8891
Wongvibulsin, Shannon
Barnes, Leandra A.
Zhou, Hong-Yu https://orcid.org/0000-0002-1256-7050
Cai, Zhuo Ran
Van Allen, Eliezer M. https://orcid.org/0000-0002-0201-4444
Kim, David https://orcid.org/0000-0003-0151-5121
Daneshjou, Roxana https://orcid.org/0000-0001-7988-9356
Rajpurkar, Pranav https://orcid.org/0000-0002-8030-3727
Article History
Received: 8 August 2023
Accepted: 1 October 2024
First Online: 2 January 2025
Competing interests
: R.D. reports receiving personal fees from DWA, personal fees from Pfizer, personal fees from L’Oreal, personal fees from VisualDx and stock options from MDAlgorithms and Revea outside the submitted work and has a patent for TrueImage pending. D.I.S. is the co-founder of FixMySkin Healing Balms, a shareholder in Appiell Inc. and K-Health, a consultant for Appiell Inc. and LuminDx and an investigator for AbbVie and Sanofi. E.M.V.A. serves as an advisor to Enara Bio, Manifold Bio, Monte Rosa, Novartis Institute for Biomedical Research and Serinus Bio. E.M.V.A provides research support to Novartis, Bristol Myers Squibb, Sanofi and NextPoint. E.M.V.A. holds equity in Tango Therapeutics, Genome Medical, Genomic Life, Enara Bio, Manifold Bio, Microsoft, Monte Rosa, Riva Therapeutics, Serinus Bio and Syapse. E.M.V.A. has filed for institutional patents on chromatin mutations and immunotherapy response and methods for clinical interpretation and provides intermittent legal consulting on patents to Foaley & Hoag. E.M.V.A. also serves on the editorial board of Science Advances. The other authors declare no competing interests.
: The CRAFT-MD framework is designed to enable faster evaluation of LLMs for leading clinical conversations and to uncover limitations to guide future model development. These LLMs could enhance clinical workflows by engaging in preliminary conversations with patients, collecting and summarizing relevant medical information and presenting these data to doctors before patient visits, potentially improving the effectiveness of doctor–patient interactions. These LLMs could be more effective than the pre-visit questionnaires, given their ability to lead dynamic conversations. However, this will require not only developing more capable LLMs but also making them more fault tolerant and cognizant of appropriate empathetic behavior.