AI Tech should Augment Physician Decision-Making, not Replace It

The use of artificial intelligence (AI) in clinical health care has the potential to transform health care delivery but it should not replace physician decision-making, says the American College of Physicians (ACP) in a new policy paper. "Artificial Intelligence in the Provision of Health Care," published in the Annals of Internal Medicine, offers recommendations on the ethical, scientific, and clinical components of AI use, and says that AI tools and systems should enhance human intelligence, not supplant it.

"AI has the potential to aid in solving some of the issues currently plaguing the health care industry, such as clinician shortages, burnout, and administrative burdens," said Isaac O. Opole, MBChB, PhD, MACP, president, ACP. "However, to ensure that we are able to realize the most benefit, with the fewest harms to patients, we need to fully understand the implications of the technology that we are implementing."

To navigate the risks and ensure best practices, ACP recommends that AI-enabled technology should be limited to a supportive role in clinical decision-making. ACP notes that when being used for clinical decision-making, the technology would more appropriately be called "augmented" intelligence, since the tools should ideally be used to assist clinicians, not replace them. The tools must be developed, tested, and used transparently, while prioritizing privacy, clinical safety, and effectiveness. The use of technology should actively work to reduce, not exacerbate, disparities, ensuring a fair and just health care system. ACP recommends that to ensure accountability and oversight of AI-enabled medical tools, there should be a coordinated federal strategy involving oversight of AI by governmental and non-governmental regulatory entities. The tools should be designed to reduce physician and other clinician burdens in support of patient care, while guided by unwavering principles of medical ethics.

Additionally, to ensure that AI tools are administered safely, ACP advises that training on AI in medicine be provided at all levels of medical education. Physicians must be able to both use the technology and remain able to make appropriate clinical decisions independently, in the case that AI decision support becomes unavailable. Lastly, efforts to quantify the environmental impacts of AI must continue and mitigation of those impacts should be considered.

"AI has already made an impact in the medical community, and ACP is excited about what it means for the future of health care," remarked Dr. Opole. "There is so much potential to use this revolutionary technology to improve clinical practices and promote health equity. As we incorporate AI into medical practice, it is essential to maintain an awareness of the clinical and ethical implications of AI technology and its impacts on patient well-being."

Daneshvar N, Pandita D, Erickson S, Sulmasy LS, DeCamp M; ACP Medical Informatics Committee and the Ethics, Professionalism and Human Rights Committee.
Artificial Intelligence in the Provision of Health Care: An American College of Physicians Policy Position Paper.
Ann Intern Med. 2024 Jun 4. doi: 10.7326/M24-0146

Most Popular Now

Philips and Medtronic Advocacy Partnersh…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Medtronic Neurovascular, a leading innovator in neurovascular therapies, today announced a strategic advocacy partnership. Delivering timely stroke...

New AI Tool Predicts Protein-Protein Int…

Scientists from Cleveland Clinic and Cornell University have designed a publicly-available software and web database to break down barriers to identifying key protein-protein interactions to treat with medication. The computational tool...

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...

New Research Shows Promise and Limitatio…

Published in JAMA Network Open, a collaborative team of researchers from the University of Minnesota Medical School, Stanford University, Beth Israel Deaconess Medical Center and the University of Virginia studied...

G-Cloud 14 Makes it Easier for NHS to Bu…

NHS organisations will be able to save valuable time and resource in the procurement of technologies that can make a significant difference to patient experience, in the latest iteration of...

Start-Ups will Once Again Have a Starrin…

11 - 14 November 2024, Düsseldorf, Germany. The finalists in the 16th Healthcare Innovation World Cup and the 13th MEDICA START-UP COMPETITION have advanced from around 550 candidates based in 62...

Hampshire Emergency Departments Digitise…

Emergency departments in three hospitals across Hampshire Hospitals NHS Foundation Trust have deployed Alcidion's Miya Emergency, digitising paper processes, saving clinical teams time, automating tasks, and providing trust-wide visibility of...

MEDICA HEALTH IT FORUM: Success in Maste…

11 - 14 November 2024, Düsseldorf, Germany. How can innovations help to master the great challenges and demands with which healthcare is confronted across international borders? This central question will be...

A "Chemical ChatGPT" for New M…

Researchers from the University of Bonn have trained an AI process to predict potential active ingredients with special properties. Therefore, they derived a chemical language model - a kind of...

Siemens Healthineers co-leads EU Project…

Siemens Healthineers is joining forces with more than 20 industry and public partners, including seven leading stroke hospitals, to improve stroke management for patients all over Europe. With a total...

MEDICA and COMPAMED 2024: Shining a Ligh…

11 - 14 November 2024, Düsseldorf, Germany. Christian Grosser, Director Health & Medical Technologies, is looking forward to events getting under way: "From next Monday to Thursday, we will once again...

In 10 Seconds, an AI Model Detects Cance…

Researchers have developed an AI powered model that - in 10 seconds - can determine during surgery if any part of a cancerous brain tumor that could be removed remains...