AI Tech should Augment Physician Decision-Making, not Replace It

The use of artificial intelligence (AI) in clinical health care has the potential to transform health care delivery but it should not replace physician decision-making, says the American College of Physicians (ACP) in a new policy paper. "Artificial Intelligence in the Provision of Health Care," published in the Annals of Internal Medicine, offers recommendations on the ethical, scientific, and clinical components of AI use, and says that AI tools and systems should enhance human intelligence, not supplant it.

"AI has the potential to aid in solving some of the issues currently plaguing the health care industry, such as clinician shortages, burnout, and administrative burdens," said Isaac O. Opole, MBChB, PhD, MACP, president, ACP. "However, to ensure that we are able to realize the most benefit, with the fewest harms to patients, we need to fully understand the implications of the technology that we are implementing."

To navigate the risks and ensure best practices, ACP recommends that AI-enabled technology should be limited to a supportive role in clinical decision-making. ACP notes that when being used for clinical decision-making, the technology would more appropriately be called "augmented" intelligence, since the tools should ideally be used to assist clinicians, not replace them. The tools must be developed, tested, and used transparently, while prioritizing privacy, clinical safety, and effectiveness. The use of technology should actively work to reduce, not exacerbate, disparities, ensuring a fair and just health care system. ACP recommends that to ensure accountability and oversight of AI-enabled medical tools, there should be a coordinated federal strategy involving oversight of AI by governmental and non-governmental regulatory entities. The tools should be designed to reduce physician and other clinician burdens in support of patient care, while guided by unwavering principles of medical ethics.

Additionally, to ensure that AI tools are administered safely, ACP advises that training on AI in medicine be provided at all levels of medical education. Physicians must be able to both use the technology and remain able to make appropriate clinical decisions independently, in the case that AI decision support becomes unavailable. Lastly, efforts to quantify the environmental impacts of AI must continue and mitigation of those impacts should be considered.

"AI has already made an impact in the medical community, and ACP is excited about what it means for the future of health care," remarked Dr. Opole. "There is so much potential to use this revolutionary technology to improve clinical practices and promote health equity. As we incorporate AI into medical practice, it is essential to maintain an awareness of the clinical and ethical implications of AI technology and its impacts on patient well-being."

Daneshvar N, Pandita D, Erickson S, Sulmasy LS, DeCamp M; ACP Medical Informatics Committee and the Ethics, Professionalism and Human Rights Committee.
Artificial Intelligence in the Provision of Health Care: An American College of Physicians Policy Position Paper.
Ann Intern Med. 2024 Jun 4. doi: 10.7326/M24-0146

Most Popular Now

Is Your Marketing Effective for an NHS C…

How can you make sure you get the right message across to an NHS chief information officer, or chief nursing information officer? Replay this webinar with Professor Natasha Phillips, former...

Welcome Evo, Generative AI for the Genom…

Brian Hie runs the Laboratory of Evolutionary Design at Stanford, where he works at the crossroads of artificial intelligence and biology. Not long ago, Hie pondered a provocative question: If...

We could Soon Use AI to Detect Brain Tum…

A new paper in Biology Methods and Protocols, published by Oxford University Press, shows that scientists can train artificial intelligence (AI) models to distinguish brain tumors from healthy tissue. AI...

Telehealth Significantly Boosts Treatmen…

New research reveals a dramatic improvement in diagnosing and curing people living with hepatitis C in rural communities using both telemedicine and support from peers with lived experience in drug...

Research Study Shows the Cost-Effectiven…

Earlier research showed that primary care clinicians using AI-ECG tools identified more unknown cases of a weak heart pump, also called low ejection fraction, than without AI. New study findings...

AI can Predict Study Results Better than…

Large language models, a type of AI that analyses text, can predict the results of proposed neuroscience studies more accurately than human experts, finds a new study led by UCL...

New Guidance for Ensuring AI Safety in C…

As artificial intelligence (AI) becomes more prevalent in health care, organizations and clinicians must take steps to ensure its safe implementation and use in real-world clinical settings, according to an...

Remote Telemedicine Tool Found Highly Ac…

Collecting images of suspicious-looking skin growths and sending them off-site for specialists to analyze is as accurate in identifying skin cancers as having a dermatologist examine them in person, a...

Philips Aims to Advance Cardiac MRI Tech…

Royal Philips (NYSE: PHG, AEX: PHIA) and Mayo Clinic announced a research collaboration aimed at advancing MRI for cardiac applications. Through this investigation, Philips and Mayo Clinic will look to...

New Study Reveals Why Organisations are …

The slow adoption of blockchain technology is partly driven by overhyped promises that often obscure the complex technological, organisational, and environmental challenges, according to research from the University of Surrey...

Deep Learning Model Accurately Diagnoses…

Using just one inhalation lung CT scan, a deep learning model can accurately diagnose and stage chronic obstructive pulmonary disease (COPD), according to a study published today in Radiology: Cardiothoracic...

Shape-Changing Device Helps Visually Imp…

Researchers from Imperial College London, working with the company MakeSense Technology and the charity Bravo Victor, have developed a shape-changing device called Shape that helps people with visual impairment navigate...