Augmented Reality may Assist Cardiologists Plan and Perform Complex Procedures

Augmented reality (AR), a technology that superimposes computer-generated information on a user's view of the real world, offers a new platform to help physicians better visualize complex medical data, particularly before and during medical procedures. A new self-contained AR device aims to provide an immersive AR experience in which surgeons can interactively explore data in three dimensions.

Jihye Jang, a PhD Candidate at the Cardiac Magnetic Resonance (MR) Center at Beth Israel Deaconess Medical Center (BIDMC), and colleagues assessed AR's potential to help cardiologists visualize myocardial scarring in the heart as they perform ventricular tachycardia ablation or other electrophysiological interventions. Myocardial scarring can occur in people who experience a heart attack and also stems from the surgical repair of congenital heart disease. The team's findings, published in PLOS ONE, demonstrate that the new augmented reality technology confers a number of advantages.

"Augmented reality allows physicians to superimpose images, such as MRI or CT scans, as a guide during therapeutic intervention," said Jang. "Our report shows exciting potential that having this complex 3D scar information through augmented reality during the intervention may help guide treatment and ultimately improve patient care. Physicians can now use AR to view 3D cardiac MR information with a touchless interaction in sterile environment."

By projecting three dimensional imagery onto a glass screen worn like a diving mask on the surgeon's face, AR provides 3D depth perception and allows surgeons to interact with the medical data without physically touching a screen or computer mouse, maintaining a sterile environment and reducing the risk of infection. In Jang and colleague's pilot study, the researchers applied the augmented reality technique as they generated holographic 3D scar in five animal models that underwent controlled infarction and electrophysiological study.

3D holographic visualization of the scar was performed to assist assessment of the complex 3D scar architecture. An operator and mapping specialist viewed the holographic 3D scar during electrophysiological study, and completed the perceived usefulness questionnaire in the six-item usefulness scale and found it useful to have scar information during the intervention. The user could interactively explore 3D myocardial scar in the augmented reality environment that allows for the combination of holographic 3D LGE data interacting with any real-world environments, such as a surgical suite or patient's body.

"Our report is one of the first efforts to test augmented reality in cardiovascular electrophysiological intervention," said Jang. "Our next steps will expand the use of AR into treatments for arrhythmia by merging the scar information with electrophysiology data."

Jang J, Tschabrunn CM, Barkagan M, Anter E, Menze B, Nezafat R.
Three-dimensional holographic visualization of high-resolution myocardial scar on HoloLens.
PLoS One. 2018 Oct 8;13(10):e0205188. doi: 10.1371/journal.pone.0205188.

Most Popular Now

Patient Safety must be Central to the De…

An EPR system brings together different patient information in one place, making it easier to access for healthcare professionals. This information can include patients' own notes, test results, observations by...

ChatGPT Shows Promise in Answering Patie…

The groundbreaking ChatGPT chatbot shows potential as a time-saving tool for responding to patient questions sent to the urologist's office, suggests a study in the September issue of Urology Practice®...

Survey: Most Americans Comfortable with …

Artificial intelligence (AI) is all around us - from smart home devices to entertainment and social media algorithms. But is AI okay in healthcare? A new national survey commissioned by...

AI Spots Cancer and Viral Infections at …

Researchers at the Centre for Genomic Regulation (CRG), the University of the Basque Country (UPV/EHU), Donostia International Physics Center (DIPC) and the Fundación Biofisica Bizkaia (FBB, located in Biofisika Institute)...

Video Gaming Improves Mental Well-Being

A pioneering study titled "Causal effect of video gaming on mental well-being in Japan 2020-2022," published in Nature Human Behaviour, has conducted the most comprehensive investigation to date on the...

Machine learning helps identify rheumato…

A machine-learning tool created by Weill Cornell Medicine and Hospital for Special Surgery (HSS) investigators can help distinguish subtypes of rheumatoid arthritis (RA), which may help scientists find ways to...

New Diabetes Research Links Blood Glucos…

As part of its ongoing exploration of vocal biomarkers and the role they can play in enhancing health outcomes, Klick Labs published a new study in Scientific Reports - confirming...

New AI Software could Make Diagnosing De…

Although Alzheimer's is the most common cause of dementia - a catchall term for cognitive deficits that impact daily living, like the loss of memory or language - it's not...

A New AI Tool for Cancer

Scientists at Harvard Medical School have designed a versatile, ChatGPT-like AI model capable of performing an array of diagnostic tasks across multiple forms of cancers. The new AI system, described Sept...

Vision-Based ChatGPT Shows Deficits Inte…

Researchers evaluating the performance of ChatGPT-4 Vision found that the model performed well on text-based radiology exam questions but struggled to answer image-related questions accurately. The study's results were published...

Bayer Launches New Healthy-Aging Ecosyst…

Combining a scientifically formulated dietary supplement, a leading-edge wellness companion app, and a saliva-based a biological age test by Chronomics, Bayer is taking a big step in the emerging healthy-aging...

New AI-Driven Tool could Revolutionize B…

Researchers at the Icahn School of Medicine at Mount Sinai have developed a noninvasive technique that could dramatically improve the way doctors monitor intracranial hypertension, a condition where increased pressure...