AI System that Mimics Human Gaze could be Used to Detect Cancer

A cutting-edge artificial intelligence (AI) system that can accurately predict the areas of an image where a person is most likely to look has been created by scientists at Cardiff University.

Based on the mechanics of the human brain and its ability to distinguish between different parts of an image, the researchers say the novel system more accurately represents human vision than anything that has gone before.

Applications of the new system range from robotics, multimedia communication and video surveillance to automated image editing and finding tumours in medical images.

The Multimedia Computing Research Group at Cardiff University are now planning to test the system by helping radiologists to find lesions within medical images, with the overall goal of improving the speed, accuracy and sensitivity of medical diagnostics.

The system has been presented in the journal Neuralcomputing.

Being able to focus our attention is an important part of the human visual system which allows us to select and interpret the most relevant information in a particular scene.

Scientists all over the world have been using computer software to try and recreate this ability to pick out the most salient parts of an image, but with mixed success up until now.

In their study, the team used a deep learning computer algorithm known as a convolutional neural network which is designed to mimic the interconnected web of neurons in the human brain and is modelled specifically on the visual cortex.

This type of algorithm is ideal for taking images as an input and being able to assign importance to various objects or aspects within the image itself.

In their study, the team utilised a huge database of images in which each image had already been assessed, or viewed, by humans and assigned so-called 'areas of interest' using eye-tracking software.

These images were then fed into the algorithm and using a type of AI known as deep learning, the system slowly began to learn from the images to a point where it could then accurately predict which parts of the image were most salient.

The new system was tested against seven state-of-the-art visual saliency systems that are already in use and was shown to be superior on all metrics.

Co-author of the study Dr Hantao Liu, from Cardiff University's School of Computer Science and Informatics, said: "This study has shown that our cutting-edge system, which uses the latest advances in machine learning, is superior to the existing state-of-the-art visual saliency models that currently exist.

"Being able to successfully predict where people look in natural images could unlock a wide range of applications from automatic target detection to robotics, image processing and medical diagnostics.

"Our code has been made freely available so that everyone can benefit from the research and find new ways of applying this technology to real world problems and applications.

"The next step for us is to work with radiologists to determine how these models can assist them in detecting lesions within medical images."

The code underlying the new system has been made freely available to the public and can be downloaded here.

Jianxun Lou, Hanhe Lin, David Marshall, Dietmar Saupe, Hantao Liu.
TranSalNet: Towards perceptually relevant visual saliency prediction.
Neurocomputing, Volume 494, 2022. doi: 10.1016/j.neucom.2022.04.080

Most Popular Now

Philips and Medtronic Advocacy Partnersh…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Medtronic Neurovascular, a leading innovator in neurovascular therapies, today announced a strategic advocacy partnership. Delivering timely stroke...

New AI Tool Predicts Protein-Protein Int…

Scientists from Cleveland Clinic and Cornell University have designed a publicly-available software and web database to break down barriers to identifying key protein-protein interactions to treat with medication. The computational tool...

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...

New Research Shows Promise and Limitatio…

Published in JAMA Network Open, a collaborative team of researchers from the University of Minnesota Medical School, Stanford University, Beth Israel Deaconess Medical Center and the University of Virginia studied...

G-Cloud 14 Makes it Easier for NHS to Bu…

NHS organisations will be able to save valuable time and resource in the procurement of technologies that can make a significant difference to patient experience, in the latest iteration of...

Start-Ups will Once Again Have a Starrin…

11 - 14 November 2024, Düsseldorf, Germany. The finalists in the 16th Healthcare Innovation World Cup and the 13th MEDICA START-UP COMPETITION have advanced from around 550 candidates based in 62...

Hampshire Emergency Departments Digitise…

Emergency departments in three hospitals across Hampshire Hospitals NHS Foundation Trust have deployed Alcidion's Miya Emergency, digitising paper processes, saving clinical teams time, automating tasks, and providing trust-wide visibility of...

MEDICA HEALTH IT FORUM: Success in Maste…

11 - 14 November 2024, Düsseldorf, Germany. How can innovations help to master the great challenges and demands with which healthcare is confronted across international borders? This central question will be...

A "Chemical ChatGPT" for New M…

Researchers from the University of Bonn have trained an AI process to predict potential active ingredients with special properties. Therefore, they derived a chemical language model - a kind of...

Siemens Healthineers co-leads EU Project…

Siemens Healthineers is joining forces with more than 20 industry and public partners, including seven leading stroke hospitals, to improve stroke management for patients all over Europe. With a total...

MEDICA and COMPAMED 2024: Shining a Ligh…

11 - 14 November 2024, Düsseldorf, Germany. Christian Grosser, Director Health & Medical Technologies, is looking forward to events getting under way: "From next Monday to Thursday, we will once again...

In 10 Seconds, an AI Model Detects Cance…

Researchers have developed an AI powered model that - in 10 seconds - can determine during surgery if any part of a cancerous brain tumor that could be removed remains...