Research Offers Radical Rethink of How to Improve AI in the Future

Computer scientists at the University of Essex have devised a radically different approach to improving artificial intelligence (AI) in the future.

Published in top machine learning journal - the Journal of Machine Learning Research - the Essex team hope this research will provide a backbone for the next generation of AI and machine learning breakthroughs.

This could be translated to improvements in everything from driverless cars and smartphones having a better understanding of voice commands, to improved automatic medical diagnoses and drug discovery.

"Artificial intelligence research ultimately has the goal of producing completely autonomous and intelligent machines which we can converse with and will do tasks for us, and this new published work accelerates our progress towards that," explained co-lead author Dr Michael Fairbank, from Essex’s School of Computer Science and Electronic Engineering.

The recent impressive breakthroughs in AI around vision tasks, speech recognition and language translation have involved "deep learning", which means training multi-layered artificial neural networks to solve a task. However, training these deep neural networks is a computationally expensive task, requiring huge amounts of training examples and computing time.

What the Essex team, which includes Professor Luca Citi and Dr Spyros Samothrakis, has achieved is to devise a radically different approach to training neural networks in deep learning.

"Our new method, which we call Target Space, provides researchers with a step change in the way they can improve and build their AI creations," added Dr Fairbank. "Target Space is a paradigm-changing view, which turns the training process of these deep neural networks on its head, ultimately enabling the current progress in AI developments to happen faster."

The standard way people train neural networks to improve performance is to repeatedly make tiny adjustments to the connection strengths between the neurones in the network. The Essex team have taken a new approach. So, instead of tweaking connection strengths between neurones, the new "target-space" method proposes to tweak the firing strengths of the neurones themselves.

Professor Citi added: "This new method stabilises the learning process considerably, by a process which we call cascade untangling. This allows the neural networks being trained to be deeper, and therefore more capable, and at the same time potentially requiring fewer training examples and less computing resources. We hope this work will provide a backbone for the next generation of artificial intelligence and machine-learning breakthroughs."

The next steps for the research are to apply the method to various new academic and industrial applications.

Michael Fairbank, Spyridon Samothrakis, and Luca Citi.
Deep Learning in Target Space.
Journal of Machine Learning Research 23.8 (2022): 1-46.

Most Popular Now

MEDICA 2024 + COMPAMED 2024: Adapted Hal…

11 - 14 November 2024, Düsseldorf, Germany. The final preparations for MEDICA 2024 and COMPAMED 2024 in Düsseldorf have begun. A total of more than 5,500 exhibitors from approximately 70 countries...

AI does Not Necessarily Lead to more Eff…

The use of artificial intelligence (AI) in hospitals and patient care is steadily increasing. Especially in specialist areas with a high proportion of imaging, such as radiology, AI has long...

Commission Joins Forces with Venture Cap…

The Commission has launched a Trusted Investors Network bringing together a group of investors ready to co-invest in innovative deep-tech companies in Europe together with the EU. The Union's investment...

Why the NHS is Seeking to Make Media Ser…

Opinion Article by Dean Moody, Healthcare Services Director, Airwave Healthcare. Tim Kelsey and Martha Lane Fox called for WiFi to be made available free of charge throughout the NHS back in...

An AI-Powered Pipeline for Personalized …

Ludwig Cancer Research scientists have developed a full, start-to-finish computational pipeline that integrates multiple molecular and genetic analyses of tumors and the specific molecular targets of T cells and harnesses...

Wearable Cameras Allow AI to Detect Medi…

A team of researchers says it has developed the first wearable camera system that, with the help of artificial intelligence (AI), detects potential errors in medication delivery. In a test whose...

Philips and Medtronic Advocacy Partnersh…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Medtronic Neurovascular, a leading innovator in neurovascular therapies, today announced a strategic advocacy partnership. Delivering timely stroke...

AI could Transform How Hospitals Produce…

A pilot study led by researchers at University of California San Diego School of Medicine found that advanced artificial intelligence (AI) could potentially lead to easier, faster and more efficient...

New AI Tool Predicts Protein-Protein Int…

Scientists from Cleveland Clinic and Cornell University have designed a publicly-available software and web database to break down barriers to identifying key protein-protein interactions to treat with medication. The computational tool...

Great Start for Ideas and Innovations: D…

8 - 10 April 2025, Berlin, Germany. From 15 October to 15 November 2024, the DMEA invites experts from business, science, politics and practice to actively participate in shaping the congress...

Start-Ups will Once Again Have a Starrin…

11 - 14 November 2024, Düsseldorf, Germany. The finalists in the 16th Healthcare Innovation World Cup and the 13th MEDICA START-UP COMPETITION have advanced from around 550 candidates based in 62...

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...