Computer Vision App Allows Easier Monitoring of Diabetes

A computer vision technology developed by University of Cambridge engineers has now been developed into a free mobile phone app for regular monitoring of glucose levels in people with diabetes.

The app uses computer vision techniques to read and record the glucose levels, time and date displayed on a typical glucose test via the camera on a mobile phone. The technology, which doesn't require an internet or Bluetooth connection, works for any type of glucose meter, in any orientation and in a variety of light levels. It also reduces waste by eliminating the need to replace high-quality non-Bluetooth meters, making it a cost-effective solution to the NHS.

Working with UK glucose testing company GlucoRx, the Cambridge researchers have developed the technology into a free mobile phone app, called GlucoRx Vision, which is now available on the Apple App Store and Google Play Store.

To use the app, users simply take a picture of their glucose meter and the results are automatically read and recorded, allowing much easier monitoring of blood glucose levels.

In addition to the glucose meters which people with diabetes use on a daily basis, many other types of digital meters are used in the medical and industrial sectors. However, many of these meters still do not have wireless connectivity, so connecting them to phone tracking apps often requires manual input.

"These meters work perfectly well, so we don't want them sent to landfill just because they don't have wireless connectivity," said Dr James Charles from Cambridge's Department of Engineering. "We wanted to find a way to retrofit them in an inexpensive and environmentally-friendly way using a mobile phone app."

In addition to his interest in solving the challenge from an engineering point of view, Charles also had a personal interest in the problem. He has type 1 diabetes and needs to take as many as ten glucose readings per day. Each reading is then manually entered into a tracking app to help determine how much insulin he needs to regulate his blood glucose levels.

"From a purely selfish point of view, this was something I really wanted to develop," he said.

"We wanted something that was efficient, quick and easy to use," said Professor Roberto Cipolla, also from the Department of Engineering. "Diabetes can affect eyesight or even lead to blindness, so we needed the app to be easy to use for those with reduced vision."

The computer vision technology behind the GlucoRx app is made up of two steps. First, the screen of the glucose meter is detected. The researchers used a single training image and augmented it with random backgrounds, particularly backgrounds with people. This helps ensure the system is robust when the user's face is reflected in the phone's screen.

Second, a neural network called LeDigit detects each digit on the screen and reads it. The network is trained with computer-generated synthetic data, avoiding the need for labour-intensive labelling of data which is commonly needed to train a neural network.

"Since the font on these meters is digital, it's easy to train the neural network to recognise lots of different inputs and synthesise the data," said Charles. "This makes it highly efficient to run on a mobile phone."

"It doesn't matter which orientation the meter is in - we tested it in all types of orientations, viewpoints and light levels," said Cipolla, who is also a Fellow of Jesus College. "The app will vibrate when it's read the information, so you get a clear signal when you've done it correctly. The system is accurate across a range of different types of meters, with read accuracies close to 100%"

In addition to blood glucose monitor, the researchers also tested their system on different types of digital meters, such as blood pressure monitors, kitchen and bathroom scales. The researchers also recently presented their results at the 31st British Machine Vision Conference.

Gluco-Rx initially approached Cipolla's team in 2018 to develop a cost-effective and environmentally-friendly solution to the problem of non-connected glucose meters, and once the technology had been shown to be sufficiently robust, the company worked with the Cambridge researchers to develop the app.

"We have been working in partnership with Cambridge University on this unique solution, which will help change the management of diabetes for years to come," said Chris Chapman, Chief Operating Officer of GlucoRx. "We will soon make this solution available to all of our more than 250,000 patients."

As for Charles, who has been using the app to track his glucose levels, he said it "makes the whole process easier. I've now forgotten what it was like to enter the values in manually, but I do know I wouldn't want to go back to it. There are a few areas in the system which could still be made even better, but all in all I'm very happy with the outcome."

James Charles, Stefano Bucciarelli, Roberto Cipolla.
Real-time screen reading: reducing domain shift for one-shot learning.
Paper presented at the British Machine Vision Conference: https://bmvc2020-conference.com/conference/papers/paper_0512.html

Most Popular Now

MEDICA 2024 + COMPAMED 2024: Adapted Hal…

11 - 14 November 2024, Düsseldorf, Germany. The final preparations for MEDICA 2024 and COMPAMED 2024 in Düsseldorf have begun. A total of more than 5,500 exhibitors from approximately 70 countries...

AI does Not Necessarily Lead to more Eff…

The use of artificial intelligence (AI) in hospitals and patient care is steadily increasing. Especially in specialist areas with a high proportion of imaging, such as radiology, AI has long...

Commission Joins Forces with Venture Cap…

The Commission has launched a Trusted Investors Network bringing together a group of investors ready to co-invest in innovative deep-tech companies in Europe together with the EU. The Union's investment...

Why the NHS is Seeking to Make Media Ser…

Opinion Article by Dean Moody, Healthcare Services Director, Airwave Healthcare. Tim Kelsey and Martha Lane Fox called for WiFi to be made available free of charge throughout the NHS back in...

An AI-Powered Pipeline for Personalized …

Ludwig Cancer Research scientists have developed a full, start-to-finish computational pipeline that integrates multiple molecular and genetic analyses of tumors and the specific molecular targets of T cells and harnesses...

Wearable Cameras Allow AI to Detect Medi…

A team of researchers says it has developed the first wearable camera system that, with the help of artificial intelligence (AI), detects potential errors in medication delivery. In a test whose...

Philips and Medtronic Advocacy Partnersh…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Medtronic Neurovascular, a leading innovator in neurovascular therapies, today announced a strategic advocacy partnership. Delivering timely stroke...

AI could Transform How Hospitals Produce…

A pilot study led by researchers at University of California San Diego School of Medicine found that advanced artificial intelligence (AI) could potentially lead to easier, faster and more efficient...

New AI Tool Predicts Protein-Protein Int…

Scientists from Cleveland Clinic and Cornell University have designed a publicly-available software and web database to break down barriers to identifying key protein-protein interactions to treat with medication. The computational tool...

Great Start for Ideas and Innovations: D…

8 - 10 April 2025, Berlin, Germany. From 15 October to 15 November 2024, the DMEA invites experts from business, science, politics and practice to actively participate in shaping the congress...

Start-Ups will Once Again Have a Starrin…

11 - 14 November 2024, Düsseldorf, Germany. The finalists in the 16th Healthcare Innovation World Cup and the 13th MEDICA START-UP COMPETITION have advanced from around 550 candidates based in 62...

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...