Speech Analysis App Predicts Worsening Heart Failure Before Symptom Onset

A voice analysis app used by heart failure patients at home recognises fluid in the lungs three weeks before an unplanned hospitalisation or escalation in outpatient drug treatment. The late breaking research is presented at Heart Failure 2022, a scientific congress of the European Society of Cardiology (ESC).(1)

"The current standard of care just isn’t good enough for keeping patients with heart failure well and out of the hospital," said study author Professor William Abraham of The Ohio State University, Columbus, US. "The system tested in this study was able to predict 80% of worsening heart failure in advance, compared to a 10-20% success rate for daily weight monitoring shown in previous studies. In the future, speech analysis, together with other clinical information, could be used to modify treatments before a patient’s condition deteriorates and thereby avoid hospital admission."

In patients with heart failure, the heart does not pump blood around the body as well as it should. Fluid is not eliminated properly by the kidneys and this excess fluid builds up in the lungs or legs. Lung congestion is a common cause of hospitalisation, and can be life-threatening. Currently, lung congestion is monitored by asking patients to weigh themselves every day and report any substantial gain. Patients are also requested to report worsening symptoms such as shortness of breath, needing to elevate the head at night to breath comfortably and sleep, and swelling in the feet or ankles.

The speech analysis app used in the current study was previously shown to detect fluid in the lungs of patients hospitalised with acute heart failure.(2) This study investigated its ability to predict worsening heart failure in patients living at home.

The study included 180 patients with heart failure taking guideline recommended medications. At the beginning of the study, as a baseline measurement, participants recorded five sentences on a standard smartphone using the voice analysis app. During the study period, every morning before breakfast patients recorded the same five sentences using the app. The app compared each day's recordings with the baseline versions and alerted research staff when it detected lung congestion. Professor Abraham explained: "The system sets a baseline for each individual patient during a period of stability. It then detects changes in speech over time that indicate fluid in the lungs."

The researchers examined whether the lung congestion alerts predicted heart failure events, defined as at least one worsening symptom which led to hospitalisation or escalation in outpatient drug treatment. They did this by comparing the date of the alert with the dates of subsequent heart failure events. "True alerts" were those issued within a 31-day window before the heart failure event. "False alerts" were those issued outside of the 31-day window prior to an event.

Professor Abraham noted that a "true alert" would continue to be issued daily until the heart failure event occurred. He said: "In this study, the alerts were not acted upon by clinicians since the aim was to determine the diagnostic performance of the tool. In real life, notifications would be sent to the patient's physician until it was responded to. Here we followed patients longitudinally for worsening heart failure events and then looked to see if there was an alert prior to that event - i.e. a 'true alert'. If there was no alert then the system failed to predict the event. Alerts not followed by a worsening heart failure event were 'false alerts'."

During the study, patients provided recordings for an average of 512 days. A total of 49 heart failure events occurred in 37 patients, of which 39 (80%) were correctly predicted by the app and 10 (20%) were missed. True alerts were issued a median of 21 days before worsening symptoms. Each patient received a false alert every 4.8 months on average, resulting in an average of 2.5 erroneous warnings each year.

Professor Abraham said: "In this community-based study, a voice analysis app was able to predict most cases of worsening heart failure well in advance, with very few false alarms. Weight gain and symptoms occur too late to allow medical interventions that keep patients out of the hospital. Future studies will investigate whether changing patient management following an alert, for example by increasing the diuretic dose to get rid of excess fluid, can prevent hospitalisations."

1. The abstract 'HearO™ community study: remote speech analysis to predict worsening heart failure events' has been presented during the session 'Late-Breaking Science - Devices' on 21 May at 15:50 CEST in Room 3.
2. Amir O, Abraham WT, Azzam ZS, et al. Remote speech analysis in the evaluation of hospitalized patients with acute decompensated heart failure. JACC Heart Fail. 2022;10:41-49.

Most Popular Now

European Artificial Intelligence Act Com…

The European Artificial Intelligence Act (AI Act), the world's first comprehensive regulation on artificial intelligence, enters into force. The AI Act is designed to ensure that AI developed and used...

Patient Safety must be Central to the De…

An EPR system brings together different patient information in one place, making it easier to access for healthcare professionals. This information can include patients' own notes, test results, observations by...

ChatGPT Shows Promise in Answering Patie…

The groundbreaking ChatGPT chatbot shows potential as a time-saving tool for responding to patient questions sent to the urologist's office, suggests a study in the September issue of Urology Practice®...

Survey: Most Americans Comfortable with …

Artificial intelligence (AI) is all around us - from smart home devices to entertainment and social media algorithms. But is AI okay in healthcare? A new national survey commissioned by...

AI Spots Cancer and Viral Infections at …

Researchers at the Centre for Genomic Regulation (CRG), the University of the Basque Country (UPV/EHU), Donostia International Physics Center (DIPC) and the Fundación Biofisica Bizkaia (FBB, located in Biofisika Institute)...

Video Gaming Improves Mental Well-Being

A pioneering study titled "Causal effect of video gaming on mental well-being in Japan 2020-2022," published in Nature Human Behaviour, has conducted the most comprehensive investigation to date on the...

New Diabetes Research Links Blood Glucos…

As part of its ongoing exploration of vocal biomarkers and the role they can play in enhancing health outcomes, Klick Labs published a new study in Scientific Reports - confirming...

Machine learning helps identify rheumato…

A machine-learning tool created by Weill Cornell Medicine and Hospital for Special Surgery (HSS) investigators can help distinguish subtypes of rheumatoid arthritis (RA), which may help scientists find ways to...

New AI Software could Make Diagnosing De…

Although Alzheimer's is the most common cause of dementia - a catchall term for cognitive deficits that impact daily living, like the loss of memory or language - it's not...

A New AI Tool for Cancer

Scientists at Harvard Medical School have designed a versatile, ChatGPT-like AI model capable of performing an array of diagnostic tasks across multiple forms of cancers. The new AI system, described Sept...

Vision-Based ChatGPT Shows Deficits Inte…

Researchers evaluating the performance of ChatGPT-4 Vision found that the model performed well on text-based radiology exam questions but struggled to answer image-related questions accurately. The study's results were published...

Bayer Launches New Healthy-Aging Ecosyst…

Combining a scientifically formulated dietary supplement, a leading-edge wellness companion app, and a saliva-based a biological age test by Chronomics, Bayer is taking a big step in the emerging healthy-aging...