Wearable Device Reveals Consumer Emotions

Humans experience a range of emotions in response to products and experiences on a daily basis. Shoppers may get excited for certain brands and then overwhelmed by choices. Audience members may oscillate between apathy and engagement during performances. Children can become frustrated, bored, or entertained while learning a new subject. Using wearable stress sensors, analytics, and other technologies, MIT Media Lab spinout mPath is able to pinpoint the exact moment consumers feel these subconscious responses. In doing so, the startup has brought some interesting market research insights to major companies and organizations to help them refine their products and services.

"Right now, companies struggle to understand their customers’ emotional needs or wants," says founder and CEO Elliot Hedman PhD. 2But if we listen a little to consumer emotions, there's a lot of room for innovation."

Headquartered in Denver, Colorado, mPath has worked with big-name clients including The LEGO Group, Google, The Blue Man Group, Lowe’s, Hasbro, and Best Buy, as well as governmental organizations, film production companies, and hospitals. Now mPath is dipping into childhood education, having just launched a project with the Boys and Girls Clubs in Denver to discover ways to encourage children to read more.

Getting the whole story with "emototyping"
The startup's MOXO sensor - whose core technology was co-invented by Hedman, MIT Professor Rosalind Picard, and other MIT researchers - is a wearable that resembles a bulky smartwatch. Placed on the wrist, it wirelessly measures changes in skin conductance (subtle electrical changes across the skin), which reflect sympathetic nervous system activity and physiological arousal. Spikes in conductance can signal stress and frustration, while dips may indicate disinterest or boredom.

To gain an accurate picture of consumers' responses to specific stimuli, mPath developed a new approach to market research, called "emototyping." This process combines the stress sensors with eye-tracking glasses or GoPro cameras, to identify where a person looked at the exact moment of an emotional spike or dip. Personal interviews are also conducted with all participants, who are shown the data and asked what they think they felt.

This entire process creates a more in-depth, precise emotional profile of consumers than traditional market research, which primarily involves interviews and occasionally video analysis, according to Hedman. "All these things combined together in emototyping tell us a deep story about the participant," he says.

Emototyping is an especially useful tool when studying children’s experiences, according to Hedman. “It’s hard for kids to describe what they felt,” he says. “The sensors help tell the whole story.”

Insights from tooth-brushing, to retail, to reading
Over the years, the startup has tackled an eclectic mix of projects. A study with the New World Symphony found that making songs shorter and performing classical compositions of modern pop music help engage new audiences in classical music. Studying movies such as "The Departed" revealed where some techniques or concepts (such as dark humor) can be implemented in films to keep audiences engaged. At one point, the startup even tracked patrons’ fear throughout parts of a haunted house.

One of mPath's more unique recent projects was helping a toothpaste company understand people's experience with brushing their teeth. "I've learned so many things I never thought I'd know about brushing," Hedman says, laughing.

For the study, mPath researchers drove to people’s homes to equip them with the MOXO sensor and a GoPro camera. At times, they measured few to no skin-conductance spikes in the data, indicating the brushers were bored; at other times, little spikes in the data indicated the brushers were inconvenienced. After analysis and interviews, mPath concluded that people are looking for a more engaging brushing experience. The toothpaste company is developing products around that idea.

More common are retail-store studies. In studying customers in electronics stores, mPath found that engagement spiked while they were trying out interactive electronics, but dipped dramatically when an employee came over to deliver a so-called "sales pitch." Results like this indicate that retail stores must better train employees to interact with customers and create displays that better encourage deep interaction, "which is a big space where retail needs to develop," Hedman says.

Now at the Boys and Girls Club, mPath has uncovered methods to encourage reading. Hedman gives an example of a young girl who appeared to be reading a book, but the eye-tracking glasses caught her focus shifting to a poster on the wall, which she read instead. "Our theory is that an entire paragraph can look overwhelming, so we’re developed some ways to make text look more like a poster - something easy to read if they’re trying to learn," he says.

In another instance, mPath countered a commonly held idea that letting children play a brief video game as "dessert" after reading works well. But mPath's data found that when children play a brief game before reading, the sensors pick up more spikes in engagement. "We found if children start with dessert, they’re more excited during reading," Hedman says.

From therapy to industry
With its renewed focus on children's learning, the sensor has, in a way, come full circle: The MOXO sensor's core technology began as tool for studying stress levels of children with autism. (A version was later developed into the E4 wristband that can sense oncoming seizures, commercialized through Picard's startup Empatica.)

While at MIT, Hedman tested the sensor on children with autism enrolled in occupational therapy. One boy was climbing a rock wall and looked calm, but his stress spikes registered off the charts. "I thought, 'The sensor has to be broken. There's no way that kid is scared,’" Hedman says.

Coming off the wall, the boy told the teacher he was bored, but the sensor data indicated otherwise. That's when the teacher had "a light-bulb moment," Hedman says: The boy said he was bored to compensate for being overwhelmed. "That was a really powerful moment for me. I knew there is so much we can do if we understand emotions better," Hedman says.

Therapy applications seemed promising. But companies began courting Hedman with appealing market-research questions. First came Hasbro, which wanted to find out how immigrants to the United States can learn how to play common American board games, such as Monopoly. Then came LEGO asking to track the emotions of adults and children at play - which pushed Hedman toward industry.

In the LEGO study, Hedman found that children became most stressed when making mistakes they need to go back a few steps to rectify. It also revealed the children were far less stressed with parents nearby. But if parents helped build too much, the children get too bored. Based on those results, LEGO implemented solutions into its digital products.

"I was like, 'Cool, we just helped a company.' That kind of shifted me from theory to impacting organizations," Hedman says.

Hedman founded mPath in 2012, while still at MIT. But the sensors were only half the innovation. Hedman needed to develop "a bizarre set of skills," he says, to develop emototyping. At MIT, he took classes on ethnography and creating research environments. He took psychophysiology classes at Boston College and Northwestern University, and education classes at Harvard University. "A large community of people from all over the place guided me," he says, "but MIT opened up those doors."

Moving forward, mPath will continue doing "impactful work," Hedman says, such as studying young student engagement at physical schools and in massive open online courses (MOOCs), with aims of helping redesign curriculum and classroom experiences.

For further information, please visit:
http://www.buildempathy.com

Most Popular Now

AI for Real-Rime, Patient-Focused Insigh…

A picture may be worth a thousand words, but still... they both have a lot of work to do to catch up to BiomedGPT. Covered recently in the prestigious journal Nature...

New Research Shows Promise and Limitatio…

Published in JAMA Network Open, a collaborative team of researchers from the University of Minnesota Medical School, Stanford University, Beth Israel Deaconess Medical Center and the University of Virginia studied...

G-Cloud 14 Makes it Easier for NHS to Bu…

NHS organisations will be able to save valuable time and resource in the procurement of technologies that can make a significant difference to patient experience, in the latest iteration of...

Hampshire Emergency Departments Digitise…

Emergency departments in three hospitals across Hampshire Hospitals NHS Foundation Trust have deployed Alcidion's Miya Emergency, digitising paper processes, saving clinical teams time, automating tasks, and providing trust-wide visibility of...

Start-Ups will Once Again Have a Starrin…

11 - 14 November 2024, Düsseldorf, Germany. The finalists in the 16th Healthcare Innovation World Cup and the 13th MEDICA START-UP COMPETITION have advanced from around 550 candidates based in 62...

MEDICA HEALTH IT FORUM: Success in Maste…

11 - 14 November 2024, Düsseldorf, Germany. How can innovations help to master the great challenges and demands with which healthcare is confronted across international borders? This central question will be...

A "Chemical ChatGPT" for New M…

Researchers from the University of Bonn have trained an AI process to predict potential active ingredients with special properties. Therefore, they derived a chemical language model - a kind of...

Siemens Healthineers co-leads EU Project…

Siemens Healthineers is joining forces with more than 20 industry and public partners, including seven leading stroke hospitals, to improve stroke management for patients all over Europe. With a total...

MEDICA and COMPAMED 2024: Shining a Ligh…

11 - 14 November 2024, Düsseldorf, Germany. Christian Grosser, Director Health & Medical Technologies, is looking forward to events getting under way: "From next Monday to Thursday, we will once again...

In 10 Seconds, an AI Model Detects Cance…

Researchers have developed an AI powered model that - in 10 seconds - can determine during surgery if any part of a cancerous brain tumor that could be removed remains...

Does AI Improve Doctors' Diagnoses?

With hospitals already deploying artificial intelligence to improve patient care, a new study has found that using Chat GPT Plus does not significantly improve the accuracy of doctors' diagnoses when...

AI Analysis of PET/CT Images can Predict…

Dr. Watanabe and his teams from Niigata University have revealed that PET/CT image analysis using artificial intelligence (AI) can predict the occurrence of interstitial lung disease, known as a serious...