Think You're Funny? ChatGPT might be Funnier

A study comparing jokes by people versus those told by ChatGPT shows that humans need to work on their material.

The research team behind the study published on Wednesday, July 3, in the journal PLOS ONE, took on the serious task of comparing participants’ reactions to jokes written by ChatGPT 3.5 and others written by people.

This was conducted in an effort to determine if artificial intelligence can outwit humans for a laugh, said Drew Gorenz, a doctoral candidate in social psychology at the USC Dornsife College of Letters, Arts and Sciences.

"Since ChatGPT can’t feel emotions itself but it tells novel jokes better than the average human, these studies provide evidence that you don’t need to feel the emotions of appreciating a good joke to tell a really good one yourself," Gorenz said.

One study compared the funniness of novel jokes crafted by regular people with the funniness of novel jokes generated by ChatGPT. Participants did so without knowing their author.

The researchers found that overall, nearly 70% of the participants rated the ChatGPT-generated jokes as funnier than those crafted by humans. A little over 25% of participants rated the human-crafted responses as funnier, and only about 5% rated jokes from both sources as equally funny. The results were consistent even when the researchers checked for differences across various demographics.

To see how ChatGPT might fare against professional humor writers, the researchers conducted a second study in which they challenged ChatGPT to develop new headlines in the satirical style of The Onion. They then asked another group of 200 participants to rate the funniness of original Onion headlines and of the new ChatGPT-generated headlines. Participants found ChatGPT’s headlines just as funny as the original Onion headlines.

How does one get people and AI to generate original jokes? For the first study, both ChatGPT and 105 participants completed three tasks, each including three prompts. In the first task, they crafted humorous new phrases for common acronyms. In a second task, both ChatGPT and the human writers generated funny answers to fill-in-the-blank phrases such as, "A lesser known room in the White House: ____." They were also prompted to come up with a "roast joke," a funny slam inspired by an awkward fictional scenario such as this:

"Imagine that one of your friends wants your opinion on how well she sings. She sings a minute or two to demonstrate her voice, and you cringe - she might be the worst singer you ever heard. When she asks, 'So how was it?' you decide to be honest so you say, 'To be honest, listening to that was like: _____'"

These three tasks resulted in more than 945 jokes written by 105 writers. ChatGPT was asked to generate 20 humorous answers for each prompt for a total of 180 jokes. A new group of participants then rated the funniness of the jokes.

In the second study, ChatGPT was fed original headlines from The Onion and asked to generate new headlines in the same style. A group of 200 participants was asked to rate the funniness of the original Onion headlines and the ChatGPT-generated ones without knowing the authorship.

Gorenz said his idea for the study stemmed in part from the entertainment world’s debate over writers’ concerns about the use of large language models (LLMs) like ChatGPT in entertainment production. The issue has been magnified due to recent strikes by Hollywood writers and actors who are fearful that the adoption of LLMs poses an existential threat to their respective professions, to art and to human creativity.

Gorenz, himself an amateur stand-up comedian, acknowledged a lifelong love for comedy that inspired his research with co-author, Norbert Schwarz, who is a co-director of the USC Dornsife Mind and Society Center and an expert on consumer judgment with the USC Marshall School of Business.

Gorenz said their study raises questions about the use of ChatGPT and other LLMs within the entertainment industry.

"The implications are more positive for people who merely want to reap the benefits of elevating their everyday communications with a dose of humor," he and Schwarz, a Provost Professor of Psychology and Marketing, wrote.

"But for professional comedy writers, our results suggest that LLMs can pose a serious employment threat," Schwarz added.

Whether AI gets the last laugh remains to be seen.

Gorenz D, Schwarz N.
How funny is ChatGPT? A comparison of human- and A.I.-produced jokes.
PLoS One. 2024 Jul 3;19(7):e0305364. doi: 10.1371/journal.pone.0305364

Most Popular Now

Researchers Find Telemedicine may Help R…

Low-value care - medical tests and procedures that provide little to no benefit to patients - contributes to excess medical spending and both direct and cascading harms to patients. A...

AI Revolutionizes Glaucoma Care

Imagine walking into a supermarket, train station, or shopping mall and having your eyes screened for glaucoma within seconds - no appointment needed. With the AI-based Glaucoma Screening (AI-GS) network...

AI may Help Clinicians Personalize Treat…

Individuals with generalized anxiety disorder (GAD), a condition characterized by daily excessive worry lasting at least six months, have a high relapse rate even after receiving treatment. Artificial intelligence (AI)...

Accelerating NHS Digital Maturity: Paper…

Digitised clinical noting at South Tees Hospitals NHS Foundation Trust is creating efficiencies for busy doctors and nurses. The trust’s CCIO Dr Andrew Adair, deputy CCIO Dr John Greenaway, and...

Mobile App Tracking Blood Pressure Helps…

The AHOMKA platform, an innovative mobile app for patient-to-provider communication that developed through a collaboration between the School of Engineering and leading medical institutions in Ghana, has yielded positive results...

AI can Open Up Beds in the ICU

At the height of the COVID-19 pandemic, hospitals frequently ran short of beds in intensive care units. But even earlier, ICUs faced challenges in keeping beds available. With an aging...

Can AI Help Detect Cognitive Impairment?

Mild cognitive impairment (MCI) can be an early indicator of Alzheimer's disease or dementia, so identifying those with cognitive issues early could lead to interventions and better outcomes. But diagnosing...

Customized Smartphone App Shows Promise …

A growing body of research indicates that older adults in assisted living facilities can delay or even prevent cognitive decline through interventions that combine multiple activities, such as improving diet...

New Study Shows Promise for Gamified mHe…

A new study published in Multiple Sclerosis and Related Disorders highlights the potential of More Stamina, a gamified mobile health (mHealth) app designed to help people with Multiple Sclerosis (MS)...

AI Model Predicting Two-Year Risk of Com…

AFib (short for atrial fibrillation), a common heart rhythm disorder in adults, can have disastrous consequences including life-threatening blood clots and stroke if left undetected or untreated. A new study...

Patients' Affinity for AI Messages …

In a Duke Health-led survey, patients who were shown messages written either by artificial intelligence (AI) or human clinicians indicated a preference for responses drafted by AI over a human...

New Research Explores How AI can Build T…

In today’s economy, many workers have transitioned from manual labor toward knowledge work, a move driven primarily by technological advances, and workers in this domain face challenges around managing non-routine...