Brain Composer: 'Thinking' Melodies onto a Musical Score

Brain-computer interfaces, known as BCI, can replace bodily functions to a certain degree. Thanks to BCI, physically impaired persons can control special prostheses through the power of their minds, surf in internet and write emails. Under the title of "Brain Composer", a group led by BCI expert Gernot Müller-Putz from TU Graz's Institute of Neural Engineering shows that experiences of quite a different tone can be sounded from the keys of brain-computer interfaces. Derived from an established BCI method which mainly serves to spell - more accurately - write by means of BCI, the team has developed a new application by which music can be composed and transferred onto a musical score - just through the power of thought. All you need is a special cap which measures brain waves, the adapted BCI, a software for composing music, and of course a bit of musical knowledge.

The basic principle of the BCI method used, which is called P300, can be briefly described: various options, such as letters or notes, pauses, chords, etc. flash by one after the other in a table. If you're trained and can focus on the desired option while it lights up, you cause a minute change in your brain waves. The BCI recognises this change and draws conclusions about the chosen option.

The short video "Sheet Music by Mind" gives an impression of composing music using BCI: https://www.tugraz.at/institute/ine/research/videos/

Musical test persons
18 test persons chosen for the study by Gernot Müller-Putz, Andreas Pinegger and Selina C. Wriessnegger from TU Graz's Institute of Neural Engineering as well as Hannah Hiebel, meanwhile at the Institute of Cognitive Psychology & Neuroscience at the University of Graz, had to "think" melodies onto a musical score. All test subjects were of sound bodily health during the study and had a certain degree of basic musical and compositional knowledge since they all played musical instruments to some degree. Among the test persons was the late Graz composer and clarinettist, Franz Cibulka. "The results of the BCI compositions can really be heard. And what is more important: the test persons enjoyed it. After a short training session, all of them could start composing and seeing their melodies on the score and then play them. The very positive results of the study with bodily healthy test persons are the first step in a possible expansion of the BCI composition to patients," stresses Müller-Putz.

Sideshow of BCI research
This little-noticed sideshow of the lively BCI research at TU Graz, with its distinct focus on disabled persons, shows us which other avenues may yet be worth exploring. Meanwhile there are some initial attempts at BCI systems on smart phones. This makes it easier for people to use BCI applications, since the smart phone as powerful computer is becoming part of the BCI system. It is thus conceivable, for instance, to have BCI apps which can analyse brain signals for various applications. "20 years ago, the idea of composing a piece of music using the power of the mind was unimaginable. Now we can do it, and at the same time have tens of new, different ideas which are in part, once again, a long way from becoming reality. We still need a bit more time before it is mature enough for daily applications. The BCI community is working in many directions at high pressure.

Graz as centre of BCI research
The international community for brain-computer interfaces is meeting at the Graz BCI Conference 2017 from 18th to 22nd September. It will end with a special event open to the public: a BCI Science Slam on Friday, 22nd September. Five researchers will stage their current topics using "mini-shows" lasting six minutes in a creative and easy-to-understand way, and the audience will vote for the winner of the Slam at the end. Entry is free of charge. You can find information about the conference and the Science Slam here.

Pinegger A, Hiebel H, Wriessnegger SC, Müller-Putz GR.
Composing only by thought: Novel application of the P300 brain-computer interface.
PLOS ONE 12(9): e0181584. doi: 10.1371/journal.pone.0181584.

Most Popular Now

Patient Safety must be Central to the De…

An EPR system brings together different patient information in one place, making it easier to access for healthcare professionals. This information can include patients' own notes, test results, observations by...

ChatGPT Shows Promise in Answering Patie…

The groundbreaking ChatGPT chatbot shows potential as a time-saving tool for responding to patient questions sent to the urologist's office, suggests a study in the September issue of Urology Practice®...

Survey: Most Americans Comfortable with …

Artificial intelligence (AI) is all around us - from smart home devices to entertainment and social media algorithms. But is AI okay in healthcare? A new national survey commissioned by...

AI Spots Cancer and Viral Infections at …

Researchers at the Centre for Genomic Regulation (CRG), the University of the Basque Country (UPV/EHU), Donostia International Physics Center (DIPC) and the Fundación Biofisica Bizkaia (FBB, located in Biofisika Institute)...

Video Gaming Improves Mental Well-Being

A pioneering study titled "Causal effect of video gaming on mental well-being in Japan 2020-2022," published in Nature Human Behaviour, has conducted the most comprehensive investigation to date on the...

Machine learning helps identify rheumato…

A machine-learning tool created by Weill Cornell Medicine and Hospital for Special Surgery (HSS) investigators can help distinguish subtypes of rheumatoid arthritis (RA), which may help scientists find ways to...

New Diabetes Research Links Blood Glucos…

As part of its ongoing exploration of vocal biomarkers and the role they can play in enhancing health outcomes, Klick Labs published a new study in Scientific Reports - confirming...

New AI Software could Make Diagnosing De…

Although Alzheimer's is the most common cause of dementia - a catchall term for cognitive deficits that impact daily living, like the loss of memory or language - it's not...

A New AI Tool for Cancer

Scientists at Harvard Medical School have designed a versatile, ChatGPT-like AI model capable of performing an array of diagnostic tasks across multiple forms of cancers. The new AI system, described Sept...

Vision-Based ChatGPT Shows Deficits Inte…

Researchers evaluating the performance of ChatGPT-4 Vision found that the model performed well on text-based radiology exam questions but struggled to answer image-related questions accurately. The study's results were published...

Bayer Launches New Healthy-Aging Ecosyst…

Combining a scientifically formulated dietary supplement, a leading-edge wellness companion app, and a saliva-based a biological age test by Chronomics, Bayer is taking a big step in the emerging healthy-aging...

New AI-Driven Tool could Revolutionize B…

Researchers at the Icahn School of Medicine at Mount Sinai have developed a noninvasive technique that could dramatically improve the way doctors monitor intracranial hypertension, a condition where increased pressure...