Emotion Recognition - Audiovisual Project

YelpoYelpo Argentina
edited December 2024 in OpenBCI_GUI

We are working on the creation of an audiovisual project (TouchDesigner + Ableton) linked to emotions recorded through EEG. I am reading papers and studies regarding the analysis of brain waves in relation to emotions. I understand this is an evolving field and that there isn't yet software available that can easily reflect the electrical correlation between emotions and EEG. However, some studies show, with a considerable success rate, emotions represented on an X-Y graph, where X corresponds to "Valence" and Y to "Arousal." Using and filtering EMG waves in TouchDesigner, is it possible to determine emotional activity in real time as shown in the studies? What would you recommend reading/researching to develop this? Thank you very much!

Comments

  • wjcroftwjcroft Mount Shasta, CA

    Hi Yelpo,

    There are a number of past Forum threads on what is termed Affective BCI. You would find links to papers and research there. Link below is the same as using the 'Google Advanced Search' button in the upper right column.

    https://www.google.com/search?as_q=affective&as_sitesearch=openbci.com

    This Google Search on the same term:

    https://www.google.com/search?q=affective+bci
    https://www.google.com/search?q=affective+bci+tutorial

    Google Scholar search:

    https://scholar.google.com/scholar?hl=en&as_sdt=0,5&q=affective+bci&btnG=

    William

  • wjcroftwjcroft Mount Shasta, CA

    https://bcmi.sjtu.edu.cn/home/blu/papers/2023/2023-13.pdf

    Affective Brain–Computer Interfaces (aBCIs): A Tutorial
    This tutorial guides the reader into the basics of brain–computer interfaces (BCIs) leading into “closed-loop” affective BCIs that include the chain from analysis to brain stimulation.
    By DONGRUI WU , Fellow IEEE, BAO-LIANG LU , Fellow IEEE, BIN HU , Fellow IEEE,
    AND ZHIGANG ZENG , Fellow IEEE
    ABSTRACT | A brain–computer interface (BCI) enables a user to communicate directly with a computer using only the central nervous system. An affective BCI (aBCI) monitors and/or regulates the emotional state of the brain, which could facilitate human cognition, communication, decision-making, and health. The last decade has witnessed rapid progress in aBCI research and applications, but there does not exist a comprehensive and up-to-date tutorial on aBCIs. This tutorial fills the gap. It introduces first the basic concepts of BCIs and then, in detail, the individual components in a closed-loop aBCI system, including signal acquisition, signal processing, feature extraction, emotion recognition, and brain stimulation. Next, it describes three representative applications of aBCIs, i.e., cognitive workload recognition, fatigue estimation, and depression diagnosis and treatment. Several challenges and opportunities in aBCI research and applications, including brain signal acquisition, emotion labeling, diversity and size of aBCI datasets, algorithm comparison, negative transfer in emotion recognition, and privacy protection and security of aBCIs, are also explained.
    KEYWORDS | Affective computing; brain–computer interface (BCI); emotion recognition; emotion regulation; machine
    learning.

Sign In or Register to comment.