User Training Approaches for Brain-Computer Interfaces (BCI)

Brain-Computer Interface (BCI) are devices that enable its users to interact with computers by mean of brain-activity only, this activity being generally measured by ElectroEncephaloGraphy (EEG).

A typical example of a BCI would be a system in which a user can imagine movements of his left or right hand in order to move a cursor on a computer screen towards the left or right respectively. BCI systems are a very promising tool for severely paralysed people such as those suffering from late-stage Amyotrophic Lateral Sclerosis (ALS). Indeed, for those people, BCI can be the only mean of communication with the external world. Some BCI research groups have actually designed BCI prototypes with which disabled people could operate a text editor or a prosthesis. However, BCI can also be a promising interaction tool for healthy people, with several potential applications in the field of multimedia, virtual reality or video games among many other potential applications.

Can new EEG visualization techniques improve user learning of a Brain-Computer Interface skill?

Can new EEG visualization techniques improve user learning of a Brain-Computer Interface skill?

However, although very promising for numerous applications, BCI mostly remain prototypes not used outside laboratories, due to their low reliability. Poor BCI performances are partly due to imperfect EEG signal processing algorithms but also to the user, who may not be able to produce reliable EEG patterns. Indeed, BCI use is a skill, requiring the user to be properly trained to achieve BCI control. If he/she cannot perform the desired mental commands, no signal processing algorithm could identify them. Therefore, rather than improving EEG signal processing alone, an interesting research direction is to also guide users to learn BCI control mastery. Our current work aims at addressing this objective. We notably explore theoretical models and guidelines from psychology and cognitive sciences about human learning in order to improve BCI training protocols. Our studies notably illustrate the theoretical limitations of current standard BCI training approaches and the need for alternative approaches. We also perform some actual experiments to further illustrate some limitations of current BCI training protocols and try to understand and analyse them. We notably study which users’ profile (personality and cognitive profile) fail or succeed at learning BCI control. Overall with are working towards formally modeling BCI users and BCI control skill acquisition. Finally, we explore new feedback types and new training tasks in order to help users to learn BCI control skills more efficiently. These new feedback and tasks notably aim at providing BCI users with more information about their EEG patterns, in order to identify more easily relevant BCI control strategies, as well as motivating and engaging them in the learning task.

Some related publications

Understanding and modeling BCI control skill acquisition:

  • C. Jeunet, F. Lotte, J.-M. Batail, P. Philip, J.-A. Micoulaud-Franchi, “How to improve clinical neurofeedback using a human-factor centered standpoint? A short review of the insights provided by the literature on BCI”,  Neuroscience, 2017
  • C. Jeunet, B. N’Kaoua, F. Lotte, “Towards a cognitive model of MI-BCI user training”, 7th international BCI conference, 2017 – pdf
  • F. Lotte, C. Jeunet, “Online classification accuracy is a poor metric to study mental-imagery based BCI user learning: An experimental demonstration and new metrics”, 7th international BCI conference, 2017 – pdf
  • M. Arns, J.-M. Batail, S. Bioulac, M. Congedo, C. Daudet, D. Drapier, T. Fovet, R. Jardri, M. Le Van Quyen, F. Lotte, D. Mehler, J.-A. Micoulaud-Franchi, D. Purper-Ouakil, F. Vialatte, The Next Group, “Neurofeedback: one of today’s techniques in psychiatry?”, L’Encéphale, 2017 – pdf
  • R. Chavarriaga, M. Fried-Oken, S. Kleih, F. Lotte, R. Scherer, “Heading for new shores! Overcoming pitfalls in BCI design”, Brain-Computer Interfaces, pp. 1-14, 2016 – pdf
  • C. Jeunet, E. Jahanpour, F. Lotte, “Why Standard Brain-Computer Interface (BCI) Training Protocols Should be Changed: An Experimental Study”, Journal of Neural Engineering, vol. 13, no. 3, 036024, 2016 – pdf
  • C. Jeunet, B. N’Kaoua, F. Lotte, “Advances in User-Training for Mental-Imagery Based BCI Control: Psychological and Cognitive Factors and their Neural Correlates”, Progress in Brain Research, UK: Elsevier, vol 228, pp. 3-35, 2016 – pdf
  • C. Jeunet, B. N’Kaoua, S. Subramanian, M. Hachet, F. Lotte, “Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns”, PLOS ONE, 2015
  • F. Lotte, C. Jeunet, “Towards Improved BCI based on Human Learning Principles”, 3rd International Winter Conference on Brain-Computer Interfaces, invited paper, pp. 37-40, 2015 – pdf
  • F. Lotte, F. Larrue, C. Mühl, “Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design”, Frontiers in Human Neurosciences, vol 7., no. 568, 2013 – pdf

New feedback and training tasks for BCI:

  • L. Pillette, C. Jeunet, B. Mansencal, R. N’Kambou, B. N’Kaoua, F. Lotte, “PEANUT : Personalised Emotional Agent for Neurotechnology User-Training”, 7th international BCI conference, 2017 – pdf
  • J. Mladenovic, J. Frey, M. Bonnet-Save, J. Mattout, F. Lotte, “The Impact of Flow in an EEG-based Brain Computer Interface”, 7th international BCI conference, 2017
  • L. Perronnet, A. Lécuyer, M. Mano, E. Bannier, F. Lotte, M. Clerc, C. Barillot, “Unimodal versus bimodal EEG-fMRI neurofeedback of a motor imagery task”, Frontiers in Human Neuroscience, vol. 11, pp 193, 2017 – pdf
  • S. Teillet, F. Lotte, B. N’Kaoua, C. Jeunet, “Towards a Spatial Ability Training to Improve Motor Imagery based Brain-Computer Interfaces (MI-BCIs) Performance: a Pilot Study“, IEEE International Conference on Systems Man and Cybernetics (IEEE SMC), 2016 – pdf
  • J. Schumacher, C. Jeunet, F. Lotte, “Towards Explanatory Feedback for User Training in Brain-Computer Interfaces”, IEEE International Conference on Systems Man and Cybernetics (IEEE SMC), 2015 – pdf
  • C. Jeunet, C. Vi, D. Spelmezan, B. N’Kaoua, F. Lotte, S. Subramanian, “Continuous Tactile Feedback for Motor-Imagery based Brain-Computer Interaction in a Multitasking Context”, Interact 2015 – pdf
  • J. Mercier-Ganady, F. Lotte, E. Loup-Escande, M. Marchal, A. Lécuyer, “The Mind-Mirror: See your Brain in Action in your head Using EEG and Augmented Reality”, IEEE Virtual Reality conference (VR 2014), pp. 33-38, 2014 – videopdf
  • L. Bonnet, F. Lotte, A. Lécuyer, “Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery”, IEEE Transactions on Computational Intelligence and AI in Games (IEEE T-CIAIG), vol. 5, num. 2, pp. 185-198, 2013

Comments are closed