To improve the spatial resolution of imaging and get more effective brain function information, a multi-distance probe configuration with three distances and 52 channels is designed. At the same time, a data conversion method of modified Beer–Lambert law with partial pathlength is proposed. In the experiment, three kinds of tasks, grip of left hand, grip of right hand, and rest, are performed with eight healthy subjects. First, with a typical single-distance probe configuration, the feasibility of the proposed MBLL with PPL (...) is preliminarily validated. Further, the characteristic of the proposed method is evaluated with the multi-distance probe configuration. Compared with MBLL with differential pathlength factor, the proposed MBLL with PPL is able to acquire more obvious concentration change and can achieve higher classification accuracy of the three tasks. Then, with the proposed method, the performance of the multi-distance probe configuration is discussed. Results show that, compared with a single distance, the combination of the three distances has better spatial resolution and could explore more accurate brain activation information. Besides, the classification accuracy of the three tasks obtained with the combination of three distances is higher than that of any combination of two distances. Also, with the combination of the three distances, the two-class classification between different tasks is carried out. Both theory and experimental results demonstrate that, using multi-distance probe configuration and the MBLL with PPL method, the performance of brain function detected by NIRS can be improved. (shrink)

IntroductionRace-walking is a sport that mimics normal walking and running. Previous studies on sports science mainly focused on the cardiovascular and musculoskeletal systems. However, there is still a lack of research on the central nervous system, especially the real-time changes in brain network characteristics during race-walking exercise. This study aimed to use a network perspective to investigate the effects of different exercise intensities on brain functional connectivity.Materials and methodsA total of 16 right-handed healthy young athletes were recruited as participants in (...) this study. The cerebral cortex concentration of oxyhemoglobin was measured by functional near-infrared spectroscopy in the bilateral prefrontal cortex (PFC), the motor cortex (MC) and occipital cortex (OC) during resting and race-walking states. Three specific periods as time windows corresponding to different exercise intensities were divided from the race-walking time of participants, including initial, intermediate and sprint stages. The brain activation and functional connectivity (FC) were calculated to describe the 0.01-0.1 Hz frequency-specific cortical activities.ResultsCompared to the resting state, FC changes mainly exist between MC and OC in the initial stage, while PFC was involved in FC changes in the intermediate stage, and FC changes in the sprint stage were widely present in PFC, MC and OC. In addition, from the initial-development to the sprint stage, the significant changes in FC were displayed in PFC and MC.ConclusionThis brain functional connectivity-based study confirmed that hemodynamic changes at different exercise intensities reflected different brain network-specific characteristics. During race-walking exercise, more extensive brain activation might increase information processing speed. Increased exercise intensity could facilitate the integration of neural signals such as proprioception, motor control and motor planning, which may be an important factor for athletes to maintain sustained motor coordination and activity control at high intensity. This study was beneficial to understanding the neural mechanisms of brain networks under different exercise intensities. (shrink)

Electroencephalography and functional near-infrared spectroscopy have potentially complementary characteristics that reflect the electrical and hemodynamic characteristics of neural responses, so EEG-fNIRS-based hybrid brain-computer interface is the research hotspots in recent years. However, current studies lack a comprehensive systematic approach to properly fuse EEG and fNIRS data and exploit their complementary potential, which is critical for improving BCI performance. To address this issue, this study proposes a novel multimodal fusion framework based on multi-level progressive learning with multi-domain features. The framework consists (...) of a multi-domain feature extraction process for EEG and fNIRS, a feature selection process based on atomic search optimization, and a multi-domain feature fusion process based on multi-level progressive machine learning. The proposed method was validated on EEG-fNIRS-based motor imagery and mental arithmetic tasks involving 29 subjects, and the experimental results show that multi-domain features provide better classification performance than single-domain features, and multi-modality provides better classification performance than single-modality. Furthermore, the experimental results and comparison with other methods demonstrated the effectiveness and superiority of the proposed method in EEG and fNIRS information fusion, it can achieve an average classification accuracy of 96.74% in the MI task and 98.42% in the MA task. Our proposed method may provide a general framework for future fusion processing of multimodal brain signals based on EEG-fNIRS. (shrink)

This study decodes consumers' preference levels using a convolutional neural network in neuromarketing. The classification accuracy in neuromarketing is a critical factor in evaluating the intentions of the consumers. Functional near-infrared spectroscopy is utilized as a neuroimaging modality to measure the cerebral hemodynamic responses. In this study, a specific decoding structure, called CNN-based fNIRS-data analysis, was designed to achieve a high classification accuracy. Compared to other methods, the automated characteristics, constant training of the dataset, and learning efficiency of the proposed (...) method are the main advantages. The experimental procedure required eight healthy participants to view commercial advertisement videos of different durations. The cerebral hemodynamic responses of the participants were measured. To compare the preference classification performances, CNN was utilized to extract the most common features, including the mean, peak, variance, kurtosis, and skewness. Considering three video durations, the average classification accuracies of 15, 30, and 60 s videos were 84.3, 87.9, and 86.4%, respectively. Among them, the classification accuracy of 87.9% for 30 s videos was the highest. The average classification accuracies of three preferences in females and males were 86.2 and 86.3%, respectively, showing no difference in each group. By comparing the classification performances in three different combinations between two groups, male participants were observed to have targeted preferences for commercial advertising, and the classification performance 88.4% between “like” vs. “dislike” out of three categories was the highest. Finally, pairwise classification performance are shown as follows: For female, 86.1%, 87.4%, 85.2%, and for male 85.7, 88.4, 85.1%, respectively. (shrink)

Exposure Therapy (ET) has demonstrated its efficacy in the treatment of phobias, anxiety and Post-traumatic Stress Disorder (PTSD), however, it suffers a high drop-out rate because of too low or too high patient engagement in treatment. Virtual Reality Exposure Therapy (VRET) is comparably effective regarding symptom reduction and offers an alternative tool to facilitate engagement for avoidant participants. Neuroimaging studies have demonstrated that both ET and VRET normalize brain activity within a fear circuit. However, previous studies have employed brain imaging (...) technology which restricts people’s movement and hides their body, surroundings and therapist from view. This is at odds with the way engagement is typically controlled. We used a novel combination of neural imaging and VR technology—Functional Near-Infrared Spectroscopy (fNIRS) and Immersive Projection Technology (IPT), to avoid these limitations. Although there are a few studies that have investigated the effect of VRET on a brain function after the treatment, the present study utilized technologies which promote ecological validity to measure brain changes after VRET treatment. Furthermore, there are no studies that have measured brain activity within VRET session. In this study brain activity within the prefrontal cortex (PFC) was measured during three consecutive exposure sessions. N = 13 acrophobic volunteers were asked to walk on a virtual plank with a 6 m drop below. Changes in oxygenated (HbO) hemogl... (shrink)

Functional near-infrared spectroscopy has attracted increasing attention in the field of brain–computer interfaces owing to their advantages such as non-invasiveness, user safety, affordability, and portability. However, fNIRS signals are highly subject-specific and have low test-retest reliability. Therefore, individual calibration sessions need to be employed before each use of fNIRS-based BCI to achieve a sufficiently high performance for practical BCI applications. In this study, we propose a novel deep convolutional neural network -based approach for implementing a subject-independent fNIRS-based BCI. A total (...) of 18 participants performed the fNIRS-based BCI experiments, where the main goal of the experiments was to distinguish a mental arithmetic task from an idle state task. Leave-one-subject-out cross-validation was employed to evaluate the average classification accuracy of the proposed subject-independent fNIRS-based BCI. As a result, the average classification accuracy of the proposed method was reported to be 71.20 ± 8.74%, which was higher than the threshold accuracy for effective BCI communication as well as that obtained using conventional shrinkage linear discriminant analysis. To achieve a classification accuracy comparable to that of the proposed subject-independent fNIRS-based BCI, 24 training trials were necessary for the traditional subject-dependent fNIRS-based BCI. It is expected that our CNN-based approach would reduce the necessity of long-term individual calibration sessions, thereby enhancing the practicality of fNIRS-based BCIs significantly. (shrink)

Brain-computer interface multi-modal fusion has the potential to generate multiple commands in a highly reliable manner by alleviating the drawbacks associated with single modality. In the present work, a hybrid EEG-fNIRS BCI system—achieved through a fusion of concurrently recorded electroencephalography and functional near-infrared spectroscopy signals—is used to overcome the limitations of uni-modality and to achieve higher tasks classification. Although the hybrid approach enhances the performance of the system, the improvements are still modest due to the lack of availability of computational (...) approaches to fuse the two modalities. To overcome this, a novel approach is proposed using Multi-resolution singular value decomposition to achieve system- and feature-based fusion. The two approaches based up different features set are compared using the KNN and Tree classifiers. The results obtained through multiple datasets show that the proposed approach can effectively fuse both modalities with improvement in the classification accuracy. (shrink)

Human gait is a complex activity that requires high coordination between the central nervous system, the limb, and the musculoskeletal system. More research is needed to understand the latter coordination's complexity in designing better and more effective rehabilitation strategies for gait disorders. Electroencephalogram and functional near-infrared spectroscopy are among the most used technologies for monitoring brain activities due to portability, non-invasiveness, and relatively low cost compared to others. Fusing EEG and fNIRS is a well-known and established methodology proven to enhance (...) brain–computer interface performance in terms of classification accuracy, number of control commands, and response time. Although there has been significant research exploring hybrid BCI involving both EEG and fNIRS for different types of tasks and human activities, human gait remains still underinvestigated. In this article, we aim to shed light on the recent development in the analysis of human gait using a hybrid EEG-fNIRS-based BCI system. The current review has followed guidelines of preferred reporting items for systematic reviews and meta-Analyses during the data collection and selection phase. In this review, we put a particular focus on the commonly used signal processing and machine learning algorithms, as well as survey the potential applications of gait analysis. We distill some of the critical findings of this survey as follows. First, hardware specifications and experimental paradigms should be carefully considered because of their direct impact on the quality of gait assessment. Second, since both modalities, EEG and fNIRS, are sensitive to motion artifacts, instrumental, and physiological noises, there is a quest for more robust and sophisticated signal processing algorithms. Third, hybrid temporal and spatial features, obtained by virtue of fusing EEG and fNIRS and associated with cortical activation, can help better identify the correlation between brain activation and gait. In conclusion, hBCI system is not yet much explored for the lower limb due to its complexity compared to the higher limb. Existing BCI systems for gait monitoring tend to only focus on one modality. We foresee a vast potential in adopting hBCI in gait analysis. Imminent technical breakthroughs are expected using hybrid EEG-fNIRS-based BCI for gait to control assistive devices and Monitor neuro-plasticity in neuro-rehabilitation. However, although those hybrid systems perform well in a controlled experimental environment when it comes to adopting them as a certified medical device in real-life clinical applications, there is still a long way to go. (shrink)

We present a nonparametric approach to prediction of the n-back n \in {1, 2} task as a proxy measure of mental workload using Near Infrared Spectroscopy (NIRS) data. In particular, we focus on measuring the mental workload through hemodynamic responses in the brain induced by these tasks, thereby realizing the potential that they can offer for their detection in real world scenarios (e.g., difficulty of a conversation). Our approach takes advantage of intrinsic linearity that is inherent in the components of (...) the NIRS time series to adopt a one step regression strategy. We demonstrate the correctness of our approach through its mathematical analysis. Furthermore, we study the performance of our model in an inter-subject setting in contrast with state-of-the-art techniques in the literature to show a significant improvement on prediction of these tasks (82.50% and 86.40% for female and male participants, respectively). Moreover, our empirical analysis suggest a gender difference effect on the performance of the classifiers (with male data exhibiting a higher non-linearity) along with the left-lateralized activation in both genders with higher specificity in females. (shrink)

Training under high interference conditions through interleaved practice results in performance suppression during training but enhances long-term performance relative to repetitive practice involving low interference. Previous neuroimaging work addressing this contextual interference effect of motor learning has relied heavily on the blood-oxygen-level-dependent response using functional magnetic resonance imaging methodology resulting in mixed reports of prefrontal cortex recruitment under IP and RP conditions. We sought to clarify these equivocal findings by imaging bilateral PFC recruitment using functional near-infrared spectroscopy while discrete key (...) pressing sequences were trained under IP and RP schedules and subsequently tested following a 24-h delay. An advantage of fNIRS over the fMRI BOLD response is that the former measures oxygenated and deoxygenated hemoglobin changes independently allowing for assessment of cortical hemodynamics even when there is neurovascular decoupling. Despite slower sequence performance durations under IP, bilateral PFC oxygenated and deoxygenated hemoglobin values did not differ between practice conditions. During test, however, slower performance from those previously trained under RP coincided with hemispheric asymmetry in PFC recruitment. Specifically, following RP, test deoxygenated hemoglobin values were significantly lower in the right PFC. The present findings contrast with previous behavioral demonstrations of increased cognitive demand under IP to illustrate a more complex involvement of the PFC in the contextual interference effect. IP and RP incur similar levels of bilateral PFC recruitment, but the processes underlying the recruitment are dissimilar. PFC recruitment during IP supports action reconstruction and memory elaboration while RP relies on PFC recruitment to maintain task variation information in working memory from trial to trial. While PFC recruitment under RP serves to enhance immediate performance, it does not support long-term performance. (shrink)

There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during (...) highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations. (shrink)

Brain-computer interfaces (BCIs) are being investigated as an access pathway to communication for individuals with physical disabilities, as the technology obviates the need for voluntary motor control. However, to date, minimal research has investigated the use of BCIs for children. Traditional BCI communication paradigms may be suboptimal given that children with physical disabilities may face delays in cognitive development and acquisition of literacy skills. Instead, in this study we explored emotional state as an alternative access pathway to communication. We developed (...) a pediatric BCI to identify positive and negative emotional states from changes in hemodynamic activity of the prefrontal cortex (PFC). To train and test the BCI, 10 neurotypical children aged 8–14 underwent a series of emotion-induction trials over four experimental sessions (one offline, three online) while their brain activity was measured with functional near-infrared spectroscopy (fNIRS). Visual neurofeedback was used to assist participants in regulating their emotional states and modulating their hemodynamic activity in response to the affective stimuli. Child-specific linear discriminant classifiers were trained on cumulatively available data from previous sessions and adaptively updated throughout each session. Average online valence classification exceeded chance across participants by the last two online sessions (with 7 and 8 of the 10 participants performing better than chance, respectively, in Sessions 3 and 4). There was a small significant positive correlation with online BCI performance and age, suggesting older participants were more successful at regulating their emotional state and/or brain activity. Variability was seen across participants in regards to BCI performance, hemodynamic response, and discriminatory features and channels. Retrospective offline analyses yielded accuracies comparable to those reported in adult affective BCI studies using fNIRS. Affective fNIRS-BCIs appear to be feasible for school-aged children, but to further gauge the practical potential of this type of BCI, replication with more training sessions, larger sample sizes, and end-users with disabilities is necessary. (shrink)

Recent advances in neuroscience have paved the way to innovative applications that cognitively augment and enhance humans in a variety of contexts. This paper aims at providing a snapshot of the current state of the art and a motivated forecast of the most likely developments in the next two decades. Firstly, we survey the main neuroscience technologies for both observing and influencing brain activity, which are necessary ingredients for human cognitive augmentation. We also compare and contrast such technologies, as their (...) individual characteristics (e.g., spatio-temporal resolution, invasiveness, portability, energy requirements and cost) influence their current and future role in human cognitive augmentation. Secondly, we chart the state of the art on neurotechnologies for human cognitive augmentation, keeping an eye both on the applications that already exist and those that are emerging or are likely to emerge in the next two decades. Particularly, we consider applications in the areas of communication, cognitive enhancement, memory, attention monitoring/enhancement, situation awareness and complex problem solving, and we look at what fraction of the population might benefit from such technologies and at the demands they impose in terms of user training. Thirdly, we briefly review the ethical issues associated with current neuroscience technologies. These are important because they may differentially influence both present and future research on (and adoption of) neurotechnologies for human cognitive augmentation: an inferior technology with no significant ethical issues may thrive while a superior technology causing widespread ethical concerns may end up being outlawed. Finally, based on the lessons learned in our analysis, using past trends and considering other related forecasts, we attempt to forecast the most likely future developments of neuroscience technology for human cognitive augmentation and provide informed recommendations for promising future research and exploitation avenues. (shrink)

A passive brain–computer interface based upon functional near-infrared spectroscopy brain signals is used for earlier detection of human drowsiness during driving tasks. This BCI modality acquired hemodynamic signals of 13 healthy subjects from the right dorsolateral prefrontal cortex of the brain. Drowsiness activity is recorded using a continuous-wave fNIRS system and eight channels over the right DPFC. During the experiment, sleep-deprived subjects drove a vehicle in a driving simulator while their cerebral oxygen regulation state was continuously measured. Vector phase analysis (...) was used as a classifier to detect drowsiness state along with sleep stage-based threshold criteria. Extensive training and testing with various feature sets and classifiers are done to justify the adaptation of threshold criteria for any subject without requiring recalibration. Three statistical features along with six VPA features were used. The average accuracies for the five classifiers are 90.9% for discriminant analysis, 92.5% for support vector machines, 92.3% for nearest neighbors, 92.4% for both decision trees, and ensembles over all subjects’ data. Trajectory slopes of CORE vector magnitude and angle: m and m are the best-performing features, along with ensemble classifier with the highest accuracy of 95.3% and minimum computation time of 40 ms. The statistical significance of the results is validated with a p-value of less than 0.05. The proposed passive BCI scheme demonstrates a promising technique for online drowsiness detection using VPA along with sleep stage classification. (shrink)

Multi-modal integration, which combines multiple neurophysiological signals, is gaining more attention for its potential to supplement single modality’s drawbacks and yield reliable results by extracting complementary features. In particular, integration of electroencephalography and functional near-infrared spectroscopy is cost-effective and portable, and therefore is a fascinating approach to brain-computer interface. However, outcomes from the integration of these two modalities have yielded only modest improvement in BCI performance because of the lack of approaches to integrate the two different features. In addition, mismatch (...) of recording locations may hinder further improvement. In this literature review, we surveyed studies of the integration of EEG/fNIRS in BCI thoroughly and discussed its current limitations. We also suggested future directions for efficient and successful multi-modal integration of EEG/fNIRS in BCI systems. (shrink)

Over the last few decades, neuroimaging techniques have transformed our understanding of the brain and the effect of neurological conditions on brain function. More recently, light-based modalities such as functional near-infrared spectroscopy have gained popularity as tools to study brain function at the bedside. A recent application is to assess residual awareness in patients with disorders of consciousness, as some patients retain awareness albeit lacking all behavioural response to commands. Functional near-infrared spectroscopy can play a vital role in identifying these (...) patients by assessing command-driven brain activity. The goal of this review is to summarise the studies reported on this topic, to discuss the technical and ethical challenges of working with patients with disorders of consciousness, and to outline promising future directions in this field. (shrink)