As an important component to promote the development of affective brain–computer interfaces, the study of emotion recognition based on electroencephalography (EEG) has encountered a difficult challenge; the distribution of EEG data changes among different subjects and at different time periods. Domain adaptation methods can effectively alleviate the generalization problem of EEG emotion recognition models. However, most of them treat multiple source domains, with significantly different distributions, as one single source domain, and only adapt the cross-domain marginal distribution while ignoring the (...) joint distribution difference between the domains. To gain the advantages of multiple source distributions, and better match the distributions of the source and target domains, this paper proposes a novel multi-source joint domain adaptation (MSJDA) network. We first map all domains to a shared feature space and then align the joint distributions of the further extracted private representations and the corresponding classification predictions for each pair of source and target domains. Extensive cross-subject and cross-session experiments on the benchmark dataset, SEED, demonstrate the effectiveness of the proposed model, where more significant classification results are obtained on the more difficult cross-subject emotion recognition task. (shrink)

Common spatial pattern is an effective algorithm for extracting electroencephalogram features of motor imagery ; however, CSP mainly aims at multichannel EEG signals, and its effect in extracting EEG features with fewer channels is poor—even worse than before using CSP. To solve the above problem, a new combined feature extraction method has been proposed in this study. For EEG signals from fewer channels, wavelet packet transform, fast ensemble empirical mode decomposition, and local mean decomposition were used to decompose the band-pass (...) filtered EEG into multiple time–frequency components, and the corresponding components were selected according to the frequency characteristics of MI or the correlation coefficient between its time–frequency components and the original EEG signal. Furthermore, phase space reconstruction was performed on the selected components after the three time-frequency decompositions, the maximum Lyapunov index was calculated, and the features were reconstructed; then, CSP projection mapping was used for the reconstructed features. The support vector machine probability output model was trained by the obtained three mappings. Probability outputs by three different support vector machines were then obtained. Finally, the classification of test samples was determined by the fusion of the Dempster–Shafer evidence theory at the decision level. The results showed that the accuracy of the proposed method was 95.71% on data set III of BCI competition II, which was 2.88% higher than the existing methods. On data set IIb of BCI competition IV, the average accuracy was 86.60%, which was 2.3% higher than the existing methods. This study verified the effectiveness of the proposed method and provided an approach for the research and development of the MI-BCI system based on fewer channels. (shrink)