Emotions are multimodal processes that play a crucial role in our everyday lives. Recognizing emotions is becoming more critical in a wide range of application domains such as healthcare, education, human-computer interaction, Virtual Reality, intelligent agents, entertainment, and more. Facial macro-expressions or intense facial expressions are the most common modalities in recognizing emotional states. However, since facial expressions can be voluntarily controlled, they may not accurately represent emotional states. Earlier studies have shown that facial micro-expressions are more reliable than facial (...) macro-expressions for revealing emotions. They are subtle, involuntary movements responding to external stimuli that cannot be controlled. This paper proposes using facial micro-expressions combined with brain and physiological signals to more reliably detect underlying emotions. We describe our models for measuring arousal and valence levels from a combination of facial micro-expressions, Electroencephalography (EEG) signals, galvanic skin responses (GSR), and Photoplethysmography (PPG) signals. We then evaluate our model using the DEAP dataset and our own dataset based on a subject-independent approach. Lastly, we discuss our results, the limitations of our work, and how these limitations could be overcome. We also discuss future directions for using facial micro-expressions and physiological signals in emotion recognition. (shrink)

Hemagglutinin is a major virulence factor of influenza viruses and plays an important role in viral pathogenesis. Analysis of amino acid changes, epitopes’ regions, glycosylation and phosphorylation sites have greatly contributed to the development of new generations of vaccine. The hemagglutinins of 10 selected isolates, 8 of 2010 and 2 of 2013 samples were sequenced and analyzed by several bioinformatic softwares and the results were compared with those of 3 vaccine isolates. The study detected several amino acid changes related to (...) altered epitopes’ sites, modification sites and physico-chemical properties. The results showed some conserved modification sites in HA structure. This study is the first analytical research on isolates obtained from Shiraz, Iran, and our results can be used to better understand the genetic diversity and antigenic variations in Iranian and Asian H1N1 pathogenic strains. (shrink)