The COVID-19 pandemic has necessitated innovations in data collection protocols, including use of virtual or remote visits. Although developmental scientists used virtual visits prior to COVID-19, validation of virtual assessments of infant socioemotional and language development are lacking. We aimed to fill this gap by validating a virtual visit protocol that assesses mother and infant behavior during the Still Face Paradigm and infant receptive and expressive communication using the Bayley-III Screening Test. Validation was accomplished through comparisons of data collected during (...) in-person laboratory visits and virtual visits conducted via Zoom. Of the 119 mother-infant dyads who participated, 73 participated in lab visits only, 13 participated in virtual visits only, and 33 dyads participated in a combination of lab and virtual visits across four time points. Maternal perspectives of, and preferences for, virtual visits were also assessed. Proportions of missing data were higher during virtual visits, particularly for assessments of infant receptive communication. Nonetheless, comparisons of virtual and laboratory visits within a given time point indicated that mothers and infants showed similar proportions of facial expressions, vocalizations and directions of gaze during the SFP and infants showed similar and expected patterns of behavioral change across SFP episodes. Infants also demonstrated comparable expressive and receptive communicative abilities across virtual and laboratory assessments. Maternal reports of ease and preference for virtual visits varied by infant age, with mothers of 12-month-old infants reporting, on average, less ease of virtual visits and a preference for in-person visits. Results are discussed in terms of feasibility and validity of virtual visits for assessing infant socioemotional and language development, and broader advantages and disadvantages of virtual visits are also considered. (shrink)

Improving generalization in psychology will require more expansive data collection to fuel more expansive statistical models, beyond the scale of traditional lab research. We argue that citizen science is uniquely positioned to scale up data collection and, that in spite of certain limitations, can help to alleviate the generalizability crisis.

In early 2020, in-person data collection dramatically slowed or was completely halted across the world as many labs were forced to close due to the COVID-19 pandemic. Developmental researchers who assess looking time were forced to re-think their methods of data collection. While a variety of remote or online platforms are available for gathering behavioral data outside of the typical lab setting, few are specifically designed for collecting and processing looking time data in infants and young children. To address these (...) challenges, our lab developed several novel approaches for continuing data collection and coding for a remotely administered audiovisual looking time protocol. First, we detail a comprehensive approach for successfully administering the Multisensory Attention Assessment Protocol, developed by our lab to assess multisensory attention skills. The MAAP is administered from a distance by using Zoom, Gorilla Experiment Builder, an internet connection, and a home computer. This new data collection approach has the advantage that participants can be tested in their homes. We discuss challenges and successes in implementing our approach for remote testing and data collection during an ongoing longitudinal project. Second, we detail an approach for estimating gaze direction and duration collected remotely from webcam recordings using a post processing toolkit and demonstrate its effectiveness and precision. However, because OpenFace derives gaze estimates without translating them to an external frame of reference, we developed a machine learning approach to overcome this limitation. Thus, third, we trained a ML algorithm [] to classify gaze estimates from OpenFace with respect to areas of interest on the participant's screen. We then demonstrate reliability between this approach and traditional coding approaches. The combination of OpenFace and ML will provide a method to automate the coding of looking time for data collected remotely. Finally, we outline a series of best practices for developmental researchers conducting remote data collection for looking time studies. (shrink)

Online data collection methods are expanding the ease and access of developmental research for researchers and participants alike. While its popularity among developmental scientists has soared during the COVID-19 pandemic, its potential goes beyond just a means for safe, socially distanced data collection. In particular, advances in video conferencing software has enabled researchers to engage in face-to-face interactions with participants from nearly any location at any time. Due to the novelty of these methods, however, many researchers still remain uncertain about (...) the differences in available approaches as well as the validity of online methods more broadly. In this article, we aim to address both issues with a focus on moderated data collected using video-conferencing software. First, we review existing approaches for designing and executing moderated online studies with young children. We also present concrete examples of studies that implemented choice and verbal measures and looking time across both in-person and online moderated data collection methods. Direct comparison of the two methods within each study as well as a meta-analysis of all studies suggest that the results from the two methods are comparable, providing empirical support for the validity of moderated online data collection. Finally, we discuss current limitations of online data collection and possible solutions, as well as its potential to increase the accessibility, diversity, and replicability of developmental science. (shrink)

Online data collection with infants raises special opportunities and challenges for developmental research. One of the most prevalent methods in infancy research is eye-tracking, which has been widely applied in laboratory settings to assess cognitive development. Technological advances now allow conducting eye-tracking online with various populations, including infants. However, the accuracy and reliability of online infant eye-tracking remain to be comprehensively evaluated. No research to date has directly compared webcam-based and in-lab eye-tracking data from infants, similarly to data from adults. (...) The present study provides a direct comparison of in-lab and webcam-based eye-tracking data from infants who completed an identical looking time paradigm in two different settings. We assessed 4-6-month-old infants in an eye-tracking task that measured the detection of audio-visual asynchrony. Webcam-based and in-lab eye-tracking data were compared on eye-tracking and video data quality, infants’ viewing behavior, and experimental effects. Results revealed no differences between the in-lab and online setting in the frequency of technical issues and participant attrition rates. Video data quality was comparable between settings in terms of completeness and brightness, despite lower frame rate and resolution online. Eye-tracking data quality was higher in the laboratory than online, except in case of relative sample loss. Gaze data quantity recorded by eye-tracking was significantly lower than by video in both settings. In valid trials, eye-tracking and video data captured infants’ viewing behavior uniformly, irrespective of setting. Despite the common challenges of infant eye-tracking across experimental settings, our results point toward the necessity to further improve the precision of online eye-tracking with infants. Taken together, online eye-tracking is a promising tool to assess infants’ gaze behavior but requires careful data quality control. The demographic composition of both samples differed from the generic population on caregiver education: our samples comprised caregivers with higher-than-average education levels, challenging the notion that online studies will per se reach more diverse populations. (shrink)

Emotional creativity refers to cognitive abilities and personality traits related to the originality of emotional experience and expression. Previous studies have found that the COVID-19 epidemic and the restrictions imposed increased the levels of negative emotions, which obstructed adaptation. This research suggests that EC predicts the motivation for innovative adaptive behavior under the restrictions of COVID-19. In the case study of university professors, we show that EC predicts the motivation to creatively capitalize on the imposed online teaching in looking for (...) innovative research and personal development. Methodologically, we rely on the Emotional Creativity Inventory administered to a sample of 463 university professors from the Czech Republic, Slovak Republic, and Russia. The indicators for motivation for innovative performance included motivations to use distant methods of scientific research, to look for partners for conducting scientific research in other cities or abroad, to conduct interdisciplinary research, starting distance learning to enhance qualifications, and the perception that due to online teaching, there is more time for personal development. We employ a set of ordinal regression analyses controlling for age, gender, position, type of science, and country. The results suggest that Emotional Creativity and its three components predict the motivation of university professors to creatively capitalize on the imposed online teaching in looking for innovative research and personal development under the conditions of COVID-19. Furthermore, our results confirmed the gender and age differences in EC. The differences in EC according to position and type of science were not statistically significant. These results compel us to be aware of the importance of the emotional side of creativity to optimize stress-related behavior under the conditions of limited abilities to continue as usual. More space devoted to the manifestation of all the aspects of emotional creativity would improve adaptation to challenging circumstances and even allow one to capitalize on new opportunities. Moreover, we suggest that if personal intrinsic Emotional Creativity is high, the crises, such as the COVID-19 epidemic, may improve adaptation and trigger creative outcomes. (shrink)