Notwithstanding diverse opinions and debates about mixing methods, mixed methods research (MMR) is increasingly being used in sport and exercise psychology. In this paper, we describe MMR trends within leading sport and exercise psychology journals and explore critical realism as a possible underpinning framework for conducting MMR. Our meta-study of recent empirical mixed methods studies published in 2017–2019 indicates that eight (36%) of the 22 MMR studies explicitly stated a paradigmatic position (five drew on pragmatism, (...) two switched paradigms between qualitative and quantitative elements of the study, and one was situated in relativist-interpretivism). The remaining 14 (64%) studies did not report their underpinning research philosophical assumptions. Evaluating the merits and limitations of these positions against critical realist assumptions suggests that several paradigmatic disagreements are potentially reconcilable. These include (a) maintaining that ontological and epistemological concerns are important for methodological integrity of a mixed methods study; (b) switching between paradigms in the same study is problematic; and (c) refuting the qualitative-quantitative incommensurability thesis, therefore allowing mixed methods research without compromising philosophical coherence. From a critical realist position, we suggest that both quantitative and qualitative designs are justifiable in a mixed methods study because (1) they help corroborate, refine, or refute plausible explanations of phenomena (epistemological), but (2) with different methodologies utilised to perform different tasks in the same research design related to different psycho-social system features (ontological). We call for a collaborative engagement by researchers across paradigmatic positions to work towards the advancement of methodological pluralism in our research community. (shrink)

This paper provides a critical review of the debate over the philosophical foundations of mixed methods research and examines the notion of philosophical foundations. It distinguishes axiology-oriented from ontology-oriented philosophical foundations. It also identifies three different senses of philosophical foundations of mixed methods research. The weak sense of philosophical foundations (e.g., pragmatism) merely allows the possibility of the integration of both quantitative and qualitative methods/data/designs. The moderate sense of philosophical foundations (e.g., transformativism) provide a good (...) reason to use mixed methods in (at least some) social scientific research. The strong sense of philosophical foundations (e.g., dialectical pluralism) justifies a normative thesis that mixed methods research should be encouraged in (at least some) social scientific research. (shrink)

Combining methods in social scientific research has recently gained momentum through a research strand called Mixed Methods Research. This approach, which explicitly aims to offer a framework for combining methods, has rapidly spread through the social and behavioural sciences, and this article offers an analysis of the approach from a field theoretical perspective. After a brief outline of the MMR program, we ask how its recent rise can be understood. We then delve deeper into some of (...) the specific elements that constitute the MMR approach, and we engage critically with the assumptions that underlay this particular conception of using multiple methods. We conclude by offering an alternative view regarding methods and method use. (shrink)

A variety of philosophical positions have been proposed and developed to motivate, justify, and guide mixed methods research. This chapter provides a brief overview of the main positions in the debate over the philosophical foundations of mixed methods research. It shows that ‘philosophical foundations’ means differently while different positions provide ‘philosophical foundations’ in different senses. It also highlights the significance of the collaboration between researchers and philosophers in the examination of the philosophical foundations of mixed (...) methods research. (shrink)

Household confinement due to the rapid spread of the pandemic caused by COVID-19 has brought very significant changes, such as the forced stay-at-home of children due to the closure of schools. This has meant drastic changes in the organization of daily life and restrictions on their activities, including exercise, which could affect the quality of life of the children due to its importance. In order to study the relationship between physical activity and psychological well-being of minors, a study has been (...) carried out with Mixed Methods Research, combining survey methodology with transversal design with qualitative methodology using discourse analysis. A total of 234 parents of minors in Spain and several Spanish-speaking countries in America participated. The instrument was a questionnaire in Google Forms, which included the Kidscreen-27 quality of life scale. The results show significant differences in both the type of physical activity and its frequency due to age, and differences in parents’ perception of whether their children’s physical activity levels were sufficient or not, both on the health, mood and school subscales, and in the categorization of open responses referring to concerns due to the pandemic, analyzed with the ALCESTE technique. The relationship between physical activity of children and adolescents and quality of life is clearly concluded. (shrink)

As mixed methods research approaches become increasingly more common, it is imperative they are conducted in a thoughtful and rigorous manner to yield useful results. While researchers have begun to explore the use of various qualitative research methodologies in mixed methods research, there is a gap in literature discussing the philosophical congruence of using interpretive description in mixed method studies, and how to ensure rigor while integrating interpretive description results. Our purpose in writing this article (...) is to discuss the issues of fit, purpose, process, context, and design when using interpretive description in mixed methods research approaches by drawing on examples from the literature. Further, we explore the contributions that interpretive description can make in a mixed methods inquiry. This article offers a first step in using a purposeful approach to mixed methods interpretive description studies to increase transparency and rigor in this relatively new methodology. (shrink)

Mixed methods research - the combination of qualitative and quantitative data within the same design to strengthen causal inference - is gaining prominence in the social sciences but its benefits are contested. There remains confusion over which methods to mix and what is the point of mixing them. We argue that variety of evidence is what matters, not the data or methods, and that distinct epistemic principles underlie its added value for causal inference. The centrality of (...) evidential variety also implies that strong causal pluralism is untenable as a foundation for mixed methods research. (shrink)

Philosophical Foundations of Mixed Methods Research provides a comprehensive examination of the philosophical foundations of mixed methods research. It offers new defences of the seven main approaches to mixed methods (the pragmatist approach, the transformative approach, the indigenous approach, the dialectical approach, the dialectical pluralist approach, the performative approach, and the realist approach) written by leading mixed methods researchers. Each approach is accompanied by critical reflections chapter from philosophers’ point of view. The (...) book shows the value of the use of mixed methods from a philosophical point of view, and offers a systematic and critical examination of these positions and approaches from a philosophical point of view. The volume also offers a platform to promote a dialogue between mixed methods researchers and philosophers of science, and provides foundations for further research and teaching of this hotly debated topic. (shrink)

While a growing number of works have been published about the use of mixed methods research in nursing, scarce attention has been devoted to the issue of the quality of mixed methods within the discipline. The quality appraisal of mixed methods research poses two problems to nursing science: first, current quality criteria are not nursing‐specific and consequently, they might not facilitate the application of mixed methods research findings into nursing practice. Second, criteria (...) were theoretically derived and as such, they might not faithfully account for the decisions that nurse researchers take when appraising mixed methods research studies. This qualitative, within‐case study explored the views of nurse researchers about mixed methods research in general and, more specifically, the question of quality in mixed methods research. An international sample of 13 nurse researchers was interviewed via Skype and phone. Thematic analysis revealed that the participants favored universal, cross‐disciplinary quality criteria, and not criteria specific to the nursing discipline, and a consensual and standardized approach to appraising the quality of mixed methods research. Recommendations are put forward to strengthen the quality appraisal of mixed methods research studies by nurse researchers, as well as future works on this topic within nursing science. (shrink)

Unfortunately, figure 2 was incorrectly published.

Background Rapid Ethical Assessment is a form of rapid ethnographic assessment conducted at the beginning of research project to guide the consent process with the objective of reconciling universal ethical guidance with specific research contexts. The current study is conducted to assess the perceived relevance of introducing REA as a mainstream tool in Ethiopia. Methods Mixed methods research using a sequential explanatory approach was conducted from July to September 2012, including 241 cross-sectional, self-administered and 19 qualitative, in-depth (...) interviews among health researchers and regulators including ethics committee members in Ethiopian health research institutions and universities. Results In their evaluation of the consent process, only 40.2% thought that the consent process and information given were adequately understood by study participants; 84.6% claimed they were not satisfied with the current consent process and 85.5% thought the best interests of study participants were not adequately considered. Commonly mentioned consent-related problems included lack of clarity, inadequate information, language barriers, cultural differences, undue expectations and power imbalances. About 95.4% believed that consent should be contextualized to the study setting and 39.4% thought REA would be an appropriate approach to improve the perceived problems. Qualitative findings helped to further explore the gaps identified in the quantitative findings and to map-out concerns related to the current research consent process in Ethiopia. Suggestions included, conducting REA during the pre-test phase of studies when applicable. The need for clear guidance for researchers on issues such as when and how to apply the REA tools was stressed. Conclusion The study findings clearly indicated that there are perceived to be correctable gaps in the consent process of medical research in Ethiopia. REA is considered relevant by researchers and stakeholders to address these gaps. Exploring further the feasibility and applicability of REA is recommended. (shrink)

Yinyang philosophy encompasses an essential understanding of the mechanism and laws of nature, cosmos, and human society in Chinese culture, and reaches to many other parts of Asia and around the world. The purpose of this article is to explore how yinyang philosophy can serve as a philosophical underpinning of mixed methods research (MMR). In particular, harmony, one of the important features in yinyang philosophy, is applied to interpret the design of mixed methods research. Guided by (...) this philosophy, other beliefs about an integrated approach to using qualitative and quantitative methods fit in with the MMR approach. These underlying precepts are not necessarily held by researchers, and will be shown to indicate harmony and a dynamic equilibrium of yin and yang. This perspective provides a novel window for considering controversial issues that have arisen about the use of different philosophical underpinnings for MMR during its emergence over the past several decades. The implications are for a softer interpretation, for example, when selection of quantitative rules needs to harmonize with certain types of MMR, and validity of self-developed questionnaires needs to consider different levels of criteria for MMR. (shrink)

Rapid Ethical Assessment (REA) is a form of rapid ethnographic assessment conducted at the beginning of research project to guide the consent process with the objective of reconciling universal ethical guidance with specific research contexts. The current study is conducted to assess the perceived relevance of introducing REA as a mainstream tool in Ethiopia.

The goal of this research is to know and compare the emotions and reactions to confinement due to the COVID-19 pandemic in children and adolescents with high abilities and community samples. This is a mixed study with an exploratory reach that is descriptive, and which combines survey and qualitative methodologies to examine the emotions and reactions to confinement experiences of children and adolescents aged between 5 and 14 years. An online poll was designed with 46 questions, grouped into three (...) sections: General Data, Reactions to the health contingencies of COVID-19, and Positive and negative emotions. This last section was included the Oros’ positive emotions questionnaire and the scales of the negative effect of the PANAS Schedule positive and negative affect on children and adolescents between 8 and 14 years old. Data were collected online with a convenience sample. Quantitative data were analyzed with the SPSS statistics program and qualitative data with Alceste software. Among the main findings is the fact that there are no significant differences between the groups by ability in terms of reactions and emotions; however, there are differences between age groups and sex. The study discusses the implications for educational intervention in situations like the current pandemic. (shrink)

A monomethod bias still prevails in the psychology of religion, with the developing field studying the relationship between religiosity, spirituality and health being almost completely dominated by questionnaire research. This comes as a surprise, because the experiential side of religion, spirituality, can by definition be regarded as inner and private experiences of transcendence that have frequently been described as being of utmost importance. At first glance, from this perspective, standardized questionnaire scales appear to be inappropriate for “measuring the unmeasurable”. Until (...) now, no questionnaire instrument developed for the purpose of assessing spiritual and religious experiences has been qualitatively double-checked for intermethod validity. In order to throw light on whether questionnaire instruments are appropriate for measuring domains of spiritual and transcendental experiences, we tested a newly developed questionnaire instrument, the Exceptional Experience Questionnaire , for intermethod validity by conducting post-questionnaire interviews . This revealed that the EEQ was able to grasp these experiences within reasonable limits. However, two thirds of our interview sample said that the study had changed how they viewed these experiences. These findings suggest that the reactivity of quantitative instruments in grasping spiritual and transcendental domains should be taken into account, especially when devising longitudinal designs and further research is clearly needed. As a consequence, introducing a reflective circle of results stemming from both quantitative and qualitative approaches is recommended as the most useful and appropriate research tool for studying spiritual or mystical experiences, if not all constructs. (shrink)

The Baptist Union of Southern Africa's future is conspicuous unless it understands the context within which it ministers in our 'rainbow nation'. As a union of churches, BUSA faces significant challenges that have been highlighted through a mixed-methods research approach. Through many months of data collection at the Baptist Union archives, an online survey and informal interviews spanning many parts of South Africa, the researcher practically demonstrates the importance of the cumulative results for the future of BUSA. This (...) article highlights, in overview fashion, a few of the major challenges that need to be urgently addressed in the light of BUSA's historic ecclesiological presuppositions that have their roots in the missional ministry of Hugo Gutshe who saw each of his Baptist congregants as missionary, and expanded the influence of BUSA in South Africa. (shrink)

A monomethod bias still prevails in the psychology of religion, with the developing field studying the relationship between religiosity, spirituality and health being almost completely dominated by questionnaire research. This comes as a surprise, because the experiential side of religion, spirituality, can by definition be regarded as inner and private experiences of transcendence that have frequently been described as being of utmost importance. At first glance, from this perspective, standardized questionnaire scales appear to be inappropriate for “measuring the unmeasurable”. Until (...) now, no questionnaire instrument developed for the purpose of assessing spiritual and religious experiences has been qualitatively double-checked for intermethod validity. In order to throw light on whether questionnaire instruments are appropriate for measuring domains of spiritual and transcendental experiences, we tested a newly developed questionnaire instrument, the Exceptional Experience Questionnaire , for intermethod validity by conducting post-questionnaire interviews . This revealed that the EEQ was able to grasp these experiences within reasonable limits. However, two thirds of our interview sample said that the study had changed how they viewed these experiences. These findings suggest that the reactivity of quantitative instruments in grasping spiritual and transcendental domains should be taken into account, especially when devising longitudinal designs and further research is clearly needed. As a consequence, introducing a reflective circle of results stemming from both quantitative and qualitative approaches is recommended as the most useful and appropriate research tool for studying spiritual or mystical experiences, if not all constructs. (shrink)

This study sets out to develop a cognitive-behavioral therapy-based psychoeducation application to reduce the school burnout levels of secondary school students and to test its effectiveness with the mixed methods research design. For this purpose, qualitative data have been included in the process at three different steps, before, during, and after the experimental application involving an intervention application. The application of the intervention of the research has been carried out with an experimental design with pretest-posttest control group, which (...) is one of the true experimental designs. Experimental and control groups have been determined with 30 students reached by nested sampling method, and the CBT-based psychoeducation practice developed during the research process has been carried out for 9 weeks in the experimental group. During the research, descriptive analysis and content analysis methods have been used in the analysis of qualitative data, normality analysis, and One-Way Analysis of Covariance have been used in the analysis of quantitative data. Findings obtained from the study show that CBT-based psychoeducation practice is an effective approach in reducing school burnout. It has also been determined that the findings obtained from the analysis of the documents obtained during the application and findings from the interview process done after the application coincided with the findings of quantitative methods, and the qualitative findings adequately explain the quantitative findings. (shrink)

The subject of bullying has received widespread academic attention, going back to pioneering studies in the 1970s. However, work in this area has tended to take a gender-neutral/male perspective that does not distinguish between male and female bullying. While retaining a dialogue with generalist literature on the subject, this article seeks to highlight the theoretical and political-social relevance of gender-specific and intersectional approaches when exploring the question of bullying between adolescent girls. Based on the study _Il bullismo femminile a scuola. (...) Un’indagine intersezionale mixed-method_ (Female bullying at school, an intersectional, mixed-method study) – conducted in medium-sized and large cities in northern, central and southern Italy – it proposes a theoretical-analytical framework in which to consider the phenomenon of female bullying in Italian schools. (shrink)

This study’s objective was to understand Colombian adolescents’ experiences and preferences regarding access to sexual and reproductive health services (SRHS), either alone or accompanied. A mixed-method approach was used, involving a survey of 812 participants aged eleven to twenty-four years old and forty-five semi-structured interviews with participants aged fourteen to twenty-three. Previous research shows that adolescents prefer privacy when accessing SRHS and often do not want their parents involved. Such findings align with the longstanding tendency to frame the ethical (...) principle of autonomy as based on independence in decision-making. However, the present study shows that such a conceptualization and application of autonomy does not adequately explain Colombian adolescent participants’ preferences regarding access to SRHS. Participants shared a variety of preferences to access SRHS, with the majority of participants attaching great importance to having their parents involved, to varying degrees. What emerges is a more complex and non-homogenous conceptualization of autonomy that is not inherently grounded in independence from parental involvement in access to care. We thus argue that when developing policies involving adolescents, policymakers and health professionals should adopt a nuanced “relational autonomy” approach to better respect the myriad of preferences that Colombian (and other) adolescents may have regarding their access to SRHS. (shrink)

Feedback plays a crucial role in the writing processes. However, in the literature on foreign language writing, there is a dearth of studies that compare the effects of teacher feedback and automated feedback on both cognitive and psychological aspects of FL writing. To fill this gap, the current study compared the effects of teacher feedback and automated feedback on both revision quality and writing proficiency development, and perceived usefulness and perceived ease of use of the feedback in English writing among (...) English learners as an FL in China. It also investigated students’ perceptions of the strengths and weaknesses of the two types of feedback. The study adopted a mixed-methods design. The quantitative method collected the data through a pre-test and a post-test, which measured the participants’ English writing proficiency development; a writing task, which received either teacher feedback or automated feedback; and a close-ended questionnaire, which examined students’ perceived usefulness and perceived ease of use of the feedback. The qualitative method collected the data through an open-ended questionnaire, which examined the participants’ perceptions of the strengths and weaknesses of teacher feedback or automated feedback depending on the type of feedback they received. Chinese university EFLs in two English classes taught by the same English teacher participated in the study: one class received teacher feedback while the other received automated feedback using Pigaiwang. While the students in the two classes did not differ significantly on the pre-test of students’ writing proficiency, students who received teacher feedback scored significantly higher on revision than those who received automated feedback. Students in the teacher feedback class also had significantly higher ratings on perceived usefulness and perceived ease of use of the feedback than those in the automated feedback class. However, students in the automated feedback class obtained significantly higher scores on the post-test of the writing proficiency. The qualitative results identified three themes of strengths and two themes of weaknesses for the teacher feedback and the automated feedback, respectively. The results suggest that while teacher feedback has a more positive effect on the psychological aspect of FL writing, automated feedback may be more effective in developing FL writing proficiency in the long run. (shrink)

Community psychologists address social inequalities and problems by employing ecological principles, multiple methodologies, and participatory approaches to empower individuals, organizations, and communities to organize action and systems change. This article aims to contribute to mixed methods literature by presenting three models of mixed methods participatory research across a variety of geographic and sociocultural contexts. The models outline participatory processes and points of qualitative and quantitative data integration. Challenges related to the interplay between participatory approaches and (...) class='Hi'>mixed methods studies as well as implications on social science research are discussed. (shrink)

The present study used quantitative and qualitative measures to examine Iranian applied linguists’ (mis-) conceptions of ethical issues in research. For this purpose, one hundred and twelve applied linguists completed a research ethics questionnaire constructed and validated by the researchers. In the follow-up qualitative phase, 15 applied linguists who were faculty members participated in semi-instructed interviews. Data were analyzed using exploratory factors analyses for the first phase and theme analyses for the second phase. Quantitative results showed that the most important (...) misconceptions among Iranian applied linguists lingered on working with data (data collection and data analyses). For example, removing an outlier was a prevalent act conducted by applied linguists in the present study. Teachers using their students as participants of their own research as well as how they treated those students after a study were other controversial issues. The qualitative results revealed several themes including _lack of knowledge, conflict with real-world practices, a product-oriented approach to education and a publish or perish mentality_ as the reasons for misconceptions of ethics in applied linguistics among Iranian researchers. On general terms, there was an implicit agreement regarding the lack of training on research ethics among Iranian applied linguists. (shrink)

Due to the complexity of research objects, theoretical concepts, and stimuli in media research, researchers in psychology and communications presumably need sophisticated measures beyond self-report scales to answer research questions on media use processes. The present study evaluates stimulus-dependent structure in spontaneous eye-blink behavior as an objective, corroborative measure for the media use phenomenon of spatial presence. To this end, a mixed methods approach is used in an experimental setting to collect, combine, analyze, and interpret data from standardized (...) participant self-report, observation of participant behavior, and content analysis of the media stimulus. T-pattern detection is used to analyze stimulus-dependent blinking behavior, and this structural data is then contrasted with self-report data. The combined results show that behavioral indicators yield the predicted results, while self-report data shows unpredicted results that are not predicted by the underlying theory. The use of a mixed methods approach offered insights that support further theory development and theory testing beyond a traditional, mono-method experimental approach. (shrink)

Recent research shows that research programmes (quantitative, qualitative and mixed) in education are not displaced (as suggested by Kuhn) but rather lead to integration. The objective of this study is to present a rationale for mixed methods (integrative) research programs based on contemporary philosophy of science (Lakatos, Giere, Cartwright, Holton, Laudan). This historical reconstruction of episodes from physical science (spanning a period of almost 300 years, 17 th to 20 th century) does not agree with the positivist (...) image of science. Quantitative data (empirical evidence) by itself, does not facilitate progress (despite widespread belief to the contrary), neither in the physical sciences nor in the social sciences (education) A historical reconstruction shows that both Piaget and Pascual-Leone's research programs in cognitive psychology, follow the Galilean idealisation quite closely, similar to the research programs of Newton, Mendeleev, Einstein, Thomson, Rutherford, Millikan and Perl in the physical sciences. This relationship does not imply that researchers in education have to emulate research in the physical sciences. A major argument in favor of mixed methods (integrative) research programs is that it provides a rationale for hypotheses, theories, guiding assumptions and presuppositions to compete and provide alternatives. Similar to the physical sciences, this proliferation of hypotheses leads to controversies and rivalries, and thus facilitates the decision making process of the scientific community. It is concluded that mixed methods research programs (not paradigms) in education can facilitate the construction of robust strategies, provided we let the problem situation (as studied by practicing researchers) decide the methodology. (shrink)

Recent research shows that research programmes (quantitative, qualitative and mixed) in education are not displaced (as suggested by Kuhn) but rather lead to integration. The objective of this study is to present a rationale for mixed methods (integrative) research programs based on contemporary philosophy of science (Lakatos, Giere, Cartwright, Holton, Laudan). This historical reconstruction of episodes from physical science (spanning a period of almost 300 years, 17th to 20th century) does not agree with the positivist image of (...) science. Quantitative data (empirical evidence) by itself, does not facilitate progress (despite widespread belief to the contrary), neither in the physical sciences nor in the social sciences (education) A historical reconstruction shows that both Piaget and Pascual-Leone’s research programs in cognitive psychology, follow the Galilean idealisation quite closely, similar to the research programs of Newton, Mendeleev, Einstein, Thomson, Rutherford, Millikan and Perl in the physical sciences. This relationship does not imply that researchers in education have to emulate research in the physical sciences. A major argument in favor of mixed methods (integrative) research programs is that it provides a rationale for hypotheses, theories, guiding assumptions and presuppositions to compete and provide alternatives. Similar to the physical sciences, this proliferation of hypotheses leads to controversies and rivalries, and thus facilitates the decision making process of the scientific community. It is concluded that mixed methods research programs (not paradigms) in education can facilitate the construction of robust strategies, provided we let the problem situation (as studied by practicing researchers) decide the methodology. (shrink)

Recent research shows that research programmes (quantitative, qualitative and mixed) in education are not displaced (as suggested by Kuhn) but rather lead to integration. The objective of this study is to present a rationale for mixed methods (integrative) research programs based on contemporary philosophy of science (Lakatos, Giere, Cartwright, Holton, Laudan). This historical reconstruction of episodes from physical science (spanning a period of almost 300 years, 17th to 20th century) does not agree with the positivist image of (...) science. Quantitative data (empirical evidence) by itself, does not facilitate progress (despite widespread belief to the contrary), neither in the physical sciences nor in the social sciences (education) A historical reconstruction shows that both Piaget and Pascual-Leone’s research programs in cognitive psychology, follow the Galilean idealisation quite closely, similar to the research programs of Newton, Mendeleev, Einstein, Thomson, Rutherford, Millikan and Perl in the physical sciences. This relationship does not imply that researchers in education have to emulate research in the physical sciences. A major argument in favor of mixed methods (integrative) research programs is that it provides a rationale for hypotheses, theories, guiding assumptions and presuppositions to compete and provide alternatives. Similar to the physical sciences, this proliferation of hypotheses leads to controversies and rivalries, and thus facilitates the decision making process of the scientific community. It is concluded that mixed methods research programs (not paradigms) in education can facilitate the construction of robust strategies, provided we let the problem situation (as studied by practicing researchers) decide the methodology. (shrink)

BackgroundThere is increasing evidence that research misbehaviour is common, especially the minor forms. Previous studies on research misbehaviour primarily focused on biomedical and social sciences, and evidence from natural sciences and humanities is scarce. We investigated what academic researchers in Amsterdam perceived to be detrimental research misbehaviours in their respective disciplinary fields.MethodsWe used an explanatory sequential mixed methods design. First, survey participants from four disciplinary fields rated perceived frequency and impact of research misbehaviours from a list of 60. (...) We then combined these into a top five ranking of most detrimental research misbehaviours at the aggregate level, stratified by disciplinary field. Second, in focus group interviews, participants from each academic rank and disciplinary field were asked to reflect on the most relevant research misbehaviours for their disciplinary field. We used participative ranking methodology inducing participants to obtain consensus on which research misbehaviours are most detrimental.ResultsIn total, 1080 researchers completed the survey (response rate: 15%) and 61 participated in the focus groups (3 three to 8 eight researchers per group). Insufficient supervision consistently ranked highest in the survey regardless of disciplinary field and the focus groups confirmed this. Important themes in the focus groups were insufficient supervision, sloppy science, and sloppy peer review. Biomedical researchers and social science researchers were primarily concerned with sloppy science and insufficient supervision. Natural sciences and humanities researchers discussed sloppy reviewing and theft of ideas by reviewers, a form of plagiarism. Focus group participants further provided examples of particular research misbehaviours they were confronted with and how these impacted their work as a researcher.ConclusionWe found insufficient supervision and various forms of sloppy science to score highly on aggregate detrimental impact throughout all disciplinary fields. Researchers from the natural sciences and humanities also perceived nepotism to be of major impact on the aggregate level. The natural sciences regarded fabrication of data of major impact as well. The focus group interviews helped to understand how researchers interpreted ‘insufficient supervision’. Besides, the focus group participants added insight into sloppy science in practice. Researchers from the natural sciences and humanities added new research misbehaviours concerning their disciplinary fields to the list, such as the stealing of ideas before publication. This improves our understanding of research misbehaviour beyond the social and biomedical fields. (shrink)

Research in an emergent field requires the researcher to consider appropriate methodologies. This paper describes research that attempts to discover how new technologies can influence local democratic engagement. It describes an interpretive research project informed by critical social theory that uses an explanatory mixed methods approach, combining two sequential data collection methods. The study incorporates a survey instrument and qualitative interviewing, analysed using Grounded Theory Methodology. The paper will describe the context for the research, the choice of (...) a mixed methods approach and relate this to an epistemology and ontology. The paper does not discuss the research findings but focuses on the research process and methodology and provides reflection on the outcomes and the challenges of the chosen approach. It demonstrates that mixed methods research is appropriate in a narrow and emergent field of study and that it offers methodological flexibility whilst promoting rigour and grounded results. (shrink)

The beginning of the COVID-19 pandemic brought about a sudden and significant change in the conditions of various academic activities. In the present study, we wanted to investigate the influence of the first pandemic lockdown on procrastination tendencies among Polish students. To achieve this goal we employed a mixed-method, embedded longitudinal study. In the quantitative part of the research, the same group of university students completed the procrastination questionnaire twice: a year before, and two months after the introduction of (...) the first pandemic lockdown. The qualitative part included the open-ended questions about the perceived reasons for an observed change in a tendency to postpone tasks after the pandemic outbreak. Our analyses showed a significant increase in academic procrastination after the lockdown introduction. In particular, students reported a decrease in the study interest and lower working discipline. As the causes of higher procrastination during the lockdown period, students most frequently pointed out the reduced monitoring of work progress by supervisors and lower negative consequences of delaying tasks. The second most frequent theme in provided answers included difficulty in restraining from alternative activities and problems with focusing on tasks or ignoring distractions. Embedding qualitative and quantitative data gave a consistent picture of students' situation in the first lockdown and provided potential explanation for the exacerbation of procrastinatory behaviors after the pandemic outbreak. (shrink)

This study aims to explore the factors contributing to the perceived preparedness of graduate students for responsible conduct of research (RCR). A convergent mixed design was used, and both interview and quantitative data were collected, analyzed, and integrated to understand the role of individual and institutional factors in the perceived RCR preparedness of graduate students. Both interview and quantitative data converge on the role of mentor instruction and institutional policies in developing RCR preparedness. The findings also suggested that greater (...) exposure of students to ethical norms and practices is critical in nurturing RCR. (shrink)

Mixing methods is a well-known innovative meth- odologic proposal for research in the second half of the 20th century social sciences. Reading literature about it, I observed the aspect that justifies this paper: Authors of theoretical contributions on mixing methods recognized that this was known to be a practice already in use many centuries ago. Some of them even have re-examined the whole history of the scientific method to search precedents. They are however individual and theoretical precedents. I (...) add in this paper the practical projection of these and other methodological theories on people’s training from Greek classical times. My hypothesis is that liberal arts was the basic syllabus in Western -and westernized- educaion for more than a millennium in such a way that results of their training precisely involved to mixing methods. In return, to understand the liberal arts in the light of mixing methods shows new aspects of their historical interest. I study the theoretical basis of this syllabus from Cicero to Alcuin. More important for future research, I conclude that Alcuin’s thesis about the correspondence between the gifts of the Holy Spiritu and the seven liberal arts can be extended to the Aristotelian dianoethics habits and to Dilthey’s 20th-century sciences of mind. (shrink)

BackgroundFamily consent is a prerequisite for the organ donation of the deceased in China. However, a large number of donors are individuals who died due to accidental injuries or unanticipated diseases, which means that most of the families of such donors have just experienced the sudden death of their loved one and have to make a donation decision in a short time. This decision may cause psychological stress and some psychological damage to the minds of relatives of the donors. In (...) addition, cultural sensitivity also has largely caused the relatives of donors inner conflicts and contradictions. And sometimes organ donation may still be stigmatized. However, have they received any emotional support and what is their emotional support needs are some questions that need to be answered. Therefore, this study aims to investigate the emotional support, influencing factors, and needs of the family members of organ donors in Hunan Province, China.Materials and methodsThis is mixed-methods research that combines quantitative and qualitative research methods. A cross-sectional survey was conducted among 102 donor families using a questionnaire to investigate their emotional support status. To further understand their emotional support needs, 12 donor families participated in the semi-structured interview.ResultsThe results confirmed that: A total of 67.7% of the 102 respondents received emotional support or psychological comfort. Thus, only a small number of respondents felt respected by the public. Emotional support came mainly from immediate family members, and official organizations such as the Red Cross. Marital status, health status, occupation, and coping style can affect the emotional support of the donor families. Interview showed that the families of donors need emotional support and psychological aid from psychological professionals mostly. And they also wish to receive the understanding and respect of the public.ConclusionMost families of organ donors received emotional support from family, Red Cross, and friends, but only a minority of families of donors reported receiving respect from the public after the donation. And families of donor showed a strong need for emotional support and professional psychological aid from institutions. (shrink)

The author asks whether there was a “scientific ‘68”, and focuses on aspects of two specific methodological proposals defined in the 1940s and 50s by the terms “action research” and “mixing methods”, applied particularly to social sciences. In the first, the climate surrounding the events of 1968 contributed to heightening the participative element to be found –by definition– in “action research”; that is: the importance of making the research subjects themselves participants in the design, execution and application of the (...) study of which they are the focus. This approach captured the democratic and anti-authoritarian spirit at the heart of the proposal, which was part of the prevailing climate in those days. The repercussions of 1968 on “mixing methods” focused on studying what had actually occurred, especially between the youth and workers, and therefore, particularly from the point of view of sociology and social psychology, using a “mixed methods” approach. The author explores the proposal of Norman Denzin; but traces the recent origins of both “mixing methods” and “action research” back to the proposals of mainly Kurt Lewin and the Chicago School. (shrink)

This research was carried out within the framework of the question of the level of technical competencies of 4-6 age Quran course teachers and the factors that affect this competence positively or negatively. The main reason for creating such an issue as a problem and working is to draw attention to the importance of using technology in education and training processes that emerged with the pandemic process. In the study, an explanatory sequential design which is one of the mixed (...) methods research models was adopted. The relational screening model, one of the quantitative research methods, was used as the primary data set of the study. In this context, the "Technological Pedagogical Content Knowledge (TPCK)" developed by Horzum et al. (2014) was used as a data collection tool and applied to 528 participants. The case study design, one of the qualitative research methods, was used as the secondary data set of the study. In this context, focus group interviews were held with a total of 20 participants in the form of two sessions and 10 participants in each session. The focus of the interviews was on the fact that the participants' general statements about their experiences with technology usage in 4-6 age group Quran course distance education process and their evaluations of the advantages and disadvantages of the process. In the light of the quantitative findings obtained in the study, it is noteworthy that the general average of the TPCK scale of the teachers is good. However, it is seen that the scores of the teachers from the sub-dimensions related to technology are below the general average. Within the framework of qualitative findings, it was determined that technology literacy awareness increased with the distance education process. Teachers state that they need in-service training seminars to maintain awareness of this technology that emerges in them. (shrink)

Sensor-based data are becoming increasingly widespread in social, behavioral and organizational sciences. Far from providing a neutral window on 'reality', sensor-based big-data are highly complex, constructed data sources. Nevertheless, a more systematic approach to the validation of sensors as a method of data collection is lacking, as their use and conceptualization have been spread out across different strands of social-, behavioral- and computer science literature. Further debunking the myth of raw data, the present article argues that, in order to validate (...) sensor-based data, researchers need to take into account the mutual interdependence between types of sensors available on the market, the conceptual (construct) choices made in the research process, and the contextual cues. Sensor-based data in research are usually combined with additional quantitative and qualitative data sources. However, the incompatibility between the highly granular nature of sensor data and the static, a-temporal character of traditional quantitative and qualitative data has not been sufficiently emphasized as a key limiting factor of sensor-based research. It is likely that the failure to consider the basic quality criteria of social science measurement indicators more explicitly may lead to the production of insignificant results, despite the availability of high volume and high-resolution data. The paper concludes with recommendations for designing and conducting mixed methods studies using sensors. (shrink)

Recent decades have seen a proliferation of research methods, both quantitative and qualitative, available to psychologists. Whereas some scholars have claimed that qualitative and quantitative methods are inherently opposed, recently many more researchers have argued in favor of “mixed methods” approaches. In this article the author presents a review of the literature on the issue of how to meaningfully relate qualitative and quantitative approaches, with a particular emphasis on recent calls for mixed methods. The (...) relative success of mixed-methods approaches is examined, and some of the common pitfalls of these approaches are outlined. 2012 APA, all rights reserved). (shrink)

Physical education is often selected for applying multilingual initiatives through the use of the content and language integrated learning (CLIL) approach. However, it is still unclear whether the introduction of such approach might entail losing Physical Education’s essence and distorting its basic purposes. The aim of this study is to analyse the impact of CLIL on the Physical Education lessons. Given the purpose of this study, a mixed methodological approach based on a sequential exploratory design divided in two different (...) phases is used. We begin with an initial qualitative data collection (phase I) consisting in the analysis of interviews with 12 participants (8 teachers and 4 students). Based on its analysis, two foci are identified: social relationships and physical activity. Then, informed by the results obtained, a quantitative approach is used (phase II), differentiating these two sets of data to deepen on them. On one part, a sociometric questionnaire was applied to analyse the social relationships among CLIL students. On the other part, a quasi-experimental design (n = 49) was implemented using accelerometry to measure the MVPA of the PE sessions. Regarding physical activity, the results show that levels of MVPA are higher in the experimental group (CLIL) than in the control group showing light to the divergent viewpoints of interviewees. However, focusing on social relationships, the sociometric questionnaire results show that there were no statistical significative changes, although some signs of a slight effect on students’ relationships arise depending on their gender. Therefore, more research would be necessary to deepen on how CLIL affects in this regard. (shrink)

Despite a long history of researchers who combine phenomenology with qualitative or quantitative methods, there are only few examples of working with a phenomenological mixed method—a method where phenomenology informs both qualitative and quantitative data generation, analysis, and interpretation. Researchers have argued that in working with a phenomenological mixed method, there should be mutual constraint and enlightenment between the qualitative and quantitative methods for studying consciousness. In this article, we discuss what a framework for phenomenological (...) class='Hi'>mixed methods could look like and we aim to provide guidance of how to work within such framework. We are inspired by resources coming from research in mixed methods and existing examples of phenomenological mixed-method research. We also present three cases of phenomenological mixed methods where we study complex social phenomena and discuss the process of how we conducted the studies. From both the research inspiration and our own studies, we depict the landscape of possibilities available for those interested in mixing phenomenology with qualitative and quantitative methods, as well as the challenges and common pitfalls that researchers face. To navigate in this landscape, we develop a three-fold structure, focusing on the phenomenological frame, the phenomenologically informed generation of qualitative and quantitative data, and the phenomenologically informed analysis and interpretation of data. (shrink)

This article argues that the emerging field of Mixed Methods faces a series of challenges which must be addressed before the area can fulfill its potential. Foremost among these is the lack of attention given to ontological concerns. Specifically, Mixed Methods must examine what ontological commitments are made as the result of employing the range of typologies now discovered. It is argued that Mixed Methods presently lacks a clear conception of how its paradigm is (...) significantly different from non-mixed methodological approaches. It is suggested that Mixed Methods adopt a “weak” minimal realist ontological stance that is rooted in a position called “measured realism.” It is also argued that such a position is required since the present reliance on pragmatism does not sufficiently address ontological concerns. Suggestions are made, by way of an empirical research example, as to plausible ways to handle the issue of ontological commitment. (shrink)

This article explains the foundation of knowledge acquisition through discourses involving research methodology and research methods; differences between the two concepts is exemplified, with the former (research methodology) addressing philosophical underpinnings around the process of research, and through which human epistemic quest for knowledge is addressed, while the latter (research methods) addresses problems involving the application of qualitative or quantitative techniques (in some cases mixed-methods) in answering the researchers' underpinning research questions / hypothetical postulations. Challenges surrounding (...) research ethics is relevantly addressed with a view of explaining issues needed in ensuring research processes are successfully accomplished through ‘detailed eye for issues’, for example, the application of skills needed to access research participants without inflicting harm unethically. (shrink)

Purpose This paper aims to discuss research ethics in mixed-methods research and MMR development with a focus on ethical challenges that stem from working with technical instruments such as mobile eye-trackers. Design/methodology/approach The case of an interdisciplinary mixed-methods development study that aimed at researching the impacts of emerging mobile augmented-reality technologies on the perception of public places serves as an example to discuss research-ethical challenges regarding the practical implementation of the study, data processing and management and (...) societal implications of developing instruments to track and understand human practices. Findings This study reports challenges and experiences in ethical decision-making in the practical implementation of the study regarding the relationship to research subjects, the use of mobile research instruments in public places and the interdisciplinary cooperation among research team members. Further, this paper expounds on ethical challenges and recommendations in data processing and management and with a view to societal implications of method development and the aspirations of transdisciplinarity. This study concludes that institutionalized ethics need to become more flexible, while applied ethics and reflection must make their entry into university curricula across disciplines. Originality/value Complex interdisciplinary mobile and mixed-methods projects that involve sensors and instruments such as mobile eye-trackers are on the rise. However, there is a significant lack of engagement with practical research ethical challenges, practices and requirements in both mixed-methods and method-development literature. By taking a context- and process-oriented perspective focusing on doing ethics, the paper contributes a concrete empirical case to these underdeveloped fields. (shrink)

Personal data protection is an ethical issue. In this study we analyzed how research ethics committees (RECs) and data protection officers (DPOs) handle personal data protection issues in research protocols. We conducted a mixed-methods study. We included heads (or delegated representatives) of RECs and DPOs from universities and public research institutes in Croatia. The participants provided information about data protection issues in research and their mutual collaboration on those issues through structured interviews that contained closed and open-ended questions. (...) Qualitative description was used to analyze open-ended questions. The results showed that 55% of the REC representatives were not aware who was DPO in their institution. Among RECs, 65% never contacted the DPO. There were 61% of RECs who reported that they received no training from the organization on personal data protection. When asked about barriers to personal data protection in their institutions, 26% of REC members highlighted the lack of a clear protocol for assessing personal data protection issues, while 30% of DPOs mentioned lack of knowledge among researchers about personal data. In conclusion, we found that when it came to protecting personal data in research protocols, RECs and DPOs hardly ever worked together. When developing future personal data protection policies for academic and scientific research institutions, it is essential that RECs and DPOs should collaborate and both continue to expand/update their knowledge on personal data protection procedures. (shrink)