This article analyzes the use of crowdsourcing to promote corporate sustainability by assessing compliance with supply chain disclosure laws. It draws on a case study of WikiRate.org as a novel example of crowdsourcing compliance with respect to the UK Modern Slavery Act and U.S. conflict minerals legislation (section 1502 of the Dodd-Frank Financial Reform Act). WikiRate is an open research platform whose mission is to crowdsource better companies by motivating corporations to be transparent about their environmental, social, and (...) governance performance. In particular, WikiRate’s projects on modern slavery and conflict minerals harness the power of citizens to evaluate the quality of corporate disclosures produced in accordance with these laws. Following an analysis of its projects on modern slavery and conflict minerals, I evaluate the challenges of using crowdsourcing to assess legal compliance, including the potential manipulation of data and the difficulty of relying on non-expert citizens to assess complex information in corporate disclosures. I argue that one must identify the appropriate “crowd” that would be most capable of assessing compliance with a given law. While crowdsourcing platforms such as WikiRate invite a broad range of stakeholders to assess compliance, the reality is that only a limited set of individuals may be able to meaningfully participate given the complexity of supply chain disclosures. Thus, “expertsourcing” may be a more appropriate tool for assessing compliance with certain laws as it limits participation to citizens with specialized expertise. (shrink)

Recent years have seen a surge in online collaboration between experts and amateurs on scientific research. In this article, we analyse the epistemological implications of these crowdsourced projects, with a focus on Zooniverse, the world’s largest citizen science web portal. We use quantitative methods to evaluate the platform’s success in producing large volumes of observation statements and high impact scientific discoveries relative to more conventional means of data processing. Through empirical evidence, Bayesian reasoning, and conceptual analysis, we show how information (...) and communication technologies enhance the reliability, scalability, and connectivity of crowdsourced e-research, giving online citizen science projects powerful epistemic advantages over more traditional modes of scientific investigation. These results highlight the essential role played by technologically mediated social interaction in contemporary knowledge production. We conclude by calling for an explicitly sociotechnical turn in the philosophy of science that combines insights from statistics and logic to analyse the latest developments in scientific research. (shrink)

Crowdsourced regulation has been discussed to date by legal and social science scholars mainly in the context of legislation and rulemaking, without paying sufficient attention to non-legislative regulatory functions. This article provides a richer theory of crowdsourced regulation which extends to all regulatory functions, focusing on monitoring and enforcement. Regulatory agencies worldwide harness the power of the public using digital platforms to carry out monitoring and enforcement tasks in regulated markets and sectors. For example, agencies operate online complaint databases that (...) invite the public to report mistreatment of consumers and environmental nuisances by regulated firms. Agencies also publish information concerning corporate misbehavior to publicly shame companies into compliance. Crowdsourcing regulatory monitoring and enforcement can help minimize some prominent ailments of the regulatory task, such as poor resources, diminishing deterrence, declining legitimacy, and capture. It can also promote goals and values such as public participation, increased transparency, public trust in regulators, administrative efficiency, and effectiveness in achieving regulatory objectives. However, crowdsourcing regulatory monitoring and enforcement is subject to a new set of legal, administrative, and democratic failures that need to be acknowledged and addressed. The article develops a theory of crowdsourced regulation that supplies justifications and rationales for crowdsourced regulatory monitoring and enforcement, points out its main pitfalls, and normatively evaluates law and policy implications. (shrink)

Results from a crowdsourced audio questionnaire show that inflected infinitives in Galician are still acceptable in a broad range of contexts, different from those described for European Portuguese. Crucially, inflected infinitives with referential subjects are widely accepted only inside strong islands in Galician (complements of nouns, adjunct clauses). They are widely rejected in non-islands, notably in the complements of epistemic/factive verbs, in contrast with Portuguese and older varieties of Galician (Gondar 1978, Raposo 1987). Statistical analysis shows, however, that, in the (...) complements of epistemic/factive (and desiderative) verbs, inflected infinitives are significantly more acceptable in instances of control, whether partial or exhaustive. In fact, there is no significant difference between these two types of control in Galician, unlike in Portuguese, where inflection is generally better in instances of partial control and is not acceptable in instances of exhaustive local subject control (Modesto 2010, Sheehan 2018). We propose an analysis of this pattern in terms of phase theory. The inflectional domain of non-finite clauses remains visible to the thematic domain of the next clause up, according to the less strict version of the Phase Impenetrability Condition (Chomsky 2001), allowing control to take place. Pronouns/or pronominal inflections in the inflectional domain of visible non-finite clauses therefore get controlled. In islands, however, material in the inflectional domain remains free/referential. Despite this basic pattern, the data are characterized by substantial interspeaker variation. Statistical analysis shows that gender, urban/rural birthplace and mother tongue are all significant factors in this variation, while age and region of birth are not. Most notably, urban-born male bilinguals with Spanish as their mother tongue consistently rate the sentences higher on the Likert scale. Overall, the results show that crowdsourcing can lead to empirically robust syntactic descriptions of minority languages which are likely to be subject to substantial sociolinguistic variation and where judgements from a single social group may be misrepresentative of the general picture. The study also highlights, however, the challenges associated with using crowd-sourced audio-questionnaires of this kind in languages of this kind and the need for statistical analysis of results to control for substantial amounts of variation. (shrink)

This article focuses on the problems of application of artificial intelligence to represent legal knowledge. The volume of legal knowledge used in practice is unusually large, and therefore the ontological knowledge representation is proposed to be used for semantic analysis, presentation and use of common vocabulary, and knowledge integration of problem domain. At the same time some features of legal knowledge representation in Ukraine have been taken into account. The software package has been developed to work with the ontology. The (...) main features of the program complex, which has a Web-based interface and supports multi-user filling of the knowledge base, have been described. The crowdsourcing method is due to be used for filling the knowledge base of legal information. The success of this method is explained by the self-organization principle of information. However, as a result of such collective work a number of errors are identified, which are distributed throughout the structure of the ontology. The results of application of this program complex are discussed in the end of the article and the ways of improvement of the considered technique are planned. (shrink)

In 2015, a flourish of “alarums and excursions” by the scientific community propelled CRISPR/Cas9 and other new gene-editing techniques into public attention. At issue were two kinds of potential gene-editing experiments in humans: those making inheritable germ-line modifications and those designed to enhance human traits beyond what is necessary for health and healing. The scientific consensus seemed to be that while research to develop safe and effective human gene editing should continue, society's moral uncertainties about these two kinds of experiments (...) needed to be better resolved before clinical trials of either type should be attempted. In the United States, the National Academies of Science, Engineering and Medicine convened the Committee on Human Gene Editing: Scientific, Medical and Ethical Considerations to pursue that resolution. The committee's 2017 consensus report has been widely interpreted as “opening the door” to inheritable human genetic modification and holding a line against enhancement interventions. But on a close reading it does neither. There are two reasons for this eccentric conclusion, both of which depend upon the strength of the committee's commitment to engaging diverse public voices in the gene-editing policy-making process. (shrink)

Records of online collaborative mathematical activity provide us with a novel, rich, searchable, accessible and sizeable source of data for empirical investigations into mathematical practice. In this paper we discuss how the resources of crowdsourced mathematics can be used to help formulate and answer questions about mathematical practice, and what their limitations might be. We describe quantitative approaches to studying crowdsourced mathematics, reviewing work from cognitive history (comparing individual and collaborative proofs); social psychology (on the prospects for a measure of (...) collective intelligence); human–computer interaction (on the factors that led to the success of one such project); network analysis (on the differences between collaborations on open research problems and known-but-hard problems); and argumentation theory (on modelling the argument structures of online collaborations). We also give an overview of qualitative approaches, reviewing work from empirical philosophy (on explanation in crowdsourced mathematics); sociology of scientific knowledge (on conventions and conversations in online mathematics); and ethnography (on contrasting conceptions of collaboration). We suggest how these diverse methods can be applied to crowdsourced mathematics and when each might be appropriate. (shrink)

Crowdsourcing platforms are powerful tools for academic researchers. Proponents claim that crowdsourcing helps researchers quickly and affordably recruit enough human subjects with diverse backgrounds to generate significant statistical power, while critics raise concerns about unreliable data quality, labor exploitation, and unequal power dynamics between researchers and workers. We examine these concerns along three dimensions: methods, fairness, and politics. We find that researchers offer vastly different compensation rates for crowdsourced tasks, and address potential concerns about data validity by using (...) platform-specific tools and user verification methods. Additionally, workers depend upon crowdsourcing platforms for a significant portion of their income, are motivated more by fear of losing access to work than by specific compensation rates, and are frustrated by a lack of transparency and occasional unfair treatment from job requesters. Finally, we discuss critical computing scholars’ proposals to address crowdsourcing’s problems, challenges with implementing these resolutions, and potential avenues for future research. (shrink)

Voter surveillance for digital campaigning is perceived as enacted from above. Political parties are “all-seeing actors” combining access to the Voters’ Registry with digital tools to maximize voter turnout. At the same time, new forms of lateral surveillance emerge as citizens voluntarily participate in the data collection process to help political parties achieve their electoral goals. This article examines the reconfiguration of the concepts of crowdsourcing and political participation through the use of voter-surveillance applications. Theoretically, it explores how crowdsourced (...) voter surveillance (CVS) builds on the emancipatory rhetoric of political participation and crowdsourcing while relying on social, technical, and political surveillance infrastructures. Empirically, it maps the information flows and knowledge hierarchies afforded by Elector, a CVS app used by the Likud party in the Israeli election of March 2020. The findings indicate that contrary to the logic of crowdsourcing as democratizing knowledge and participation, CVS cultivates controlled individuals and normalizes lateral surveillance as a ritualistic and desired form of political participation. The article therefore describes the type of political action that CVS constructs as Little Samaritan Brothers: citizens who collectively resign their rights and the rights of their peers for the party’s success. (shrink)

Interactive media create a space conducive to development of participatory culture, in which media content recipients become its active creators. Participant activities are not limited to commenting on online articles or being active on social media. They want to influence reality through their actions and to participate in creating and spreading information. The willingness and readiness of Internet users to co-create content is becoming increasingly important also in scientific projects, where success depends on the involvement of many volunteers who undertake (...) specific tasks. Although such projects are often time-consuming, they usually do not require advanced skills from the people involved. The only payoff for their efforts is the satisfaction that comes from participating, as well as the recognition in their community. The purpose of this paper is to attempt to evaluate the phenomenon of crowdsourcing in humanities, especially in the context of the new reality created by the Covid-19 pandemic. It is based on the literature which addresses the importance of crowdsourcing in projects in a variety of areas, on top of an analysis of examples in which this method is used. The selection of presented examples is strongly intended to demonstrate the enormous possibilities and resulting benefits of involving willing volunteers in humanities projects. Their role is not diminished by the fact that they do not have competencies related to project topics. It can be assumed that crowsrourcing will be more and more widely used by researchers, especially in times when increasing numbers of people undertake online activities. (shrink)

Governments regularly rely on citizens’ cooperation in exercising their authority, including the enforcement of rules. This is not only common, but also a necessary practice in a legal system. Technology makes such reliance easier, facilitating increased enforcement of law at little cost. Emergency provides an added legitimizing logic, encouraging citizens’ cooperation and leading them to uncritically follow the government’s lead to reduce the risk to the nation and to themselves. This article considers governments’ crowdsourcing citizens to monitor and surveil (...) other citizens. One central concern this practice raises is that it allows governments to circumvent the limits of their legitimate authority and to augment their power while also obscuring the actor responsible for the surveillance and enforcement action. Consequently, accountability and public oversight over the government are diminished. Where does conventional enlisting of cooperation from law-abiding citizens end, and crowdsourcing totalitarian mass mobilization of citizens against fellow citizens begin? The article’s principal claim is that a bright line should be drawn where governments’ crowdsourcing of information from citizens serves as a means to circumvent democratic checks on their power to collect information, while also disguising the actor responsible for the surveillance. Such practice severely erodes social trust between citizens, jeopardizing their ability to organize and collaborate as engaged citizens and thus serve as a check on government. It further grants excessive power to some citizens over others, endangering the latter’s freedom, especially where the information gathered is used to symbolically or actually exclude certain individuals from the political community. (shrink)

An earlier version of this paper was presented at the 2011 IEEE International Symposium on Technology and Society at Saint Xavier University in Chicago, Illinois. This paper describes a proposed mobile platform, Transafe, that captures and analyses public perceptions of safety to deliver 'crowdsourced' collective intelligence about places in the City of Melbourne, Australia, and their affective states at various times of the day. Public perceptions of crime on public transport in Melbourne are often mismatched with actual crime statistics and (...) such perceptions thus can act as social barriers to visitors and locals traversing within and through the city. Using interactive mobile applications and social media, the visualization of this crowdsourced safety perception information will increase the commuter's awareness of various situations in the City of Melbourne. In addition, through social behavioral analysis and ethnographic research, the collective public intelligence will also help inform the stakeholders of the city for future policy-making and policing strategies for safety perception management. At the centre of the proposed platform is the design and development of a mobile phone application that can contribute to people feeling safer by supporting users to report crimes and misdemeanors that they witness, and provide information about transportation and emergency services around where the users are located. The proposed application can also act as a crime deterrent with one feature that enables user tracking by up to three nominated friends if the user opts to activate tracking when feeling unsafe while roaming the city. (shrink)

Crowdsourcing has attracted increasing attention as a means to enlist online participants in organisational activities. In this paper, we examine crowdsourcing from the perspective of its ethical use in the support of open innovation taking a broader system view of its use. Crowdsourcing has the potential to improve access to knowledge, skills, and creativity in a cost-effective manner but raises a number of ethical dilemmas. The paper discusses the ethical issues related to knowledge exchange, economics, and relational (...) aspects of crowdsourcing. A guiding framework drawn from the ethics literature is proposed to guide the ethical use of crowdsourcing. A major problem is that crowdsourcing is viewed in a piecemeal fashion and separate from other organisational processes. The trend for organisations to be more digitally collaborative is explored in relation to the need for greater awareness of crowdsourcing implications. (shrink)

Informed by critiques of conformity and mass media by some of the greatest philosophers of the past two centuries, as well as by a wide range of historical and empirical studies, Weissman helps shed light on what may happen when our lives are increasingly broadcast online for everyone all the time, to be judged by the global community.

Informed by critiques of conformity and mass media by some of the greatest philosophers of the past two centuries, as well as by a wide range of historical and empirical studies, Weissman helps shed light on what may happen when our lives are increasingly broadcast online for everyone all the time, to be judged by the global community.

The recent success of Foldit in determining the structure of the Mason-Pfizer monkey virus (M-PMV) retroviral protease is suggestive of the power-solving potential of internet-facilitated game-like crowdsourcing. This research model is highly novel, however, and thus, deserves careful consideration of potential ethical issues. In this paper, we will demonstrate that the crowdsourcing model of research has the potential to cause harm to participants, manipulates the participant into continued participation, and uses participants as experimental subjects. We conclude that protocols (...) relying on this model require institutional review board (IRB) scrutiny. (shrink)

The aim of this paper is to critically explore whether crowdsourced Big Data enables an inclusive humanitarian response at times of crisis. We argue that all data, including Big Data, are socially constructed artefacts that reflect the contexts and processes of their creation. To support our argument, we qualitatively analysed the process of ‘Big Data making’ that occurred by way of crowdsourcing through open data platforms, in the context of two specific humanitarian crises, namely the 2010 earthquake in Haiti (...) and the 2015 earthquake in Nepal. We show that the process of creating Big Data from local and global sources of knowledge entails the transformation of information as it moves from one distinct group of contributors to the next. The implication of this transformation is that locally based, affected people and often the original ‘crowd’ are excluded from the information flow, and from the interpretation process of crowdsourced crisis knowledge, as used by formal responding organizations, and are marginalized in their ability to benefit from Big Data in support of their own means. Our paper contributes a critical perspective to the debate on participatory Big Data, by explaining the process of in and exclusion during data making, towards more responsive humanitarian relief. (shrink)

Purpose Over the past decade, many research works in various disciplines have benefited from the endless ocean of people and their potentials as an effective problem-solving strategy and computational model. But nothing interesting is ever completely one-sided. Therefore, when it comes to leveraging people's power, as the dark side of crowdsourcing, there are some possible threats that have not been considered as should be, such as recruiting black hat crowdworkers for organizing targeted adversarial intentions. The purpose of this paper (...) is to draw more attention to this critical issue through investigation of its different aspects. Design/methodology/approach To delve into details of such malicious intentions, the related literature and previous researches have been studied. Then, four major typologies for adversarial crowdsourced attacks as well as some real-world scenarios are discussed and delineated. Finally, possible future threats are introduced. Findings Despite many works on adversarial crowdsourcing, there are only a few specific research studies devoted to considering the issue in the context of cyber security. In this regard, the proposed typologies for such human-mediated attacks can shed light on the way of identifying and confronting such threats. Originality/value To the best of the authors' knowledge, this the first work in which the titular topic is investigated in detail. Due to popularity and efficiency of leveraging crowds' intelligence and efforts in a wide range of application domains, it is most likely that adversarial human-driven intentions gain more attention. In this regard, it is anticipated that the present research study can serve as a roadmap for proposing defensive mechanisms to cope with such diverse threats. (shrink)

The post-war Western world has seen a gradual shift from government to governance, a process that also concerned the issues related to agro-food sustainability, such as food quality, environmental impact, social justice, and farm animal welfare. Scholars believe that social media are a new site that reconfigures relations between various actors involved in the governance of these problems. However, empirical research on this matter remains scarce. This paper fills this gap by examining the case of Februdairy, a Twitter hashtag campaign (...) to promote the British dairy industry, hijacked by animal protection activists. For this case, I employ the relational perspective on technology affordances—as operationalised by Faraj and Azad, Materiality and organizing. Social interaction in a technological world, Oxford University Press, Oxford, 2012)—to highlight two distinct strategic modes of embracement of social media functionalities by the opposing groups: hashtag hijacking and crowdsourcing transparency. The analysis reveals also that a pre-existing social structure of the agro-food system conditions reconfiguration of social relations by technology in a way that actually strengthens the tendency to govern the issue of farm animal protection with market mechanisms. (shrink)

Crowdsourcing innovation community has become an important platform for enterprises to gather group wisdom. However, how the crowdsourcing innovation community plays a reference role in creative crowdsourcing participation is unclear. Based on the reference group theory, taking online impression management as the explanatory framework, this study explores the impact of crowdsourcing innovation community reference on the creative territory behavior, and the differences in the crowdsourcing innovation community reference effect among members of different community age groups. (...) A total 524 valid two-stage questionnaires were collected. The empirical analysis results show that under the influence of informational reference and utilitarian reference of the crowdsourcing innovation community, community members are significantly more likely to adopt acquired impression management than defensive impression management ; under the influence of value expressive reference of the crowdsourcing innovation community, the possibility of adopting DIM behavior is significantly greater than that of adopting AIM behavior; compared with DIM behavior, AIM behavior has a more inhibitory effect on creative territory behavior. Interestingly, there are different community reference effects among members of different community age groups. In particular, the positive contribution of the elder members is not as good as that of the newcomers. The above research conclusions not only confirm the influence of crowdsourcing community reference on crowd participation decision making but also provide theoretical and practical enlightenment for exploring the cooperation mechanism of crowdsourcing innovation. (shrink)

Crowdsourcing is an increasingly popular method for researchers in the social and behavioral sciences, including experimental philosophy, to recruit survey respondents. Crowdsourcing platforms, such as Amazon’s Mechanical Turk (MTurk), have been seen as a way to produce high quality survey data both quickly and cheaply. However, in the last few years, a number of authors have claimed that the low pay rates on MTurk are morally unacceptable. In this paper, I explore some of the methodological implications for online (...) experimental philosophy research if, in fact, typical pay practices on MTurk are morally impermissible. I argue that the most straightforward solution to this apparent moral problem—paying survey respondents more and relying only on “high reputation” respondents—will likely increase the number of subjects who have previous experience with survey materials and thus are “non-naïve” with respect to those materials. I then discuss some likely effects that this increase in experimental non-naivete will have on some aspects of the “negative” program in experimental philosophy, focusing in particular on recent debates about philosophical expertise. (shrink)

This paper reports on a study of crowd-sourcing ‘study aid’ web platforms. Students are sharing completed academic coursework through a growing network of ‘study aid’ web platforms like CourseHero.com. These websites facilitate the crowd-sourced exchange of coursework, and effectively support plagiarism. However, virtually no data exists concerning the scope or extent of coursework being shared through these platforms. This paper reports on two experiments to monitor the frequency of coursework from a sample university uploaded onto CourseHero.com. Ultimately, both experiments failed (...) to produce a clear or meaningful measurement of coursework upload frequency. The apparently widespread use of these crowd-sourcing ‘study aid’ websites and the failure of these experiments demonstrates the need for further investigation into how much coursework is being shared through such platforms, how frequently it is shared, and what kind of coursework is being shared. Addressing these issues is an important step into measuring the impact of these wellsprings of academically dishonest behavior. (shrink)

Citizen-gathered evidence (CGE) gathered by individuals organized in collectives have the potential to demonstrate environmental and social wrongdoings in court. We identify (collective) agency and resistance in how individuals and communities that have been exposed to socio-environmental stressors turn to gather CGE. We explore the modes through which people gather scientific data, produce CGE, alert authorities to environmental harm, and the methods by which data can be shared with communities, beginning with the case studies of civic environmental monitoring addressing coal (...) ash pollution in North Carolina. We analyze the case studies through a theoretical lens built on (1) the theory of civic monitoring “as resistance;” (2) the argument that CGE can embody “collective intelligence;” and (3) the concept of “crowd science” through a decentralized yet coordinated network. In the first part of the article, we introduce the case studies. Then, we illustrate our theoretical frame as applied to the analysis of the cases. We discuss the cases and in particular the CGE at issue through the prism of the frame. We demonstrate how CGE can be valuable not only for civil society and civic organizations, but also for competent authorities. In our conclusion, we identify critical junctures of our case studies, such as that of “knowledge crowdsourcing” to demand justice that triggers the government to take action and the existence of a “coordinated” yet decentralized crowd to capture the full extension of the problem. Lastly, we outline the limitations of our study, a future research agenda, and still open questions. (shrink)

The main characteristic of the modern environment is the negative change by its people – destruction and pollution. Man is part of the biosphere and the technogenic transformations of the biosphere inevitably affect him. Under the influence of technogenic civilization, all spheres of human activity undergo changes, and science above all. Ecology is especially keenly aware of the challenges of technogenic civilization. It focuses on anthropogenic factors, works with the human environment. At the same time, its problem field is expanding (...) due to interdisciplinary research and the allocation of knowledge of new environmental disciplines into an independent industry. The interdisciplinarity of modern ecology is most clearly visible on the example of such a direction as informational ecology. The presence of the digital environment in human life has grown so much that it requires the separation of the digital information environment into a separate subsystem. Information ecology studies the laws of the influence of information on the formation and functioning of man. In turn, interdisciplinarity, assuming the use of knowledge from various branches of science, brings us to the problems of the collective agent of cognition and distributed knowledge. In ecology, the problems of the collective agent of cognition are implemented through crowd-sourcing technology. Ecology is a science that requires massive collection of observation data (samples of water, air, soil pollution in various, sometimes hard-to-reach corners of the planet, observation of fluctuations in the number of species of animals and plants). The popularity of crowdsourcing projects in the field of ecology is explained by the fact that the challenges and threats of anthropogenic civilization have generated such a trend of our time as environmental orientation or environmentalism. Ecological crowdsourcing projects, inspired by the philosophy of environmentalism, can serve as an answer to the challenges of technogenic civilization. (shrink)

This article explores the meaning and context of crowdsourcing at the municipal scale. In order to legitimately govern, local governments seek feedback and engagement from actors and bodies beyond the state. At the same time, crowdsourcing efforts are increasingly being adopted by entities – public and private – to digitally transform local services and processes. But how do we know what the “the right to the city” (RTTC) means when it comes to meaningful and participatory decision-making? And how (...) do we know if participatory efforts called crowdsourcing—a practice articulated in a 2006 Wired article in the context of the tech sector—when policy ideas are sought at the municipal scale? Grounded in the ideals of Henri Lefebvre’s RTTC, the article brings together typologies of public participation to advance a conceptualization of ‘crowdsourcing’ specific to local governance. Applying this approach to a smart city initiative in Toronto, Canada, I argue that for crowdsourcing to be taken seriously as a means of inclusive and participatory decision-making that seeks to advance the RTTC, it must have connection to governance mechanisms that aim to integrate public perspectives into policy decisions. Where crowdsourcing is disconnected to decision-making processes, it is simply lip service, not meaningful participation. (shrink)

Research ethics committees and institutional review boards spend considerable time developing, scrutinising, and revising specific consent processes and materials for survey-based studies conducted on crowdsourcing and online recruitment platforms such as MTurk and Prolific. However, there is evidence to suggest that many users of ICT services do not read the information provided as part of the consent process and they habitually provide or refuse their consent without adequate reflection. In principle, these practices call into question the validity of their (...) consent. In this paper we argue that although the ‘no read problem’ and the routinisation of consent may apply to research participants’ consent practices for studies on crowdsourcing platforms, this is not a serious problem. Furthermore, given that the informational requirements for informed consent in these contexts are minimal, we argue that these participants are, nevertheless, sufficiently informed to give valid consent. We conclude that research ethics committees and institutional review boards should only agonise over the precise details of the informed consent process and materials in those rare cases where appreciable risks to research participants need to be managed. (shrink)

Online crowdsourcing platforms have rapidly become a popular source of data collection. Despite the various advantages these platforms offer, there are substantial concerns regarding not only data validity issues, but also the ethical, societal, and global ramifications arising from the prevalent use of online crowdsourcing platforms. This paper seeks to expand the dialogue by examining both the “internal” aspects of crowdsourcing research practices, such as data quality issues, reporting transparency, and fair compensation, and the “external” aspects, in (...) terms of how the widespread use of crowdsourcing data collection shapes the nature of scientific communities and our society in general. Online participants in research studies are informal workers who provide labor in exchange for remuneration. The paper thus highlights the need for researchers to consider the markedly different political, economic, and socio-cultural characteristics of the Global North and the Global South when undertaking crowdsourcing research involving an international sample; such consideration is crucial for both increasing research validity and mitigating societal inequities. We encourage researchers to scrutinize the value systems underlying this popular data collection research method and its associated ethical, societal, and global ramifications, as well as provide a set of recommendations regarding the use of crowdsourcing platforms. (shrink)

The use in psychology of crowdsourcing platforms as a method of data collection has been increasing in popularity because of its relative ease and versatility. Our goal is to adapt the Gratitude Questionnaire–20 Items to the English language by using data collected through a crowdsourcing platform. The G20 is a comprehensive instrument that takes in consideration the different basic processes of gratitude and assesses the construct’s cognitive, evaluative, emotional, and behavioral processes. We test the psychometric properties of the (...) English version of the G20 with a Prolific user sample. We assess the adequacy of the G20 for the crowdsourcing population in its English version. A description of the characteristics of the participants is conducted. Reliability analyses reveal an optimal internal consistency of the adapted scale. The results are discussed from a cross-cultural vision of gratitude. We conclude that the Gratitude Questionnaire–20 Items, adapted to English with an American sample, is a psychometrically strong instrument to measure gratitude using crowdsourcing platforms for data collection and, therefore, a reference and useful tool in future research. (shrink)

This article examines whether a crowdsourced research participant who quits a study before its completion should receive any monetary compensation. The study is focused on participants recruited from Amazon Mechanical Turk, the most widely used crowdsourcing platform, and examines the tensions between participants’ rights and research objectives when online labor markets are used to recruit research participants. The discussion is informed by the recent literature on online research with crowdsourced samples, evidence from human subjects’ practices at top US universities, (...) and an ethical analysis based on distributive justice and consequentialism. The results indicate that compensating crowdsourced research subjects who fail to complete their participation jeopardizes the benefits of many who dutifully participate and undermines the overall value of the research enterprise for advancing knowledge. By examining the issue of payment for crowdsourced participants who drop out, this article sheds light on modern ethical issues in online research and offers practical recommendations for researchers and ethics scholars. (shrink)

The COVID-19 pandemic is an unprecedented time in history. Surrounding this pandemic are many enormous uncertainties across the globe. Severe consequences have assessed for the incomes of almost 84% of employers and 68% of self-employed who are working and living in countries that are or have went through a phase of closing workplaces. Similarly, the global rate of unemployment is also expected to be increased in the coming years as 54% of employers worldwide are running their businesses in the hardest-hit (...) sectors. All of these clearly show the uneven impact of the Coronavirus crisis which will remarkably compound already present inequalities, difficulties, and vulnerabilities. The economic ramifications for 186 countries under the crunch of the COVID-19 pandemic is also considered tremendous for Pakistan. The core aim of this research was to test a new conceptual framework depicting the ramifications of restructuring processes carried out by management for their organizations amidst the COVID-19 pandemic on an Institute’s reputation as an employer brand. It also investigates the impact of perceived restructuring on a corporate brand promise made by the university or institute from the viewpoints of other key stakeholders and potential job seekers. The current study had proposed four hypotheses and according to the results of Structural Equation Modeling, the direct hypothesis based upon the relationship between restructuring and employer branding has been rejected. This study shows that restructuring and employer branding has a negative and insignificant effect on each other. The second direct hypothesis of the study that measures the effect of restructuring on corporate branding has been accepted. A corporate brand is a kind of a hub and it considers how an institute treats and deals with all of its stakeholders. It is different from employer brand as the perceptions of employees were the main focus. So, according to the results restructuring did not cause massive damage to the overall outlook of the institute. Furthermore, for the purpose of mediation analysis, the maximum likelihood method by bootstrapping was adopted to test the indirect hypotheses of the study. Crowdsourcing was introduced as a mediator in this study with restructuring, employer, and corporate brand all together in one framework, which is the novel aspect of this study. There are two indirect hypotheses and according to the results both of them did not show any insignificant results. Firstly, the study analyzed mediation among crowdsourcing, restructuring, and employer branding which was fully accepted as the results showed full mediation between these constructs. Secondly, the study analyzed mediation among crowdsourcing, restructuring, and corporate branding which was partially accepted as results showed partial mediation between these constructs. (shrink)

SummaryMid twentieth century meteor astronomy demanded the long-term compilation of observations made by numerous individuals over an extensive geographical area. Such a massive undertaking obviously required the participation of more than just professional astronomers, who often sought to expand their ranks through the use of amateurs that had a basic grasp of astronomy as well as the night sky, and were thus capable of generating first-rate astronomical reports.When, in the 1920s, renowned Swedish astronomer Knut Lundmark turned his attention to meteor (...) astronomy, he was unable to rely even upon this solution. In contrast to many other countries at the time, Sweden lacked an organized amateur astronomy and thus contained only a handful of competent amateurs. Given this situation, Lundmark had to develop ways of engaging the general public in assisting his efforts. To his advantage, he was already a well-established public figure who had published numerous popular science articles and held talks from time to time on the radio. During the 1930s, this prominence greatly facilitated his launching of a crowdsourcing initiative for the gathering of meteor observations.This paper consists of a detailed discussion concerning the means by which Lundmark's initiative disseminated astronomical knowledge to the general public and encouraged a response that might directly contribute to the advancement of science. More precisely, the article explores the manner in which he approached the Swedish public, the degree to which that public responded and the extent to which his efforts were successful. The primary aim of this exercise is to show that the apparently recent Internet phenomenon of ‘crowdsourcing’, especially as it relates to scientific research, actually has a pre-Internet history that is worth studying. Apart from the fact that this history is interesting in its own right, knowing it can provide us with a fresh vantage point from which to better comprehend and appreciate the success of present-day crowdsourcing projects. (shrink)

Nowadays, social media analysis systems are feeding on user contributed data, either for beneficial purposes, such as emergency management, or for user profiling and mass surveillance. Here, we carry out a discussion about the power and pitfalls of public accessibility to social media-based systems, with specific regards to the emergency management application EARS. We investigate whether opening such systems to the population at large would further strengthen the link between communities of volunteer citizens, intelligent systems, and decision makers, thus going (...) in the direction of developing more sustainable and resilient societies. Our analysis highlights fundamental challenges and provides interesting insights into a number of research directions with the aim of developing human-centered social media-based systems. (shrink)

Based on a crowdsourced truth value judgment experiment, we provide empirical evidence challenging two classical views in semantics, and we develop a novel account of counterfactuals that combines ideas from inquisitive semantics and causal reasoning. First, we show that two truth-conditionally equivalent clauses can make different semantic contributions when embedded in a counterfactual antecedent. Assuming compositionality, this means that the meaning of these clauses is not fully determined by their truth conditions. This finding has a clear explanation in inquisitive semantics: (...) truth-conditionally equivalent clauses may be associated with different propositional alternatives, each of which counts as a separate counterfactual assumption. Second, we show that our results contradict the common idea that the interpretation of a counterfactual involves minimizing change with respect to the actual state of affairs. We propose to replace the idea of minimal change by a distinction between foreground and background for a given counterfactual assumption: the background is held fixed in the counterfactual situation, while the foreground can be varied without any minimality constraint. (shrink)

Social innovations are usually understood as new ideas, initiatives, or solutions that make it possible to meet the challenges of societies in fields such as social security, education, employment, culture, health, environment, housing, and economic development. On the one hand, many citizen science activities serve to achieve scientific as well as social and educational goals. Thus, these actions are opening an arena for introducing social innovations. On the other hand, some social innovations are further developed, adapted, or altered after the (...) involvement of scientist-supervised citizens in research and with the use of the citizen science tools and methods such as action research, crowdsourcing, and community-based participatory research. Such approaches are increasingly recognized as crucial for gathering data, addressing community needs, and creating engagement and cooperation between citizens and professional scientists. However, there are also various barriers to both citizen science and social innovation. For example, management, quality and protection of data, funding difficulties, non-recognition of citizens’ contributions, and limited inclusion of innovative research approaches in public policies. In this volume, we open theoretical as well as empirically-based discussion, including examples, practices, and case studies of at least three types of relations between citizen science and social innovation: domination of the citizen science features over social innovation aspects; domination of the social innovation features over the citizen science aspects; and the ways to achieve balance and integration between the social innovation and citizen science features. Each of these relationships highlights factors that influence the development of the main scales of sustainability of innovations in the practice. These innovations are contributing to a new paradigm of learning and sharing knowledge as well as interactions and socio-psychological development of participants. Also, there are factors that influence the development of platforms, ecosystems, and sustainability of innovations such as broad use of the information and communications technologies including robotics and automation; emerging healthcare and health promotion models; advancements in the development and governance of smart, green, inclusive and age-friendly cities and communities; new online learning centers; agri-food, cohousing or mobility platforms; and engagement of citizens into co-creation or co-production of services delivered by public, private, non-governmental organizations as well as non-formal entities. (shrink)

The digital teaching of medieval, and especially auxiliary, scientific skills has been going on for more than a decade. Nevertheless, the breadth and depth of the auxiliary sciences is making them difficult to present in their entirety. With ‘Ad fontes’, basic knowledge of skills needed to study the Middle Ages is imparted through interactive exercises. The e-learning platform was completely revised in 2018, allowing new technical possibilities to be realised while maintaining the strengths of its intuitive exercises. Additionally, crowdsourcing (...) enterprises prove extremely valuable in the application of knowledge. After all, it is only possible to bring together knowledge of a particular field if collaborations are established across individual institutions and researchers. (shrink)

This article aims to further test the cognitive claims of the so-called subjectivity account of causal events and their linguistic markers, causal connectives. We took Mandarin Chinese, a language that is typologically completely different from the usual western languages, as a case to provide evidence for this subjectivity account. Complementary to the commonly used corpora analyses, we employed crowdsourcing to tap native speakers’ intuitions about causal coherence, focusing on four result connectives kějiàn ‘therefore’, suǒyǐ ‘so’, yīncǐ ‘so/for this reason’ (...) and yúshì ‘thereupon/as a result’. The analysis shows systematic differences regarding the use of connectives in relations that differ in terms of subjectivity, demonstrating that native speakers make use of subjectivity to encode and decode different types of causal relations in discourse. Moreover, our study evidences that a comprehensive model of subjectivity should include the epistemic dimension of certainty about the subjectivity scale that might be indicated by other linguistic elements. In-depth analyses of the test items revealed that the presence/absence of modality words in the result segments are related to different preferential patterns for the connectives. There is a trade-off between the epistemic dimension of certainty and the expression of subjectivity in the four connectives involved. (shrink)

Research on individual differences in facing the COVID-19 pandemic seems to be crucial in order to design diverse and highly effective intervention strategies. This study uses a sample of 302 North American participants who were recruited through the crowdsourcing platform ProA; different profiles were established, profiling variables of interest in facing the COVID-19 outbreak. Socio-demographic and psychological (personality traits, gratitude, life purpose, and religiosity) variables were explored. These results are of interest if we want to deepen the study of (...) individual differences at both a theoretical and applied level. (shrink)

In this paper we evaluate how to effectively use the crowdsourcing service, Amazon’s Mechanical Turk (MTurk), to content analyze textual data for use in psychological research. MTurk is a marketplace for discrete tasks completed by workers, typically for small amounts of money. MTurk has been used to aid psychological research in general, and content analysis in particular. In the current study, MTurk workers content analyzed personally-written textual data using coding categories previously developed and validated in psychological research. These codes (...) were evaluated for reliability, accuracy, completion time, and cost. Results indicate that MTurk workers categorized textual data with comparable reliability and accuracy to both previously published studies and expert raters. Further, the coding tasks were performed quickly and cheaply. These data suggest that crowdsourced content analysis can help advance psychological research. (shrink)

Linden Lab studies massive online game "Second Life" unexpectedly gained worldwide fame after a few years after release. To the surprise of many game has met with great interest, despite the lack of promotional campaigns. It can be assumed that the reason why "second life" reached a wider audience was a special type of offered entertainment. Network game proved to be no longer a game that was known so far, but an example of a mass media, whose central element is (...) a dynamic virtual world which is an extension of our "first" reality. "Second Life" has the potential, which is challenging the widely shared rules could shake the foundations of the social world. This program is currently the most advanced example of a virtual economy. Unlike many other massive online games and their predecessors, this game is entirely based on the principles of virtual property ownership, as well as rules of conduct virtual business and service, and finally also the consumption of goods. Users of the game, just like the person providing the data in the framework of social networking sites maintained in the mainstream of Web 2.0, user-generated content constituting the virtual world, which can trade content with others linden virtual dolars that can be exchanged to real U.S. dollars. The increase in popularity of "Second Life" brings to mind the vision of the possibility of creating a better place to live for many people. Closer analysis of this phenomenon does not allow for such statements. In the following instances will be presented: information about the growth of the global market for online games and its consequences, the distinguishing features of "Second Life" from traditional online games, virtual elements of the impact of economics on social life, the concept of entertainment as a job stream properties Games 2.0 and contentious issues, which produces "second life". ** Masowa gra on-line "Second Life" studia Linden Lab nieoczekiwanie zdobyła sławȩ na całym świecie po kilku latach od premiery. Ku zaskoczeniu wielu tytuł spotkał siȩ z ogromnym zainteresowaniem mimo braku akcji promocyjnych. Można przypuszczać, że powodem dla którego "drugie życie" dotarło do szerszego grona odbiorców był szczególny typ zaoferowanej formy rozrywki. Sieciowa gra okazała siȩ nie być już gr¸a} jak¸a} znano do tej pory, lecz przykładem środka masowego przekazu, którego centralnym elementem jest dynamiczny wirtualny świat stanowi¸a}cy przedłużenie naszej, "pierwszej", rzeczywistości. "Second Life" kryje w sobie potencjał, który podważaj¸a}c podzielane powszechnie reguły może wstrz¸a}sn¸a}ć posadami świata społecznego. Program ten jest obecnie najbardziej zaawansowanym przykładem wirtualnej gospodarki. W odróżnieniu od wielu innych masowych gier on-line i ich poprzedniczek pozycja ta w całości opiera siȩ na zasadach posiadania wirtualnej własności, jak też regułach prowadzenia wirtualnej działalności gospodarczej i usługowej, i wreszcie takiej też konsumpcji dóbr. Użytkownicy gry, podobnie jak osoby udostȩpniaj¸a}ce dane w ramach internetowych serwisów społecznościowych utrzymanych w nurcie Web 2.0, generuj¸a} treści tworz¸a}ce wirtualny świat, treści którymi mog¸a} handlować z innymi pobieraj¸a}c za nie opłaty w wirtualnych dolarach lindeńskich wymiennych na realne dolary amerykańskie. Wzrost popularności "Second Life" przywodzi na myśl wizjȩ możliwości stworzenia lepszego miejsca do życia dla wielu ludzi. Bliższa analiza tego zjawiska nie pozwala już na takie stwierdzenia. W dalszej czȩści wyst¸apienia przedstawione zostan¸a: informacje o wzroście globalnego rynku gier on-line i jego konsekwencjach, cechy odróżniaj¸ace "Second Life" od tradycyjnych gier sieciowych, elementy wpływu wirtualnej gospodarki na życie społeczne, pojȩcie rozrywki jako pracy, właściwości nurtu Games 2.0 oraz sporne kwestie, jakie wywołuje "drugie życie". (shrink)