Abstract

The more we rely on digital assistants, online search engines, and AI systems to revise our system of beliefs and increase our body of knowledge, the less we are able to resort to some independent criterion, unrelated to further digital tools, in order to asses the epistemic reliability of the outputs delivered by them. This raises some important questions to epistemology in general and pressing questions to applied to epistemology in particular. In this paper, we propose an experimental method for the assessment of GPT-3’s capacity to generate consistent and coherent sets of outputs. When several outputs to one and the same input are very repetitive they tend to be consistent with each other, that is they do not contradict each other. But consistency does not make the set of outputs as a whole more informative than the outputs considered individually. We argue that the less informative a set of outputs is, the less coherent it is. We establish a conceptual distinction between consistency and coherence in the light of what some epistemologists refer to as a coherence theories of truth and justification. While much attention has been given to GPT-3’s capacity to produce internally coherent individual outputs, we argue, instead, that more attention should be given to its capacity to produce consistent and coherent outputs generated on a single-input-multiple-outputs basis.