It is argued that neither the "theory-informity" of observations nor the Quine-Duhem thesis pose any in principle threat to the objectivity of theory evaluation. The employment of exploratory theories does not generate incommensurability, but on the contrary is responsible for the mensurability and commensurability of explanatory theories, since exploratory theories enable scientists to make observations which are critical in the evaluation of explanatory theories. The employment of exploratory theories and other auxiliary hypotheses does not enable a theory to always accommodate (...) recalcitrant observations to preserve evidential equivalence with a rival theory. Explanatory theories become rapidly degenerating if exploratory theories or other auxiliary hypotheses which inform the original confirmation base are modified to accommodate recalcitrant observations. (shrink)

Despite continued attention, finding adequate criteria for distinguishing “good” from “bad” scholarly journals remains an elusive goal. In this essay, I propose a solution informed by the work of Imre Lakatos and his methodology of scientific research programmes (MSRP). I begin by reviewing several notable attempts at appraising journal quality – focusing primarily on the impact factor and development of journal blacklists and whitelists. In doing so, I note their limitations and link their overarching goals to those found within the (...) philosophy of science. I argue that Lakatos’s MSRP and specifically his classifications of “progressive” and “degenerative” research programmes can be analogized and repurposed for the evaluation of scholarly journals. I argue that this alternative framework resolves some of the limitations discussed above and offers a more considered evaluation of journal quality – one that helps account for the historical evolution of journal-level publication practices and attendant contributions to the growth (or stunting) of scholarly knowledge. By doing so, the seeming problem of journal demarcation is diminished. In the process I utilize two novel tools (the mistake index and scite index) to further illustrate and operationalize aspects of the MSRP. (shrink)