SANRA—a scale for the quality assessment of narrative review articles

Research Integrity and Peer Review 4 (1) (2019)
  Copy   BIBTEX

Abstract

BackgroundNarrative reviews are the commonest type of articles in the medical literature. However, unlike systematic reviews and randomized controlled trials articles, for which formal instruments exist to evaluate quality, there is currently no instrument available to assess the quality of narrative reviews. In response to this gap, we developed SANRA, the Scale for the Assessment of Narrative Review Articles.MethodsA team of three experienced journal editors modified or deleted items in an earlier SANRA version based on face validity, item-total correlations, and reliability scores from previous tests. We deleted an item which addressed a manuscript’s writing and accessibility due to poor inter-rater reliability. The six items which form the revised scale are rated from 0 to 2 and cover the following topics: explanation of the importance and the aims of the review, literature search and referencing and presentation of evidence level and relevant endpoint data. For all items, we developed anchor definitions and examples to guide users in filling out the form. The revised scale was tested by the same editors in a group of 30 consecutive non-systematic review manuscripts submitted to a general medical journal.ResultsRaters confirmed that completing the scale is feasible in everyday editorial work. The mean sum score across all 30 manuscripts was 6.0 out of 12 possible points. Corrected item-total correlations ranged from 0.33 to 0.58, and Cronbach’s alpha was 0.68. The intra-class correlation coefficient was 0.77 [95% CI 0.57, 0.88]. Raters often disagreed on items 1 and 4.ConclusionsSANRA’s feasibility, inter-rater reliability, homogeneity of items, and internal consistency are sufficient for a scale of six items. Further field testing, particularly of validity, is desirable. We recommend rater training based on the “explanations and instructions” document provided with SANRA. In editorial decision-making, SANRA may complement journal-specific evaluation of manuscripts—pertaining to, e.g., audience, originality or difficulty—and may contribute to improving the standard of non-systematic reviews.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 74,649

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Improving the Peer Review of Narrative Literature Reviews.Jennifer A. Byrne - 2016 - Research Integrity and Peer Review 1 (1).

Analytics

Added to PP
2020-02-03

Downloads
17 (#634,913)

6 months
1 (#419,921)

Historical graph of downloads
How can I increase my downloads?