Title The Development of a Checklist to Enhance Methodological Quality in Intervention Programs
Authors Chacon-Moscoso, Salvador, Sanduvete-Chaves, Susana, SÁNCHEZ MARTÍN, MILAGROSA, SÁNCHEZ MARTÍN, MILAGROSA
External publication No
Means Front. Psychol.
Scope Article
Nature Científica
JCR Quartile 2
SJR Quartile 1
JCR Impact 2.32100
SJR Impact 1.31400
Area International
Web https://www.scopus.com/inward/record.uri?eid=2-s2.0-85006511413&doi=10.3389%2ffpsyg.2016.01811&partnerID=40&md5=779cbf05eaaf4f3121550f65523e0901
Publication date 18/11/2016
ISI 000388023200001
Scopus Id 2-s2.0-85006511413
DOI 10.3389/fpsyg.2016.01811
Abstract The methodological quality of primary studies is an important issue when performing meta-analyses or systematic reviews. Nevertheless, there are no clear criteria for how methodological quality should be analyzed. Controversies emerge when considering the various theoretical and empirical definitions, especially in relation to three interrelated problems: the lack of representativeness, utility, and feasibility. In this article, we (a) systematize and summarize the available literature about methodological quality in primary studies; (b) propose a specific, parsimonious, 12-items checklist to empirically define the methodological quality of primary studies based on a content validity study; and (c) present an inter-coder reliability study for the resulting 12-items. This paper provides a precise and rigorous description of the development of this checklist, highlighting the clearly specified criteria for the inclusion of items and a substantial inter-coder agreement in the different items. Rather than simply proposing another checklist, however, it then argues that the list constitutes an assessment tool with respect to the representativeness, utility, and feasibility of the most frequent methodological quality items in the literature, one that provides practitioners and researchers with clear criteria for choosing items that may be adequate to their needs. We propose individual methodological features as indicators of quality, arguing that these need to be taken into account when designing, implementing, or evaluating an intervention program. This enhances methodological quality of intervention programs and fosters the cumulative knowledge based on meta-analyses of these interventions. Future development of the checklist is discussed.
Keywords checklist; methodological quality; content validity; inter-coder reliability; primary studies
Universidad Loyola members