A methodological review of meta-analyses of the effectiveness of clinical psychology treatments

• Published in: Behavior research methods Vol. 50; no. 5; pp. 2057 - 2073
• Main Authors: Rubio-Aparicio, María, Marín-Martínez, Fulgencio, Sánchez-Meca, Julio, López-López, José Antonio
• Format: Journal Article
• Language: English
• Published: New York Springer US 01-10-2018
• Subjects: Behavioral Science and Psychology; Cognitive Psychology; Humans; Meta-Analysis as Topic; Models, Statistical; Psychology; Psychology, Clinical - methods; Psychology, Clinical - standards; Psychology, Clinical - statistics & numerical data; Monte Carlo studies; Standardized mean difference; Clinical significance; Meta-analysis
• ISSN: 1554-3528; 1554-3528
• DOI: 10.3758/s13428-017-0973-8

This article presents a methodological review of 54 meta-analyses of the effectiveness of clinical psychological treatments, using standardized mean differences as the effect size index. We statistically analyzed the distribution of the number of studies of the meta-analyses, the distribution of the sample sizes in the studies of each meta-analysis, the distribution of the effect sizes in each of the meta-analyses, the distribution of the between-studies variance values, and the Pearson correlations between effect size and sample size in each meta-analysis. The results are presented as a function of the type of standardized mean difference: posttest standardized mean difference, standardized mean change from pretest to posttest, and standardized mean change difference between groups. These findings will help researchers design future Monte Carlo and theoretical studies on the performance of meta-analytic procedures, based on the manipulation of realistic model assumptions and parameters of the meta-analyses. Furthermore, the analysis of the distribution of the mean effect sizes through the meta-analyses provides a specific guide for the interpretation of the clinical significance of the different types of standardized mean differences within the field of the evaluation of clinical psychological interventions.