Skip to content

Commit 4d76435

Browse files
FBartosvandenman
andauthored
Update References (#374)
Co-authored-by: Don van den Bergh <[email protected]>
1 parent 7a3f8ec commit 4d76435

8 files changed

+86
-8
lines changed

README.md

Lines changed: 66 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,66 @@
1+
# The Meta-Analysis Module <img src='inst/icons/meta-analysis.svg' width='149' height='173' align='right'/>
2+
3+
**JASP Meta-Analysis module** is an add-on module for JASP that provides comprehensive tools for synthesizing evidence across multiple studies. The Meta-Analysis module offers a wide range of functionalities, including (but not limited to) classical and Bayesian meta-analytic approaches, multilevel and multivariate models, meta-regression, publication bias adjustment, and robust meta-analytic methods. Specifically, it comprises analysis tools for effect size computation, random-effects and fixed-effects meta-analysis, moderator analysis, heterogeneity assessment, and publication bias detection. Furthermore, the module provides state-of-the-art Bayesian meta-analytic methods through model averaging and hypothesis testing. The module integrates comprehensive visualizations including forest plots, funnel plots, and bubble plots, along with extensive diagnostic tools that assist researchers in understanding, documenting, and communicating their meta-analytic results.
4+
5+
## Articles
6+
7+
The main functions of the Meta-Analysis module are comprehensively documented in two key manuscripts that serve as the primary references for understanding its functionality and statistical methodology:
8+
9+
**Part I: Classical Approaches** - This article provides detailed coverage of the classical meta-analytic methods implemented in the module, including effect size computation, random-effects models, meta-regression, multilevel and multivariate models.
10+
[![arXiv](https://img.shields.io/badge/arXiv-2509.09845-b31b1b.svg)](https://doi.org/10.48550/arXiv.2509.09845)
11+
12+
**Part II: Bayesian Approaches** - This article focuses on the advanced Bayesian meta-analytic functionality, covering Bayesian parameter estimation, hypothesis testing through Bayes factors, Bayesian model averaging, and robust Bayesian meta-analysis.
13+
[![arXiv](https://img.shields.io/badge/arXiv-2509.09850-b31b1b.svg)](https://doi.org/10.48550/arXiv.2509.09850)
14+
15+
16+
## R Packages <img src='https://www.r-project.org/logo/Rlogo.svg' width='100' height='78' align='right'/>
17+
18+
The meta-analytic functionality is served by several R packages
19+
20+
- **metafor** - The primary package for classical meta-analytic methods ([metafor on CRAN](https://cran.r-project.org/package=metafor))
21+
- **RoBMA** - The primary package for Bayesian meta-analytic methods ([RoBMA on CRAN](https://cran.r-project.org/package=RoBMA))
22+
- **pema** - The package for penalized meta-analysis ([pema on CRAN](https://cran.r-project.org/package=pema))
23+
- **metamisc** - Package for meta-analysis of prediction model performance ([metamisc on CRAN](https://cran.r-project.org/package=metamisc))
24+
- **metaSEM** - Package for meta-analytic SEM and SEM-based meta-analysis ([metaSEM on CRAN](https://cran.r-project.org/package=metaSEM))
25+
26+
## Analyses
27+
28+
The organization of the analyses within the Meta-Analysis module in JASP is as follows:
29+
30+
```
31+
--- Meta-Analysis
32+
-- Miscellaneous
33+
- Effect Size Computation
34+
- Funnel Plot
35+
-- Classical
36+
- Meta-Analysis
37+
- Meta-Analysis (Multilevel/Multivariate)
38+
- Mantel-Haenszel / Peto
39+
- Prediction Model Performance
40+
- WAAP-WLS
41+
- PET-PEESE
42+
- Selection Models
43+
- Meta-Analytic SEM
44+
- SEM-Based Meta-Analysis
45+
-- Bayesian
46+
- Meta-Analysis
47+
- Meta-Analysis (Deprecated)
48+
- Binomial Meta-Analysis
49+
- Penalized Meta-Analysis
50+
- Prediction Model Performance
51+
- Robust Bayesian Meta-Analysis
52+
```
53+
54+
### Key Features
55+
56+
**Effect Size Computation**: Calculate standardized effect sizes from raw data including standardized mean differences, odds ratios, correlations, and risk ratios with automatic standard error computation.
57+
58+
**Classical Meta-Analysis**: Comprehensive implementation of random-effects and fixed-effects models with support for meta-regression, subgroup analysis, heterogeneity assessment, and publication bias detection through funnel plot asymmetry tests.
59+
60+
**Advanced Models**: Multilevel models for dependent effect sizes, multivariate models for correlated outcomes, location-scale models for heterogeneity moderation, and cluster-robust standard errors.
61+
62+
**Bayesian Methods**: State-of-the-art Bayesian meta-analysis with model averaging, hypothesis testing via Bayes factors, prior specification options, and robust publication bias adjustment.
63+
64+
**Visualization**: Publication ready forest plots, funnel plots, bubble plots for meta-regression, and comprehensive diagnostic plots including Baujat plots and profile likelihood plots.
65+
66+
**Publication Bias**: Multiple approaches including trim-and-fill, PET-PEESE, selection models, and robust Bayesian meta-analysis.

inst/help/EffectSizeComputation.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ Already included effect sizes can be passed forward using the Reported effect si
77

88
The selected effect size can be computed only for a subset of the dataset using the Subset indicator variable..
99

10-
See [metafor's documentation](https://wviechtb.github.io/metafor/reference/escalc.html) for more detail about the effect sizes.
10+
See [metafor's documentation](https://wviechtb.github.io/metafor/reference/escalc.html) for more detail about the effect sizes. See [this tutorial](https://doi.org/10.48550/arXiv.2509.09845) for a detailed introduction to the module.
1111

1212

1313
#### Design

inst/qml/BayesianBinomialMetaAnalysis.qml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,8 +28,10 @@ Form
2828
"The analysis provides pre-specified prior distributions for different effect size measures and fields. " +
2929
"The analysis allows you to specify meta-regression, 3-level meta-analysis, and subgroup analysis. " +
3030
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.\n\n" +
31-
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025) with the binomial-normal model described in Bartoš et al. (2023).")
31+
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025) with the binomial-normal model described in Bartoš et al. (2023).\n\n" +
32+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09850) for a detailed introduction to the module.")
3233
infoBottom: "## " + qsTr("References") + "\n" +
34+
"- Bartoš F & Wagenmakers EJ (2025). “Meta-analysis with JASP, Part II: Bayesian approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09850\n" +
3335
"- Bartoš F, Gronau QF, Timmers B, Otte WM, Ly A, Wagenmakers EJ (2021). “Bayesian model‐averaged meta‐analysis in medicine.” _Statistics in Medicine, 40_(30), 6743-6761. https://doi.org/10.1002/sim.9170\n" +
3436
"- Bartoš F, Otte WM, Gronau QF, Timmers B, Ly A, Wagenmakers EJ (2023). “Empirical prior distributions for Bayesian meta-analyses of binary and time to event outcomes.” _arXiv Preprint_ https://doi.org/10.48550/arXiv.2306.11468\n" +
3537
"- Bartoš F, Maier M, Stanley TD, Wagenmakers EJ (2025). “Robust Bayesian meta-regression: Model-averaged moderation analysis in the presence of publication bias.” _Psychological Methods_. https://doi.org/10.1037/met0000737\n" +

inst/qml/BayesianMetaAnalysis.qml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,8 +29,10 @@ Form
2929
"Additional care is required when using a different type of effect sizes as the default prior distributions might not match the proper scaling of the effect size and heterogeneity. " +
3030
"The analysis allows you to specify meta-regression, 3-level meta-analysis, and subgroup analysis. " +
3131
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.\n\n" +
32-
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025).")
32+
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025).\n\n" +
33+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09850) for a detailed introduction to the module.")
3334
infoBottom: "## " + qsTr("References") + "\n" +
35+
"- Bartoš F & Wagenmakers EJ (2025). “Meta-analysis with JASP, Part II: Bayesian approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09850\n" +
3436
"- Bartoš F, Gronau QF, Timmers B, Otte WM, Ly A, Wagenmakers EJ (2021). “Bayesian model‐averaged meta‐analysis in medicine.” _Statistics in Medicine, 40_(30), 6743-6761. https://doi.org/10.1002/sim.9170\n" +
3537
"- Bartoš F, Otte WM, Gronau QF, Timmers B, Ly A, Wagenmakers EJ (2023). “Empirical prior distributions for Bayesian meta-analyses of binary and time to event outcomes.” _arXiv Preprint_ https://doi.org/10.48550/arXiv.2306.11468\n" +
3638
"- Bartoš F, Maier M, Stanley TD, Wagenmakers EJ (2025). “Robust Bayesian meta-regression: Model-averaged moderation analysis in the presence of publication bias.” _Psychological Methods_. https://doi.org/10.1037/met0000737\n" +

inst/qml/ClassicalMetaAnalysis.qml

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,12 +26,14 @@ Form
2626
info: qsTr("Classical meta-analysis allows you to conduct a meta-analysis using the classical approach. " +
2727
"It provides options for fixed and random effects models, as well as meta-regression, location-scale models, and subgroup analysis. " +
2828
"Additional options include the ability to specify clustering for robust variance estimation, permutation tests, and generating the metafor package R code. " +
29-
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.")
29+
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.\n\n" +
30+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09845) for a detailed introduction to the module.")
3031
infoBottom: "## " + qsTr("References") + "\n" +
32+
"- Bartoš F, Wagenmakers EJ, & Viechtbauer W (2025). “Meta-analysis with JASP, Part I: Classical approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09845\n" +
3133
"- Viechtbauer W (2010). “Conducting meta-analyses in R with the metafor package.” _Journal of Statistical Software, 36_(3), 1–48. https://doi.org/10.18637/jss.v036.i03\n" +
3234
"- Viechtbauer W, López-López JA, Sánchez-Meca J, Marín-Martínez F (2015). “A comparison of procedures to test for moderators in mixed-effects meta-regression models.” _Psychological Methods, 20_(3), 360–374. https://doi.org/10.1037/met0000023\n" +
3335
"- Viechtbauer W, López-López JA (2022). “Location-scale models for meta-analysis.” _Research Synthesis Methods, 13_(6), 697–715. https://doi.org/10.1002/jrsm.1562\n" +
34-
"- Viechtbauer W (2025). _metafor: Meta-Analysis Package for R_. R package version 4.8-0 Available at: <https://CRAN.R-project.org/package=metafor>.\n" +
36+
"- Viechtbauer W (2025). _metafor: Meta-Analysis Package for R_. R package version 4.8-0 Available at: <https://CRAN.R-project.org/package=metafor>.\n" +
3537
"## " + qsTr("R Packages") + "\n" +
3638
"- metafor"
3739

inst/qml/ClassicalMetaAnalysisMultilevelMultivariate.qml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -27,8 +27,10 @@ Form
2727
"The effect size dependency can be adjusted for by specifying the 'Effect Size Variance-Covariance Matrix' (interfacing the 'vcalc' function) and specifying the 'Random Effects/Model Components' (interfacing the 'random' argument in 'rma.mv' function). " +
2828
"It provides options for fixed and random effects models, as well as meta-regression, and subgroup analysis. " +
2929
"Additional options include the ability to specify clustering for robust variance estimation, permutation tests, and generating the metafor package R code. " +
30-
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.")
30+
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.\n\n" +
31+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09845) for a detailed introduction to the module.")
3132
infoBottom: "## " + qsTr("References") + "\n" +
33+
"- Bartoš F, Wagenmakers EJ, & Viechtbauer W (2025). “Meta-analysis with JASP, Part I: Classical approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09845\n" +
3234
"- Viechtbauer W (2010). “Conducting meta-analyses in R with the metafor package.” _Journal of Statistical Software, 36_(3), 1–48. https://doi.org/10.18637/jss.v036.i03\n" +
3335
"- Viechtbauer W, López-López JA, Sánchez-Meca J, Marín-Martínez F (2015). “A comparison of procedures to test for moderators in mixed-effects meta-regression models.” _Psychological Methods, 20_(3), 360–374. https://doi.org/10.1037/met0000023\n" +
3436
"- Viechtbauer W (2025). _metafor: Meta-Analysis Package for R_. R package version 4.8-0 Available at: <https://CRAN.R-project.org/package=metafor>.\n" +

inst/qml/FunnelPlot.qml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,8 +24,10 @@ Form
2424
{
2525
info: qsTr("Funnel plots allow you to visualize the observed effect sizes and standard errors with the funnel outlaying the sampling distribution under a given meta-analytic model. " +
2626
"Funnel plots are often used to assess publication bias and small-study effects. However, many studies have shown that funnel plots are not very reliable for this purpose. " +
27-
"See e.g. Lau et al., (2006) and Terrin et al. (2005).")
27+
"See e.g. Lau et al., (2006) and Terrin et al., (2005).\n\n" +
28+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09845) for a detailed introduction to the module.")
2829
infoBottom: "## " + qsTr("References") + "\n" +
30+
"- Bartoš F, Wagenmakers EJ, & Viechtbauer W (2025). “Meta-analysis with JASP, Part I: Classical approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09845\n" +
2931
"- Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. (2006). “The case of the misleading funnel plot.” _BMJ, 333_(7568), 597-600. https://doi.org/10.1136/bmj.333.7568.597\n" +
3032
"- Terrin N, Schmid CH, Lau J (2005). In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. _Journal of Clinical Epidemiology, 58_(9), 894-901. https://doi.org/10.1016/j.jclinepi.2005.01.006\n" +
3133
"- Kossmeier M, Tran US, Voracek M. (2020). “Power-enhanced funnel plots for meta-analysis.” _Zeitschrift für Psychologie, 228_(1). https://doi.org/10.1027/2151-2604/a000392\n" +

inst/qml/RobustBayesianMetaAnalysis.qml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,8 +29,10 @@ Form
2929
"Additional care is required when using a different type of effect sizes as the default prior distributions might not match the proper scaling of the effect size and heterogeneity. " +
3030
"The analysis allows you to specify meta-regression, 3-level meta-analysis, and subgroup analysis. " +
3131
"The results include estimates of effect sizes, heterogeneity, moderation, and various plots to visualize the results.\n\n" +
32-
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025).")
32+
"The analysis is based on the Bayesian meta-analysis/meta-regression parameterization as outlined in Bartoš et al. (2025).\n\n" +
33+
"See [this tutorial](https://doi.org/10.48550/arXiv.2509.09850) for a detailed introduction to the module.)"
3334
infoBottom: "## " + qsTr("References") + "\n" +
35+
"- Bartoš F & Wagenmakers EJ (2025). “Meta-analysis with JASP, Part II: Bayesian approaches.” _ArXiv Preprint_. https://doi.org/10.48550/arXiv.2509.09850\n" +
3436
"- Bartoš F, Gronau QF, Timmers B, Otte WM, Ly A, Wagenmakers EJ (2021). “Bayesian model‐averaged meta‐analysis in medicine.” _Statistics in Medicine, 40_(30), 6743-6761. https://doi.org/10.1002/sim.9170\n" +
3537
"- Bartoš F, Maier M, Stanley TD, Wagenmakers EJ (2025). “Robust Bayesian meta-regression: Model-averaged moderation analysis in the presence of publication bias.” _Psychological Methods_. https://doi.org/10.1037/met0000737\n" +
3638
"- Bartoš F, Maier M, Quintana DS, Wagenmakers EJ (2022). “Adjusting for publication bias in JASP and R: Selection models, PET-PEESE, and robust Bayesian meta-analysis.” _Advances in Methods and Practices in Psychological Science, 5_(3), 25152459221109259. https://doi.org/10.1177/25152459221109259\n" +

0 commit comments

Comments
 (0)