To overcome the frequently debated “reproducibility crisis” in science, replicating studies is becoming increasingly common across a variety of disciplines such as psychology, economics and medicine. Their aim is to assess whether the original study is statistically consistent with the replications, and to assess the evidence for the presence of an effect of interest. While the majority of the analyses is based on a single replication, multiple replications of the same experiment, usually conducted at different sites, are becoming more frequent. In this framework, our interest concerns the variation of results between sites and, more specifically, the issue of how to design the replication studies (i.e. how many sites and how many subjects within site) in order to yield sufficiently sensitive conclusions. For instance, if interest centers on hypothesis-testing, this means that tests should be well-powered, as described in Hedges and Schauer (2021) from a frequentist perspective. In this work, we propose a Bayesian scheme for designing multisite replication studies in view of testing heterogeneity between sites. We adopt a normal-normal hierarchical model and use the Bayes factor as a measure of evidence.

Bourazas, K., Consonni, G., Deldossi, L., Bayesian sample size determination for Multisite Replication Studies, in Programme and Abstracts, 22nd Annual ENBIS Conference, Trondheim, 26-30 June 2022, (Trondheim, 26-30 June 2022), Bergquist, B; Tyssedal, J; Ruckert J, Trondheim 2022:2022 38-39 [http://hdl.handle.net/10807/214430]

Bayesian sample size determination for Multisite Replication Studies

Bourazas, K
;
Consonni, G.;Deldossi, L.
2022

Abstract

To overcome the frequently debated “reproducibility crisis” in science, replicating studies is becoming increasingly common across a variety of disciplines such as psychology, economics and medicine. Their aim is to assess whether the original study is statistically consistent with the replications, and to assess the evidence for the presence of an effect of interest. While the majority of the analyses is based on a single replication, multiple replications of the same experiment, usually conducted at different sites, are becoming more frequent. In this framework, our interest concerns the variation of results between sites and, more specifically, the issue of how to design the replication studies (i.e. how many sites and how many subjects within site) in order to yield sufficiently sensitive conclusions. For instance, if interest centers on hypothesis-testing, this means that tests should be well-powered, as described in Hedges and Schauer (2021) from a frequentist perspective. In this work, we propose a Bayesian scheme for designing multisite replication studies in view of testing heterogeneity between sites. We adopt a normal-normal hierarchical model and use the Bayes factor as a measure of evidence.
Inglese
Programme and Abstracts, 22nd Annual ENBIS Conference, Trondheim, 26-30 June 2022
Enbis Conference
Trondheim
26-giu-2022
30-giu-2022
9788230354704
Bergquist, B; Tyssedal, J; Ruckert J
Bourazas, K., Consonni, G., Deldossi, L., Bayesian sample size determination for Multisite Replication Studies, in Programme and Abstracts, 22nd Annual ENBIS Conference, Trondheim, 26-30 June 2022, (Trondheim, 26-30 June 2022), Bergquist, B; Tyssedal, J; Ruckert J, Trondheim 2022:2022 38-39 [http://hdl.handle.net/10807/214430]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10807/214430
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact