This paper addresses the potential applications of multiple informant methodology (MIM) to family research. The MIM is used when data on the same unit of analysis are collected from more than one informant, and when the researchers’ purpose requires a dyadic or group level of analysis. The MIM relies on inter-rater agreement (IRA) indices, which are needed to both estimate agreement among informants and aggregate scores from different informants. This review describes the main IRA indices: reliability within-group index (rWG), agreement within-group index (aWG), average deviation indices (ADM and ADMd), intra-class correlation coefficient (ICC), and random group index (rWG). For each index, we describe the aim, application contexts, formula(s), ranges, cutoffs, requirements to apply the index, and its possible application to family research.

Lanz, M., Sorgente, A., Tagliabue, S., Inter-rater Agreement Indices for Multiple Informant Methodology, <<MARRIAGE & FAMILY REVIEW>>, 2018; 54 (2): 148-182. [doi:10.1080/01494929.2017.1340919] [http://hdl.handle.net/10807/109841]

Inter-rater Agreement Indices for Multiple Informant Methodology

Lanz, Margherita
Primo
;
Sorgente, Angela
Secondo
;
Tagliabue, Semira
Ultimo
2018

Abstract

This paper addresses the potential applications of multiple informant methodology (MIM) to family research. The MIM is used when data on the same unit of analysis are collected from more than one informant, and when the researchers’ purpose requires a dyadic or group level of analysis. The MIM relies on inter-rater agreement (IRA) indices, which are needed to both estimate agreement among informants and aggregate scores from different informants. This review describes the main IRA indices: reliability within-group index (rWG), agreement within-group index (aWG), average deviation indices (ADM and ADMd), intra-class correlation coefficient (ICC), and random group index (rWG). For each index, we describe the aim, application contexts, formula(s), ranges, cutoffs, requirements to apply the index, and its possible application to family research.
2018
Inglese
Lanz, M., Sorgente, A., Tagliabue, S., Inter-rater Agreement Indices for Multiple Informant Methodology, <<MARRIAGE & FAMILY REVIEW>>, 2018; 54 (2): 148-182. [doi:10.1080/01494929.2017.1340919] [http://hdl.handle.net/10807/109841]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10807/109841
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 12
  • ???jsp.display-item.citation.isi??? 10
social impact