In psychometric sciences, a common problem is the choice of a good response scale. Every scale has, by its nature, a propensity to lead a respondent to mainly positive- or negative- ratings. This paper investigates possible causes of the discordance between two ordinal scales evaluating the same goods or services.In psychometric literature, Cohen’s Kappa is one of the most important index to evaluate the strength of agreement, or disagreement, between two nominal variables, in particular in its weighted version. In this paper, a new index is proposed. A proper procedure to determine the lower and upper triangle in a non-square table is also implemented, as to generalize the index in order to compare two scales with a different number of categories. A test is set up with the aim to verify the tendency of a scale to have a different rating compared to a different one. A study with real data is conducted.

Bonanomi, A., A new index for the comparison of different measurement scales, in Vicari D., O. A. R. G. W. C. (ed.), Analysis and Modeling of Complex Data in Behavioral and Social Sciences, Springer, Cham, LONDON 2014: <<STUDIES IN CLASSIFICATION, DATA ANALYSIS, AND KNOWLEDGE ORGANIZATION>>, 49 55- 63. 10.1007/978-3-319-06692-9_7 [http://hdl.handle.net/10807/157114]

A new index for the comparison of different measurement scales

Bonanomi, Andrea
Primo
2014

Abstract

In psychometric sciences, a common problem is the choice of a good response scale. Every scale has, by its nature, a propensity to lead a respondent to mainly positive- or negative- ratings. This paper investigates possible causes of the discordance between two ordinal scales evaluating the same goods or services.In psychometric literature, Cohen’s Kappa is one of the most important index to evaluate the strength of agreement, or disagreement, between two nominal variables, in particular in its weighted version. In this paper, a new index is proposed. A proper procedure to determine the lower and upper triangle in a non-square table is also implemented, as to generalize the index in order to compare two scales with a different number of categories. A test is set up with the aim to verify the tendency of a scale to have a different rating compared to a different one. A study with real data is conducted.
2014
Inglese
Analysis and Modeling of Complex Data in Behavioral and Social Sciences
978-3-319-06691-2
Springer, Cham
49
Bonanomi, A., A new index for the comparison of different measurement scales, in Vicari D., O. A. R. G. W. C. (ed.), Analysis and Modeling of Complex Data in Behavioral and Social Sciences, Springer, Cham, LONDON 2014: <<STUDIES IN CLASSIFICATION, DATA ANALYSIS, AND KNOWLEDGE ORGANIZATION>>, 49 55- 63. 10.1007/978-3-319-06692-9_7 [http://hdl.handle.net/10807/157114]
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10807/157114
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact