Open Access Open Access  Restricted Access Subscription or Fee Access

Latent Class Models Approach to the Multi-rater Agreement

Ayfer Ezgi Yilmaz, Serpil Aktas

Abstract



Kappa-like statistics measures the agreement among two raters for nominal scale. For the multi-rater studies the extended versions of kappa-like statistics are suggested. Latent class models also investigate inter-rater agreement and provide a powerful and flexible tool and allow us to analyze agreement among more than two raters simultaneously. The latent class models are the finite mixture models. This model treats a contingency table as a mixture of unobserved qualitative latent variable. When the latent class model fits to the data, the expected frequencies can be used to assess the rater agreement. In this study, it is purposed to describe the latent class approach in the agreement context and, to compare this approach to the classical agreement indices on various numerical examples.

Keywords


agreement, Brennan and Prediger’s kappa, Cohen’s kappa, Fleiss’ kappa, Light’s kappa, latent class models, multi-raters.

Full Text:

PDF


Disclaimer/Regarding indexing issue:

We have provided the online access of all issues and papers to the indexing agencies (as given on journal web site). It’s depend on indexing agencies when, how and what manner they can index or not. Hence, we like to inform that on the basis of earlier indexing, we can’t predict the today or future indexing policy of third party (i.e. indexing agencies) as they have right to discontinue any journal at any time without prior information to the journal. So, please neither sends any question nor expects any answer from us on the behalf of third party i.e. indexing agencies.Hence, we will not issue any certificate or letter for indexing issue. Our role is just to provide the online access to them. So we do properly this and one can visit indexing agencies website to get the authentic information.