org.dkpro.statistics.agreement.coding

Class ScottPiAgreement

java.lang.Object

org.dkpro.statistics.agreement.AgreementMeasure

org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

org.dkpro.statistics.agreement.coding.ScottPiAgreement

All Implemented Interfaces:

ICodingAgreementMeasure, IAgreementMeasure, IChanceCorrectedAgreement

public class ScottPiAgreement
extends CodingAgreementMeasure
implements IChanceCorrectedAgreement

Implementation of Scott's pi (1955) for calculating a chance-corrected inter-rater agreement for two raters. The measure assumes the same probability distribution for all raters.

References:

• Artstein, R. & Poesio, M.: Inter-Coder Agreement for Computational Linguistics. Computational Linguistics 34(4):555-596, 2008.
• Scott, W.A.: Reliability of content analysis: The case of nominal scale coding. Public Opinion Quaterly 19(3):321-325, 1955.

Author:

Christian M. Meyer

Field Summary

Fields inherited from class org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

study

Constructor Summary

Constructors

Constructor and Description
ScottPiAgreement(ICodingAnnotationStudy study) Initializes the instance for the given annotation study.

Method Summary

Modifier and Type	Method and Description
double	calculateExpectedAgreement() Calculates the expected inter-rater agreement that assumes the same distribution for all raters and annotations.

Methods inherited from class org.dkpro.statistics.agreement.coding.CodingAgreementMeasure

calculateObservedAgreement, doCalculateItemAgreement, ensureTwoRaters, warnIfMissingValues

Methods inherited from class org.dkpro.statistics.agreement.AgreementMeasure

calculateAgreement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dkpro.statistics.agreement.IChanceCorrectedAgreement

calculateObservedAgreement

Methods inherited from interface org.dkpro.statistics.agreement.IAgreementMeasure

calculateAgreement

Constructor Detail

ScottPiAgreement

public ScottPiAgreement(ICodingAnnotationStudy study)

Initializes the instance for the given annotation study. The study may never be null.

Method Detail

calculateExpectedAgreement

public double calculateExpectedAgreement()

Calculates the expected inter-rater agreement that assumes the same distribution for all raters and annotations.

Specified by:

calculateExpectedAgreement in interface IChanceCorrectedAgreement

Overrides:

calculateExpectedAgreement in class AgreementMeasure

Throws:

NullPointerException - if the annotation study is null.

ArithmeticException - if there are no items in the annotation study.