org.dkpro.statistics.agreement.unitizing

Class KrippendorffAlphaUnitizingAgreement

java.lang.Object

org.dkpro.statistics.agreement.DisagreementMeasure

org.dkpro.statistics.agreement.unitizing.UnitizingAgreementMeasure

org.dkpro.statistics.agreement.unitizing.KrippendorffAlphaUnitizingAgreement

All Implemented Interfaces:

IAgreementMeasure, ICategorySpecificAgreement, IUnitizingAgreementMeasure

public class KrippendorffAlphaUnitizingAgreement
extends UnitizingAgreementMeasure
implements ICategorySpecificAgreement

Implementation of Krippendorff's (1995) alpha_U-measure for calculating a chance-corrected inter-rater agreement for unitizing studies with multiple raters. As a model for expected disagreement, alpha_U considers all possible unitizations for the given continuum and raters. Thereby, alpha_U becomes fully compatible with KrippendorffAlphaAgreement. Note that units coded with the same categories by a single rater may not overlap with each other.

References:

• Krippendorff, K.: On the reliability of unitizing contiguous data. Sociological Methodology 25:47–76, 1995.
• Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. 2nd edition, Thousand Oaks, CA: Sage Publications, 2004.

Author:

Christian M. Meyer, Christian Stab

Field Summary

Fields inherited from class org.dkpro.statistics.agreement.unitizing.UnitizingAgreementMeasure

study

Constructor Summary

Constructors

Constructor and Description
KrippendorffAlphaUnitizingAgreement(IUnitizingAnnotationStudy study) Initializes the instance for the given annotation study.

Method Summary

Modifier and Type	Method and Description
double	calculateCategoryAgreement(Object category) Calculates the inter-rater agreement for the given category.
protected double	calculateExpectedCategoryDisagreement(Object category)
protected double	calculateExpectedDisagreement()
protected double	calculateObservedCategoryDisagreement(Object category)
protected double	calculateObservedDisagreement()
protected static double	measureDistance(long offset1, long length1, Object category1, long offset2, long length2, Object category2)

Methods inherited from class org.dkpro.statistics.agreement.DisagreementMeasure

calculateAgreement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.dkpro.statistics.agreement.IAgreementMeasure

calculateAgreement

Constructor Detail

KrippendorffAlphaUnitizingAgreement

public KrippendorffAlphaUnitizingAgreement(IUnitizingAnnotationStudy study)

Initializes the instance for the given annotation study. The study may never be null.

Method Detail

calculateObservedDisagreement

protected double calculateObservedDisagreement()

Specified by:

calculateObservedDisagreement in class DisagreementMeasure

calculateExpectedDisagreement

protected double calculateExpectedDisagreement()

Overrides:

calculateExpectedDisagreement in class DisagreementMeasure

calculateCategoryAgreement

public double calculateCategoryAgreement(Object category)

Description copied from interface: ICategorySpecificAgreement

Calculates the inter-rater agreement for the given category.

Specified by:

calculateCategoryAgreement in interface ICategorySpecificAgreement

See Also:

ICategorySpecificAgreement

calculateObservedCategoryDisagreement

protected double calculateObservedCategoryDisagreement(Object category)

calculateExpectedCategoryDisagreement

protected double calculateExpectedCategoryDisagreement(Object category)

measureDistance

protected static double measureDistance(long offset1,
                                        long length1,
                                        Object category1,
                                        long offset2,
                                        long length2,
                                        Object category2)