org.dkpro.statistics.agreement

Interface IItemSpecificAgreement<ItemType extends IAnnotationItem>

All Known Subinterfaces:

ICodingItemSpecificAgreement

All Known Implementing Classes:

KrippendorffAlphaAgreement, PercentageAgreement

public interface IItemSpecificAgreement<ItemType extends IAnnotationItem>

A diagnostic device for analyzing the agreement separately for each annotation item. This is useful, for instance, to identify a certain type of item that has been very easy or very difficult to annotate. Note that the definition of an annotation item depends on the actual annotation task (i.e., the type of IAnnotationStudy): Coding tasks use fixed items which are provided for each rater to annotate. In unitizing tasks, the notion of an annotation item corresponds to a certain segment within the given continuum. This segment may contain none, one, or multiple annotation units by no, one, or multiple raters.

References:

• Krippendorff, K.: Content Analysis: An Introduction to Its Methodology. Beverly Hills, CA: Sage Publications, 1980.

Author:

Christian M. Meyer

See Also:

ICodingAnnotationStudy, ICodingItemSpecificAgreement, IUnitizingAnnotationStudy

Method Summary

Modifier and Type	Method and Description
double	calculateItemAgreement(ItemType item) Calculates the inter-rater agreement for the given annotation item.

Method Detail

calculateItemAgreement

double calculateItemAgreement(ItemType item)

Calculates the inter-rater agreement for the given annotation item.

See Also:

IItemSpecificAgreement