A diagnostic device for analyzing the agreement separately for each
annotation item. This is useful, for instance, to identify a certain type
of item that has been very easy or very difficult to annotate.
Krippendorff, K.: Content Analysis: An Introduction to Its Methodology.
Beverly Hills, CA: Sage Publications, 1980.