krippendorff

Fast computation of the Krippendorff's alpha measure.


Keywords
Krippendorff, alpha, agreement, reliability, coding, coders, units, values, inter-annotator-agreement, reliability-rating
License
CNRI-Python-GPL-Compatible
Install
pip install krippendorff==0.6.1

Documentation

Actions Status Version License Supported Python versions

Fast Krippendorff

Fast computation of Krippendorff's alpha agreement measure.

Based on Thomas Grill implementation.

Example usage

Given a reliability data matrix, run:

import krippendorff

krippendorff.alpha(reliability_data=...)

See sample.py and alpha's docstring for more details.

Installation

pip install krippendorff

Caveats

The implementation is fast as it doesn't do a nested loop for the coders. However, V should be small, since a VxV matrix it's used.

Citing

If you use this code in your research, please cite Fast Krippendorff:

@misc{castro-2017-fast-krippendorff,
  author = {Santiago Castro},
  title = {Fast {K}rippendorff: Fast computation of {K}rippendorff's alpha agreement measure},
  year = {2017},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/pln-fing-udelar/fast-krippendorff}}
}