FairEval implementation on HuggingFace


We have published an implementation of FairEval on HuggingFace, which allows to get a detailed breakdown of errors for sequence labeling tasks (we consider mostly NER).

Great work by Ignacio Llorca based on Katrin Ortmann’s LREC Paper Fine-Grained Error Analysis and Fair Evaluation of Labeled Spans.