Table 1 A summary of the dimensions proposed, the related metrics to measure them, and the information required to compute the metrics
From: As if sand were stone. New concepts and metrics to probe the ground on which to build trustable AI
Dimension | Metrics | Required Information |
|---|---|---|
Representativeness | Degree of correspondance, Ψ | Two datasets of arbitrary size |
Reliability | degree of weighted concordance ϱ | Raters’ accuracy and confidence on each rating |
Gold Standard Accuracy | degree of fineness, Ï• | Accuracy of the raters, type of reduction |