In this tutorial we present a formal account of evaluation metrics for three of the most salient information related tasks: Retrieval, Clustering, and Filtering. We focus on the most popular metrics and, by exploiting measurement theory, we show some constraints for suitable metrics in each of the three tasks. We also systematically compare metrics according to how they satisfy such constraints, we provide criteria to select the most adequate metric for each specific information access task, and we discuss how to combine and weight metrics.
A formal approach to effectiveness metrics for information access: Retrieval, filtering, and clustering / Amigó, Enrique; Gonzalo Julio; Mizzaro, Stefano. - 9022(2015), pp. 817-821.
Titolo: | A formal approach to effectiveness metrics for information access: Retrieval, filtering, and clustering |
Autori: | |
Data di pubblicazione: | 2015 |
Serie: | |
Citazione: | A formal approach to effectiveness metrics for information access: Retrieval, filtering, and clustering / Amigó, Enrique; Gonzalo Julio; Mizzaro, Stefano. - 9022(2015), pp. 817-821. |
Abstract: | In this tutorial we present a formal account of evaluation metrics for three of the most salient information related tasks: Retrieval, Clustering, and Filtering. We focus on the most popular metrics and, by exploiting measurement theory, we show some constraints for suitable metrics in each of the three tasks. We also systematically compare metrics according to how they satisfy such constraints, we provide criteria to select the most adequate metric for each specific information access task, and we discuss how to combine and weight metrics. |
Handle: | http://hdl.handle.net/11390/1108805 |
Appare nelle tipologie: | 4.1 Contributo in Atti di convegno |