EvalUMAP: Towards comparative evaluation in user modeling, adaptation and personalization

Conlan, Owen, Kelly, Liadh, Koidl, Kevin, Lawless, Séamus and Staikopoulos, Athanasios (2017) EvalUMAP: Towards comparative evaluation in user modeling, adaptation and personalization. In: 18th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2017. CEUR Workshop Proceedings (1866). CEUR-WS.org.

Full text not available from this repository.

Abstract

There is currently no established or standardized means for the comparative evaluation of algorithms and systems developed by researchers in the User Modeling, Adaptation and Personalization (UMAP) space. The design and establishment of such methodologies has proven to be extremely difficult, but would be highly rewarding, as demonstrated by initiatives such as CLEF, TREC and NTCIR in the Information Retrieval domain. Privacy concerns, the challenges of working with interactive scenarios, and individual differences in behaviour between users must all be addressed in order to facilitate repeatable and comparable evaluation, and to advance research in this domain. In this paper we present EvalUMAP, a new concerted drive towards the establishment of shared challenges for comparative evaluation within the UMAP community.

Item Type:	Book Section
Subjects:	Q Science > QA Mathematics > Electronic computers. Computer science T Technology > T Technology (General) > Information Technology > Electronic computers. Computer science Q Science > QA Mathematics > Computer software T Technology > T Technology (General) > Information Technology > Computer software
Divisions:	School of Computing > Staff Research and Publications
Depositing User:	Caoimhe Ní Mhaicín
Date Deposited:	01 Oct 2019 11:53
Last Modified:	29 Oct 2019 10:35
URI:	https://norma.ncirl.ie/id/eprint/3834

Actions (login required)

View Item