Go to content
UR Home

Comparing Wizard of Oz & Observational Studies for Conversational IR Evaluation: Lessons Learned from These two Diverse Approaches

URN to cite this document:
urn:nbn:de:bvb:355-epub-433745
DOI to cite this document:
10.5283/epub.43374
Elsweiler, David ; Frummet, Alexander ; Harvey, Morgan
[img]
Preview
License: Creative Commons Attribution 4.0
PDF - Published Version
(270kB)
Date of publication of this fulltext: 25 Jun 2020 05:37

This publication is part of the DEAL contract with Springer.


Abstract

Systematic and repeatable measurement of information systems via test collections, the Cranfield model, has been the mainstay of Information Retrieval since the 1960s. However, this may not be appropriate for newer, more interactive systems, such as Conversational Search agents. Such systems rely on Machine Learning technologies, which are not yet sufficiently advanced to permit true human-like ...

plus


Owner only: item control page
  1. Homepage UR

University Library

Publication Server

Contact:

Publishing: oa@ur.de
0941 943 -4239 or -69394

Dissertations: dissertationen@ur.de
0941 943 -3904

Research data: datahub@ur.de
0941 943 -5707

Contact persons