Go to content
UR Home

Comparing Wizard of Oz & Observational Studies for Conversational IR Evaluation: Lessons Learned from These two Diverse Approaches

URN to cite this document:
DOI to cite this document:
Elsweiler, David ; Frummet, Alexander ; Harvey, Morgan
License: Creative Commons Attribution 4.0
PDF - Published Version
Date of publication of this fulltext: 25 Jun 2020 05:37

This publication is part of the DEAL contract with Springer.


Systematic and repeatable measurement of information systems via test collections, the Cranfield model, has been the mainstay of Information Retrieval since the 1960s. However, this may not be appropriate for newer, more interactive systems, such as Conversational Search agents. Such systems rely on Machine Learning technologies, which are not yet sufficiently advanced to permit true human-like ...


Owner only: item control page
  1. Homepage UR

University Library

Publication Server


Publishing: oa@ur.de
0941 943 -4239 or -69394

Dissertations: dissertationen@ur.de
0941 943 -3904

Research data: datahub@ur.de
0941 943 -5707

Contact persons