Go to content
UR Home

A Living Lab Architecture for Reproducible Shared Task Experimentation

URN to cite this document:
DOI to cite this document:
Breuer, Timo ; Schaer, Philipp
PDF - Published Version
Date of publication of this fulltext: 18 Apr 2021 12:40


No existing evaluation infrastructure for shared tasks currently supports both reproducible on- and offline experiments. In this work, we present an architecture that ties together both types of experiments with a focus on reproducibility. The readers are provided with a technical description of the infrastructure and details of how to contribute their own experiments to upcoming evaluation tasks.

Owner only: item control page
  1. Homepage UR

University Library

Publication Server


Publishing: oa@ur.de
0941 943 -4239 or -69394

Dissertations: dissertationen@ur.de
0941 943 -3904

Research data: datahub@ur.de
0941 943 -5707

Contact persons