| Published Version Download ( PDF | 1MB) |
A Living Lab Architecture for Reproducible Shared Task Experimentation
Breuer, Timo and Schaer, Philipp (2021) A Living Lab Architecture for Reproducible Shared Task Experimentation. In: Information between Data and Knowledge. Schriften zur Informationswissenschaft, 74. Werner Hülsbusch, Glückstadt, pp. 348-362. ISBN 978-3-86488-172-5.Date of publication of this fulltext: 18 Apr 2021 12:40
Book section
DOI to cite this document: 10.5283/epub.44953
Abstract
No existing evaluation infrastructure for shared tasks currently supports both reproducible on- and offline experiments. In this work, we present an architecture that ties together both types of experiments with a focus on reproducibility. The readers are provided with a technical description of the infrastructure and details of how to contribute their own experiments to upcoming evaluation tasks.
Involved Institutions
Details
| Item type | Book section |
| ISBN | 978-3-86488-172-5 |
| Title of Book: | Information between Data and Knowledge |
|---|---|
| Publisher: | Werner Hülsbusch |
| Place of Publication: | Glückstadt |
| Other Series: | Schriften zur Informationswissenschaft |
| Volume: | 74 |
| Page Range: | pp. 348-362 |
| Date | 2021 |
| Additional Information (public) | Session 6: Emerging Technologies |
| Institutions | Languages and Literatures > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff) Informatics and Data Science > Department Human-Centered Computing > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff) |
| Keywords | reproducibility; evaluation infrastructure; shared tasks |
| Dewey Decimal Classification | 000 Computer science, information & general works > 020 Library & information sciences |
| Status | Published |
| Refereed | Yes, this version has been refereed |
| Created at the University of Regensburg | No |
| URN of the UB Regensburg | urn:nbn:de:bvb:355-epub-449533 |
| Item ID | 44953 |
Export bibliographical data
Owner only: item control page
Download Statistics
Download Statistics