| Updated Version Download ( PDF | 437kB) | License: Creative Commons Attribution 4.0 |
Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior
Book section
Schmidt, Thomas, Burghardt, Manuel
and Dennerlein, Katrin
(2018)
Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior.
In: Kübler, Sandra and Zinsmeister, Heike, (eds.)
Proceedings of the Workshop on Annotation in Digital Humanities co-located with ESSLLI 2018 (annDH 2018).
Sofia, Bulgaria, pp. 47-52.
This is the latest version of this item.
Abstract
We present results of a sentiment annotation study in the context of historical German plays. Our annotation corpus consists of 200 representative speeches from the German playwright Gotthold Ephraim Lessing. Six annotators, five non-experts and one expert in the domain, annotated the speeches according to different sentiment annotation schemes. They had to annotate the differentiated polarity ...
We present results of a sentiment annotation study in the context of historical German plays. Our annotation corpus consists of 200 representative speeches from the German playwright Gotthold Ephraim Lessing. Six annotators, five non-experts and one expert in the domain, annotated the speeches according to different sentiment annotation schemes. They had to annotate the differentiated polarity (very negative, negative, neutral, mixed, positive, very positive), the binary polarity (positive/negative) and the occurrence of eight basic emotions. After the annotation, the participants completed a questionnaire about their experience of the annotation process; additional feedback was gathered in a closing interview. Analysis of the annotations shows that the agreement among annotators ranges from low to mediocre. The non-expert annotators perceive the task as very challenging and report different problems in understanding the language and the context. Although fewer problems occur for the expert annotator, we cannot find any differences in the agreement levels among non-experts and between the expert and the non-experts. At the end of the paper, we discuss the implications of this study and future research plans for this area.
Alternative links to fulltext
Involved Institutions
Details
| Item type | Book section |
| Title of Book | Proceedings of the Workshop on Annotation in Digital Humanities co-located with ESSLLI 2018 (annDH 2018) |
| Place of Publication | Sofia, Bulgaria |
| Page Range | pp. 47-52 |
| Date | August 2018 |
| Date of publication | 14 Sep 2020 06:33 |
| Institutions | Languages and Literatures > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff) Informatics and Data Science > Department Human-Centered Computing > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff) |
| Keywords | sentiment analysis, sentiment annotation, drama, annotation, emotion analysis, computational linguistics |
| Dewey Decimal Classification | 000 Computer science, information & general works > 004 Computer science 400 Language > 430 Germanic 800 Literature > 830 Literatures of Germanic languages |
| Status | Published |
| Refereed | Yes, this version has been refereed |
| Created at the University of Regensburg | Partially |
| URN of the UB Regensburg | urn:nbn:de:bvb:355-epub-437018 |
| Item ID | 43701 |
Available versions of this item
-
Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior. (Deposited on 16 Jul 2018 11:50)
- Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior. (Deposited on 14 Sep 2020 06:33) [Currently displayed]
Download Statistics
Download Statistics