Direkt zum Inhalt

Schmidt, Thomas ; Burghardt, Manuel ; Dennerlein, Katrin

Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior

Schmidt, Thomas, Burghardt, Manuel und Dennerlein, Katrin (2018) Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior. In: Kübler, Sandra und Zinsmeister, Heike, (eds.) Proceedings of the Workshop on Annotation in Digital Humanities 2018 (annDH 2018). Sofia, Bulgaria, S. 47-52.

Veröffentlichungsdatum dieses Volltextes: 16 Jul 2018 11:50
Buchkapitel

WarnungEs ist eine neuere Version dieses Eintrags verfügbar.

Zusammenfassung

We present results of a sentiment annotation study in the context of historical German plays. Our annotation corpus consists of 200 representative speeches from the German playwright Gotthold Ephraim Lessing. Six annotators, five non-experts and one expert in the domain, annotated the speeches according to different sentiment annotation schemes. They had to annotate the differentiated polarity ...

We present results of a sentiment annotation study in the context of historical German plays. Our annotation corpus consists of 200 representative speeches from the German playwright Gotthold Ephraim Lessing. Six annotators, five non-experts and one expert in the domain, annotated the speeches according to different sentiment annotation schemes. They had to annotate the differentiated polarity (very negative, negative, neutral, mixed, positive, very positive), the binary polarity (positive/negative) and the occurrence of eight basic emotions. After the annotation, the participants completed a questionnaire about their experience of the annotation process; additional feedback was gathered in a closing interview. Analysis of the annotations shows that the agreement among annotators ranges from low to mediocre. The non-expert annotators perceive the task as very challenging and report different problems in understanding the language and the context. Although fewer problems occur for the expert annotator, we cannot find any differences in the agreement levels among non-experts and between the expert and the non-experts. At the end of the paper, we discuss the implications of this study and future research plans for this area.



Beteiligte Einrichtungen


Details

DokumentenartBuchkapitel
Buchtitel:Proceedings of the Workshop on Annotation in Digital Humanities 2018 (annDH 2018)
Ort der Veröffentlichung:Sofia, Bulgaria
Seitenbereich:S. 47-52
Datum8 August 2018
InstitutionenSprach- und Literatur- und Kulturwissenschaften > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Informatik und Data Science > Fachbereich Menschzentrierte Informatik > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Stichwörter / Keywordssentiment analysis, sentiment annotation, drama, annotation, emotion analysis, computational linguistics
Dewey-Dezimal-Klassifikation000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
400 Sprache > 430 Deutsch
800 Literatur > 830 Deutsche Literatur
StatusVeröffentlicht
BegutachtetJa, diese Version wurde begutachtet
An der Universität Regensburg entstandenZum Teil
URN der UB Regensburgurn:nbn:de:bvb:355-epub-374868
Dokumenten-ID37486

Bibliographische Daten exportieren

Nur für Besitzer und Autoren: Kontrollseite des Eintrags

nach oben