Direkt zum Inhalt

Hellwig, Nils Constantin ; Fehle, Jakob ; Kruschwitz, Udo ; Wolff, Christian

LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction

Book section

Hellwig, Nils Constantin , Fehle, Jakob , Kruschwitz, Udo and Wolff, Christian (2026) LLM-as-an-Annotator: Training Lightweight Models with LLM-Annotated Examples for Aspect Sentiment Tuple Prediction. In: Piperidis, Stelios and Bel, Núria and van den Heuvel, Henk and Ide, Nancy and Krek, Simon and Toral, Antonio, (eds.) Proceedings of the Fifteenth Language Resources and Evaluation Conference (LREC 2026). European Language Resources Association (ELRA), Paris, pp. 7955-7972. ISBN 978-2-493814-49-4.

DOI to cite this document: 10.5283/epub.79458


Abstract

Training models for Aspect-Based Sentiment Analysis (ABSA) tasks requires manually annotated data, which is expensive and time-consuming to obtain. This paper introduces LA-ABSA, a novel approach that leverages Large Language Model (LLM)-generated annotations to fine-tune lightweight models for complex ABSA tasks. We evaluate our approach on five datasets for Target Aspect Sentiment Detection ...

Training models for Aspect-Based Sentiment Analysis (ABSA) tasks requires manually annotated data, which is expensive and time-consuming to obtain. This paper introduces LA-ABSA, a novel approach that leverages Large Language Model (LLM)-generated annotations to fine-tune lightweight models for complex ABSA tasks. We evaluate our approach on five datasets for Target Aspect Sentiment Detection (TASD) and Aspect Sentiment Quad Prediction (ASQP). Our approach outperformed previously reported augmentation strategies and achieved competitive performance with LLM-prompting in low-resource scenarios, while providing substantial energy efficiency benefits. For example, using 50 annotated examples for in-context learning (ICL) to guide the annotation of unlabeled data, LA-ABSA achieved an F1 score of 49.85 for ASQP on the SemEval Rest16 dataset, closely matching the performance of ICL prompting with Gemma-3-27B (51.10), while requiring significantly lower computational resources.



Involved Institutions


Details

Item typeBook section
ISBN978-2-493814-49-4
Title of BookProceedings of the Fifteenth Language Resources and Evaluation Conference (LREC 2026)
PublisherEuropean Language Resources Association (ELRA)
Open Access TypeCC-License
Place of PublicationParis
Page Rangepp. 7955-7972
Date14 May 2026
Date of publication20 May 2026 06:46
InstitutionsLanguages and Literatures > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Informatics and Data Science > Department Human-Centered Computing > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)

Languages and Literatures > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Informationswissenschaft (Prof. Dr. Udo Kruschwitz)
Informatics and Data Science > Department Human-Centered Computing > Lehrstuhl für Informationswissenschaft (Prof. Dr. Udo Kruschwitz)
Identification Number
ValueType
10.63317/43srcdyc52cdDOI
KeywordsAspect-Based Sentiment Analysis, Large Language Models, Data Annotation, NLP, ABSA, LLMs
Dewey Decimal Classification000 Computer science, information & general works > 004 Computer science
000 Computer science, information & general works > 020 Library & information sciences
StatusPublished
RefereedYes, this version has been refereed
Created at the University of RegensburgYes
URN of the UB Regensburgurn:nbn:de:bvb:355-epub-794584
Item ID79458

Export bibliographical data

Owner only: item control page

nach oben