Direkt zum Inhalt

Achmann-Denkler, Michael ; Haim, Mario ; Wolff, Christian

Posts Talk Policy, Stories Don’t: Policy-Issue Detection on Instagram with Fine-Tuned Transformers and Prompted LLMs

Achmann-Denkler, Michael , Haim, Mario und Wolff, Christian (2026) Posts Talk Policy, Stories Don’t: Policy-Issue Detection on Instagram with Fine-Tuned Transformers and Prompted LLMs. In: The 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026), Co-located with LREC 2026 — 11–16 May 2026, Palma de Mallorca, Spain.

Veröffentlichungsdatum dieses Volltextes: 20 Mai 2026 07:40
Konferenz- oder Workshop-Beitrag
DOI zum Zitieren dieses Dokuments: 10.5283/epub.79454


Zusammenfassung

Policy issues are central to election campaigns, yet systematic analyses of issue communication on Instagram remain scarce—particularly for ephemeral Stories. We develop and evaluate automated methods for detecting the binary presence of policy issues in Instagram posts and Stories from the 2021 German federal election. Drawing on a gold-standard dataset of 1,357 annotated documents across three ...

Policy issues are central to election campaigns, yet systematic analyses of issue communication on Instagram remain scarce—particularly for ephemeral Stories. We develop and evaluate automated methods for detecting the binary presence of policy issues in Instagram posts and Stories from the 2021 German federal election. Drawing on a gold-standard dataset of 1,357 annotated documents across three textual channels (captions, OCR-extracted image text, and speech transcripts), we compare a fine-tuned German transformer (GBERT) with multiple LLM prompting strategies (zero-shot, few-shot, retrieval-augmented). Both approaches prove effective: GBERT achieves a cross-validated macro F1 of 0.90, closely matched by GPT-o3 under few-shot prompting (0.88). Substantively, policy visibility varies far more by content format than by party: 70% of posts contain policy references compared to only 17% of Stories, a pattern that holds consistently across all eight parties. An exploratory topic model confirms that parties reproduce familiar issue-ownership profiles within the subset of policy-relevant texts. Our results establish binary issue detection as a feasible foundation for studying policy communication in multimodal, ephemeral social media environments.



Beteiligte Einrichtungen


Details

DokumentenartKonferenz- oder Workshop-Beitrag (Paper)
ISBN978-2-493814-76-0
Buchtitel:The 3rd Workshop on Natural Language Processing for Political Sciences (PoliticalNLP 2026) @ LREC 2026
Verlag:European Language Resources Association (ELRA)
Ort der Veröffentlichung:Palma de Mallorca
Seitenbereich:S. 120-130
Datum16 Mai 2026
InstitutionenSprach- und Literatur- und Kulturwissenschaften > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Informatik und Data Science > Fachbereich Menschzentrierte Informatik > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Stichwörter / Keywordspolicy issues, Instagram, political communication, text classification, LLMs, German federal election
Dewey-Dezimal-Klassifikation000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
StatusVeröffentlicht
BegutachtetJa, diese Version wurde begutachtet
An der Universität Regensburg entstandenZum Teil
URN der UB Regensburgurn:nbn:de:bvb:355-epub-794545
Dokumenten-ID79454

Bibliographische Daten exportieren

Nur für Besitzer und Autoren: Kontrollseite des Eintrags

nach oben