Direkt zum Inhalt

Schütz, Mina

Detection and Identification of Fake News: Binary Content Classification with Pre-trained Language Models

Book section

Schütz, Mina (2021) Detection and Identification of Fake News: Binary Content Classification with Pre-trained Language Models. In: Information between Data and Knowledge. Schriften zur Informationswissenschaft, 74. Werner Hülsbusch, Glückstadt, pp. 422-431. ISBN 978-3-86488-172-5.

DOI to cite this document: 10.5283/epub.44959


Abstract

Fake news has emerged as a critical problem for society and professional journalism. Many individuals consume their news via online media, such as social networks and news websites. Therefore, the demand for automatic fake news detection is increasing. There is still no agreed upon definition for fake news, since it can include various concepts, such as clickbait, propaganda, satire, hoaxes, and ...

Fake news has emerged as a critical problem for society and professional journalism. Many individuals consume their news via online media, such as social networks and news websites. Therefore, the demand for automatic fake news detection is increasing. There is still no agreed upon definition for fake news, since it can include various concepts, such as clickbait, propaganda, satire, hoaxes, and rumors. This results in a broad landscape of machine learning approaches, which have a varying accuracy in detecting fake news. This masterthesis focused on a binary content-based classification approach, with a bidirectional Transformer ( BERT ), to detect fake news in online articles. BERT creates a pretrained language model during training and is fine-tuned on a labeled dataset. The FakeNewsNet dataset is used to test two variants of the model (cased / uncased) with articles, using only the body text, the title, and a concatenation of both. Additionally, both models were tested with different preprocessing steps. The models gain in all 29 carried out experiments high accuracy results, without overfitting. Using the body text and the concatenation resulted in five models with an accuracy of 87% after testing, whereas using only titles resulted in 84%. This shows that short statements could be already enough for fake news detection using language models. Also, the preprocessing steps seem to have no major impact on the predictions. It is concluded that transformer models, such as BERT , are a promising approach to detect fake news, since it achieves notable results, even without using a large dataset.


Involved Institutions


Details

Item typeBook section
ISBN978-3-86488-172-5
Title of BookInformation between Data and Knowledge
PublisherWerner Hülsbusch
Open Access TypeIndividuel Contract
Place of PublicationGlückstadt
Other SeriesSchriften zur Informationswissenschaft
Volume74
Page Rangepp. 422-431
Date2021
Date of publication18 Apr 2021 13:29
Additional Information (public)Gerhard Lustig Award Papers
InstitutionsLanguages and Literatures > Institut für Information und Medien, Sprache und Kultur (I:IMSK) > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Informatics and Data Science > Department Human-Centered Computing > Lehrstuhl für Medieninformatik (Prof. Dr. Christian Wolff)
Keywordsfake news; fake news detection; BERT; transformer; pre-trained language model; binary classification
Dewey Decimal Classification000 Computer science, information & general works > 020 Library & information sciences
StatusPublished
RefereedYes, this version has been refereed
Created at the University of RegensburgNo
URN of the UB Regensburgurn:nbn:de:bvb:355-epub-449597
Item ID44959

Export bibliographical data

Owner only: item control page

nach oben