Direkt zum Inhalt

Restat, Valerie ; Diestelkämper, Indra ; Klettke, Meike ; Störl, Uta

FONDUE - Fine-Tuned Optimization: Nurturing Data Usability & Efficiency

Restat, Valerie, Diestelkämper, Indra, Klettke, Meike und Störl, Uta (2025) FONDUE - Fine-Tuned Optimization: Nurturing Data Usability & Efficiency. Journal of Big Data 12 (1).

Veröffentlichungsdatum dieses Volltextes: 10 Jul 2025 09:04
Artikel
DOI zum Zitieren dieses Dokuments: 10.5283/epub.77126


Zusammenfassung

To provide good results and decisions in data-driven systems, data quality must be ensured as a primary consideration. An important aspect of this is data cleaning. Although many different algorithms and tools already exist for data cleaning, an end-to-end data quality solution is still needed. In this paper, we present FONDUE, our vision of a well-founded end-to-end data quality optimizer. In ...

To provide good results and decisions in data-driven systems, data quality must be ensured as a primary consideration. An important aspect of this is data cleaning. Although many different algorithms and tools already exist for data cleaning, an end-to-end data quality solution is still needed. In this paper, we present FONDUE, our vision of a well-founded end-to-end data quality optimizer. In contrast to many studies that consider data cleaning in the context of machine learning, our approach focuses on various scenarios, such as when preprocessing and downstream analysis are separated. As an adaptive and easily extendable framework, FONDUE operates similarly to proven methods of database query optimization. Analogously, it consists of the following parts: Rule-based optimization, where the appropriate data cleaning algorithms are selected based on use case constraints, optimizer hints in the form of best practices, and cost-based optimization, where the costs are measured in terms of data quality. Accordingly, the result is an optimized data cleaning pipeline. The choice of different optimization goals enables further flexibility, e.g. for environments with limited resources. As a first building block of FONDUE, we present CheDDaR, which is used to detect errors and measure data quality. Both are important tasks for improving data quality with FONDUE.



Beteiligte Einrichtungen


Details

DokumentenartArtikel
Titel eines Journals oder einer ZeitschriftJournal of Big Data
Verlag:Springer
Band:12
Nummer des Zeitschriftenheftes oder des Kapitels:1
Datum23 Mai 2025
InstitutionenInformatik und Data Science > Allgemeine Informatik > Data Engineering (Prof. Dr.-Ing. Meike Klettke)
Identifikationsnummer
WertTyp
10.1186/s40537-025-01158-xDOI
Stichwörter / KeywordsData quality, Data cleaning, Optimization
Dewey-Dezimal-Klassifikation000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
StatusVeröffentlicht
BegutachtetJa, diese Version wurde begutachtet
An der Universität Regensburg entstandenZum Teil
URN der UB Regensburgurn:nbn:de:bvb:355-epub-771261
Dokumenten-ID77126

Bibliographische Daten exportieren

Nur für Besitzer und Autoren: Kontrollseite des Eintrags

nach oben