Quality Indicators for Text Data

Zusammenfassung
Textual data sets vary in terms of quality. They have different characteristics such as the average sentence length or the amount of spelling mistakes and abbreviations. These text characteristics have influence on the quality of text mining results. They may be measured automatically by means of quality indicators. We present indicators, which we implemented based on natural language processing libraries such as Stanford CoreNLP2 and NLTK3. We discuss design decisions in the implementation of exemplary indicators and provide all indicators on GitHub4. In the evaluation, we investigate free texts from production, news, prose, tweets and chat data and show that the suggested indicators predict the quality of two text mining modules.
  • Vollständige Referenz
  • BibTeX
Kiefer, C., (2019). Quality Indicators for Text Data. In: Meyer, H., Ritter, N., Thor, A., Nicklas, D., Heuer, A. & Klettke, M. (Hrsg.), BTW 2019 – Workshopband. Gesellschaft für Informatik, Bonn. (S. 145-154). DOI: 10.18420/btw2019-ws-15
@inproceedings{mci/Kiefer2019,
author = {Kiefer, Cornelia},
title = {Quality Indicators for Text Data},
booktitle = {BTW 2019 – Workshopband},
year = {2019},
editor = {Meyer, Holger AND Ritter, Norbert AND Thor, Andreas AND Nicklas, Daniela AND Heuer, Andreas AND Klettke, Meike} ,
pages = { 145-154 } ,
doi = { 10.18420/btw2019-ws-15 },
publisher = {Gesellschaft für Informatik, Bonn},
address = {}
}
DateienGroesseFormatAnzeige
C2-5.pdf199.5Kb PDF Öffnen

Sollte hier kein Volltext (PDF) verlinkt sein, dann kann es sein, dass dieser aus verschiedenen Gruenden (z.B. Lizenzen oder Copyright) nur in einer anderen Digital Library verfuegbar ist. Versuchen Sie in diesem Fall einen Zugriff ueber die verlinkte DOI: 10.18420/btw2019-ws-15

Haben Sie fehlerhafte Angaben entdeckt? Sagen Sie uns Bescheid: Feedback abschicken