Visual Methods for Analyzing Probabilistic Classification Data

TitleVisual Methods for Analyzing Probabilistic Classification Data
Publication TypeJournal Article
Year of Publication2014
AuthorsAlsallakh, B., A. Hanbury, H. Hauser, S. Miksch, and A. Rauber
JournalIEEE Transactions on Visualization and Computer Graphics
Volume20
Issue12
Pages1703--1712
Date Published12/2014
Keywordsconfusion analysis, feature evaluation and selection, Probabilistic classification, visual inspection.
Abstract

Multi-class classifiers often compute scores for the classification samples describing probabilities to belong to different classes. In order to improve the performance of such classifiers, machine learning experts need to analyze classification results for a large number of labeled samples to find possible reasons for incorrect classification. Confusion matrices are widely used for this purpose. However, they provide no information about classification scores and features computed for the samples. We propose a set of integrated visual methods for analyzing the performance of probabilistic classifiers. Our methods provide insight into different aspects of the classification results for a large number of samples. One visualization emphasizes at which probabilities these samples were classified and how these probabilities correlate with classification error in terms of false positives and false negatives. Another view emphasizes the features of these samples and ranks them by their separation power between selected true and false classifications. We demonstrate the insight gained using our technique in a benchmarking classification dataset, and show how it enables improving classification performance by interactively defining and evaluating post-classification rules.

Notes

to appear

URLhttp://publik.tuwien.ac.at/files/PubDat_229886.pdf
DOI10.1109/TVCG.2014.2346660
AttachmentSize
the visual metaphor546.68 KB
Funding projects: 
CVAST