Please use this identifier to cite or link to this item:
|Title:||Comparative assessment of the measures of thematic classification accuracy||Contributor(s):||Liu, Canran (author); Frazier, Paul (author); Kumar, Lalit (author)||Publication Date:||2007||DOI:||10.1016/j.rse.2006.10.010||Handle Link:||https://hdl.handle.net/1959.11/1506||Abstract:||Accuracy assessment of classified imagery is an important task in remote sensing. Various measures have been developed to describe and compare the accuracy of maps and the performance of different classifiers, but the extent to which these measures are consistent with each other is largely unknown. In this paper the consistency of fourteen category-level and twenty map-level accuracy measures was tested on 595 published error matrices using nonparametric correlation coefficients (Spearman's "rho" and Kendall's "tau-b") as well as the probability of concordance. The results show that four groups can be identified for the category-level measures and three groups for map-level measures. The consistency among the measures within a group is generally higher than that among the measures from different groups though all the measures at the same level are highly consistent with each other. We recommend that user's accuracy and producer's accuracy and the overall accuracy should be provided as primary accuracy measures and the two relative entropy change measures and the mutual information normalized by the arithmetic mean of the entropies on map and ground truthing be provided as supplementary measures. The chance-corrected, error matrix-normalized and user's and producer's accuracy-combined measures were found to contain estimation and interpretation problems at both category- and map-levels and are therefore not recommended for general use.||Publication Type:||Journal Article||Source of Publication:||Remote Sensing of Environment, 107(4), p. 606-616||Publisher:||Elsevier||Place of Publication:||New York, United States||ISSN:||0034-4257||Field of Research (FOR):||050299 Environmental Science and Management not elsewhere classified||Peer Reviewed:||Yes||HERDC Category Description:||C1 Refereed Article in a Scholarly Journal||Statistics to Oct 2018:||Visitors: 265
|Appears in Collections:||Journal Article|
School of Environmental and Rural Science
Files in This Item:
checked on Nov 30, 2018
checked on Mar 4, 2019
Items in Research UNE are protected by copyright, with all rights reserved, unless otherwise indicated.