Less is more: optimizing classification performance through feature selection in a very-high-resolution remote sensing object-based urban application

This study evaluates the impact of four feature selection (FS) algorithms in an object-based image analysis framework for very-high-resolution land use-land cover classification. The selected FS algorithms, correlation-based feature selection, mean decrease in accuracy, random forest (RF) based recursive feature elimination, and variable selection using random forest, were tested on the extreme gradient boosting, support vector machine, K-nearest neighbor, RF, and recursive partitioningclassifiers, respectively. The results demonstrate that the selection of an appropriate FS method can be crucial to the performance of a machine learning classifier in terms of accuracy but also parsimony. In this scope, we propose a new metric to perform model selection named classification optimization score (COS) that rewards model simplicity and indirectly penalizes for increased computational time and processing requirements using the number of features for a given classification model as a surrogate. Our findings suggest that applying rigorous FS along with utilizing the COS metric may significantly reduce the processing time and the storage space while at the same time producing higher classification accuracy than using the initial dataset.