Computer-aided Interpretable Features for Leaf Image Classification

Abstract

Plant species identification is time-consuming, costly, and requires lots of effort, and expert knowledge. The studies on medicinal plant identification are often performed based on medicinal plant leaf images. The is because plant leaves contain a large number of diverse sets of features such as shape, veins, edge features, apices, etc. that are useful in identifying different medicinal plants. In recent, many researchers use deep learning methods to classify plants directly using plant images. While deep learning models have achieved great success, the lack of interpretability limits their widespread application. To overcome this, we explore the use of interpretable, measurable, and computer-aided features extracted from plant leaf images. Image processing is one of the most challenging, and crucial steps in feature extraction. The purpose of image processing is to improve the leaf image by removing undesired distortion. The main image processing steps of our algorithm involve: i) Convert original image to RGB (Red-Green-Blue) image, ii) Gray scaling, iii) Gaussian smoothing, iv) Binary thresholding, v) Remove the stalk, vi) Closing holes, and vii) Resize the image. The next step after image processing is to extract features from plant leaf images. We introduced 52 computationally efficient features to classify plant species. These features are mainly classified into four groups as i) shape-based features, ii) color-based features, iii) texture-based features, and iv) scagnostic features. Length, width, area, texture correlation, monotonicity, and scagnostics are to name a few of them. We explore the ability of features to discriminate the classes of interest under supervised learning and unsupervised learning settings. For that, supervised dimensionality reduction technique, Linear Discriminant Analysis (LDA), and unsupervised dimensionality reduction technique, Principal Component Analysis (PCA) are used to convert and visualize the images from digital-image space to feature space. All the applications are performed on Flavia and Swedish open-source benchmark leaf datasets.