High-Dimensional Feature Selection Using Improved Hybrid Breeding Optimization Algorithm with Feature Grouping

Abstract

Feature selection is essential for improving classification performance in high-dimensional biomedical data, yet conventional metaheuristic algorithms often suffer from premature convergence and loss of population diversity. To address these issues, this paper proposes a Feature Grouping and Improved Hybrid Breeding Optimization framework (FGIHBO). First, the original feature space is hierarchically partitioned using the Maximum Relevance Minimum Redundancy criterion and Symmetric Uncertainty analysis to alleviate the curse of dimensionality. Then, a Multi-Strategy Synergistic Improved Hybrid Breeding Optimization (MSIHBO) algorithm is developed by incorporating Grey Wolf Optimizer (GWO) guidance and a Shannon entropy-adaptive simulated annealing mechanism to balance exploration and exploitation. Experimental results on the CEC2022 benchmark suite demonstrate that MSIHBO provides robust optimization performance across diverse problem categories. Furthermore, evaluations on eleven high-dimensional biomedical datasets show that FGIHBO achieves average classification accuracies ranging from 92.77% to 97.66%. Compared with representative algorithms, including Multi-strategy Improved Grey Wolf Optimizer (MIGWO), Hybrid Whale Optimization Algorithm based on Gathering strategy (HWOAG), Dynamic Crow Search Algorithm (DCSA), GWO, Hybrid Breeding Optimization (HBO), Hybrid Breeding Optimization based on Lévy flight and Elite Opposition-Based Learning strategy (LEHBO), and MSIHBO, the proposed framework improves average classification accuracy by 1.47-27.46%, with the largest gain observed on dataset D10 relative to HWOAG. These results confirm the effectiveness, robustness, and scalability of the proposed framework for high-dimensional biomedical feature selection.