15 papers · ranked by Valyu relevance
Jarne Mathi Decker
This thesis investigates the impact of overcoming this limitation by engineering a comprehensive feature set to explicitly characterize the algorithms themselves. We combine static code metrics, Abstract Syntax Tree properties, behavioral performance landmarks, and high-level conceptual features. We evaluate two…
Alexander David Goldie, Zilin Wang, Jaron Cohen, Jakob Foerster + 1 more
The process of meta-learning algorithms from data, instead of relying on manual design, is growing in popularity as a paradigm for improving the performance of machine learning systems. Meta-learning shows particular promise for reinforcement learning (RL), where algorithms are often adapted from supervised or…
Mohammadjavad Azizi, Branislav Kveton, Mohammad Ghavamzadeh, Sumeet Katariya
'Sumeet Katariya'] We develop a meta-learning framework for simple regret minimization in bandits. In this framework, a learning agent interacts with a sequence of bandit tasks, which are sampled i.i.d. from an unknown prior distribution, and learns its meta-parameters to perform better on future tasks. We propose the…
Haipeng Luo, Mengxiao Zhang, Peng Zhao, Zhi‐Hua Zhou
We consider the problem of combining and learning over a set of adversarial bandit algorithms with the goal of adaptively tracking the best one on the fly. The CORRAL algorithm of Agarwal et al. (2017) and its variants (Foster et al., 2020a) achieve this goal with a regret overhead of order Oe( √ MT) where M is the…
David M. Bossens, Danesh Tarapore
Quality-Diversity (QD) algorithms evolve behaviourally diverse and high-performing solutions. To illuminate the elite solutions for a space of behaviours, QD algorithms require the definition of a suitable behaviour space. If the behaviour space is high-dimensional, a suitable dimensionality reduction technique is…
Moncef Garouani
—Considerable progress has been made in the recent literature studies to tackle the Algorithms Selection and Parametrization (ASP) problem, which is diversified in multiple meta-learning setups. Yet there is a lack of surveys and comparative evaluations that critically analyze, summarize and assess the performance of…
Zeyuan Ma, Hongshu Guo, Yue-Jiao Gong, Jun Zhang + 1 more
Meta-Black-Box-Optimization Authors: ['Zeyuan Ma' 'Hongshu Guo' 'Yue-Jiao Gong' 'Jun Zhang' 'Kay Chen Tan'] Abstract—In this survey, we introduce Meta-Black-Box-Optimization (MetaBBO) as an emerging avenue within the Evolutionary Computation (EC) community, which incorporates Meta-learning approaches to assist…
Jianyi Yang, Pengfei Li, Adam Wierman, Shaolei Ren
Online Budgeted Matching (OBM) is a classic problem with important applications in online advertising, online service matching, revenue management, and beyond. Traditional online algorithms typically assume a small bid setting, where the maximum bid-to-budget ratio (κ) is infinitesimally small. While recent algorithms…
Yukun Du, Haiyue Yu, Jiang Jiang, Shuaiwen Tang + 4 more
Existing Meta-Black-Box Optimization (MetaBBO) methods focus on how to search when controlling optimizers, but largely overlook where to search. We propose MetaSG-SAEA, a bi-level MetaBBO framework for expensive constrained multi-objective optimization problems (ECMOPs), in which a meta-policy provides search guidance…
Zechuan Huang, Zhiguang Cao, Hongshu Guo, Yue-Jiao Gong + 1 more
Meta-Black-Box Optimization (MetaBBO) is an emerging avenue within Optimization community, where algorithm design policy could be meta-learned by reinforcement learning to enhance optimization performance. So far, the reward functions in existing MetaBBO works are designed by human experts, introducing certain design…
Soumitri Chattopadhyay, Aritra Marik, Rishav Pramanik
Metaheuristic algorithms are methods devised to efficiently solve computationally challenging optimization problems. Researchers have taken inspiration from various natural and physical processes alike to formulate meta-heuristics that have successfully provided near-optimal or optimal solutions to several engineering…
Hesam Jalalian, Rafael M. O. Cruz
pipelines Authors: ['Hesam Jalalian' 'Rafael M. O. Cruz'] Abstract—Dynamic Selection (DS), where base classifiers are chosen from a classifier's pool for each new instance at test time, has shown to be highly effective in pattern recognition. However, instability and redundancy in the classifier pools can impede…
Darren Zhu, Daren Ler
Meta-learning for algorithm selection relies on a meta-dataset in which each row corresponds to a supervised learning dataset described by meta-features and labelled with a target value that is associated with algorithm choice (typically, some function of algorithm performance). A persistent limitation is that the…
Manh Hung Nguyen, Lisheng Sun-Hosoya, Isabelle Guyon
Selection Authors: ['Manh Hung Nguyen' 'Lisheng Sun-Hosoya' 'Isabelle Guyon'] Training a large set of machine learning algorithms to convergence in order to select the best-performing algorithm for a dataset is computationally wasteful. Moreover, in a budget-limited scenario, it is crucial to carefully select an…
Avelino, Juscimara G., Cavalcanti, George D. C. + 2 more
Imbalanced problems are prevalent in various real-world scenarios and are extensively explored in classification tasks. However, they also present challenges for regression tasks due to the rarity of certain target values. A common alternative is to employ balancing algorithms in preprocessing to address dataset…