Search · four archives
Search · four archives
13 papers · ranked by Valyu relevance
Shashank Shekhar, Adesh Bansode, Asif Salim
—Most of the machine learning models have associated hyper-parameters along with their parameters. While the algorithm gives the solution for parameters, its utility for model performance is highly dependent on the choice of hyperparameters. For a robust performance of a model, it is necessary to find out the right…
Sigrid Passano Hellan, Christopher G. Lucas, Nigel Goddard
Transfer learning for Bayesian optimisation has generally assumed a strong similarity between optimisation tasks, with at least a subset having similar optimal inputs. This assumption can reduce computational costs, but it is violated in a wide range of optimisation problems where transfer learning may nonetheless be…
Xilu Wang, Yaochu Jin, Sebastian Schmitt, Markus Olhofer
Bayesian optimization has emerged at the forefront of expensive black-box optimization due to its data efficiency. Recent years have witnessed a proliferation of studies on the development of new Bayesian optimization algorithms and their applications. Hence, this paper attempts to provide a comprehensive and updated…
Eric R. Cole, Mark J. Connolly, Mihir Ghetiya, Mohammad E. S. Sendi + 3 more
To treat neurological and psychiatric diseases with deep brain stimulation, a trained clinician must select parameters for each patient by monitoring their symptoms and side-effects in a months-long trial-and-error process, delaying optimal clinical outcomes. Bayesian optimization has been proposed as an efficient…
Eduardo C. Garrido‐Merchán
Several scenarios require the optimization of non-convex black-box functions, that are noisy expensive to evaluate functions with unknown analytical expression, whose gradients are hence not accessible. For example, the hyper-parameter tuning problem of machine learning models. Bayesian optimization is a class of…
Md Ochiuddin Miah, Umme Habiba, Md Faisal Kabir
Brain-computer interface (BCI) research has gained increasing attention in educational contexts, offering the potential to monitor and enhance students’ cognitive states. Real-time classification of students’ confusion levels using electroencephalogram (EEG) data presents a significant challenge in this domain. Since…
Jaime Carrasco, Fulgencio Lisón, Andrés Weintraub
Traditional Species Distribution Models (SDMs) may not be appropriate when examples of one class (e.g. absence or pseudo-absences) greatly outnumber examples of the other class (e.g. presences or observations), because they tend to favor the learning of observations more frequently. We present an ensemble method called…
Devashish Tripathi, Analabha Basu
Environmental factors play a pivotal role in shaping the genetic and phenotypic diversity among organisms. Understanding the influence of the environment on a biological phenomenon is essential for deciphering the mechanisms resulting in trait differences among organisms. In this study, we present a novel approach…
Ekaterina Noskova, Viacheslav Borovitskiy
Inference of demographic histories of species and populations is one of the central problems in population genetics. It is usually stated as an optimization problem: find a model’s parameters that maximize a certain log-likelihood. This log-likelihood is often expensive to evaluate in terms of time and hardware…
Wenhu Li, Niki van Stein, Thomas Bäck, Elena Raponi
Bayesian optimization (BO) is a powerful class of algorithms for optimizing expensive black-box functions, but designing effective BO algorithms remains a manual, expertise-driven task. Recent advancements in Large Language Models (LLMs) have opened new avenues for automating scientific discovery, including the…
Jonathan Gornet, Yiannis Kantaros, Bruno Sinopoli
—We introduce Hyperparameter Controller (Hyper-Controller), a computationally efficient algorithm for hyperparameter optimization during training of reinforcement learning neural networks. HyperController optimizes hyperparameters quickly while also maintaining improvement of the reinforcement learning neural network…
Park, Joon-Hyun, Cheon, Mujin + 4 more
The performance of Bayesian optimization (BO), a highly sample-efficient method for expensive black-box problems, is critically governed by the selection of its hyperparameters, including the kernel and acquisition functions. This presents a significant practical challenge: an inappropriate combination of these can…
Masaru Sasaki, Ken Takeda, Kota Abe, Masafumi Oizumi
Gromov-Wasserstein optimal transport (GWOT) has emerged as a versatile method for unsupervised alignment in various research areas, including neuroscience, drawing upon the strengths of optimal transport theory. However, the use of GWOT in various applications has been hindered by the difficulty of finding good optima…