Search · four archives
Search · four archives
25 papers · ranked by Valyu relevance
Farkhanda Abbas, Feng Zhang, Muhammad Ismail, Garee Khan + 6 more
'Javed Iqbal' 'Abdulwahed Fahad Alrefaei' 'Mohammed Fahad Albeshr' 'Waheb Abdullah' 'AbdulRahman Alsewari' 'Mario De Oliveira'] Algorithms for machine learning have found extensive use in numerous fields and applications. One important aspect of effectively utilizing these algorithms is tuning the hyperparameters to…
Amala Mary Vincent, P. Jidesh
For any machine learning model, finding the optimal hyperparameter setting has a direct and significant impact on the model’s performance. In this paper, we discuss different types of hyperparameter optimization techniques. We compare the performance of some of the hyperparameter optimization techniques on image…
Christopher Meaney, Xuesong Wang, Jun Guan, Therese A. Stukel
Background Supervised machine learning is increasingly being used to estimate clinical predictive models. Several supervised machine learning models involve hyper-parameters, whose values must be judiciously specified to ensure adequate predictive performance. Objective To compare several (nine) hyper-parameter…
Robert Arbon, Yanchen Zhu, Antonia S. J. S. Mey
Markov state models (MSM) are a popular statistical method for analyzing the conformational dynamics of proteins, including protein folding. With all statistical and machine learning (ML) models choices must be made about the modeling pipeline that cannot be directly learned from the data. These choices, or…
Shashank Shekhar, Adesh Bansode, Asif Salim
—Most of the machine learning models have associated hyper-parameters along with their parameters. While the algorithm gives the solution for parameters, its utility for model performance is highly dependent on the choice of hyperparameters. For a robust performance of a model, it is necessary to find out the right…
Caner Erden, Halil İbrahim Demir, Abdullah Hulusi Kökçam
One of the most critical issues in machine learning is the selection of appropriate hyper parameters for training models. Machine learning models may be able to reach the best training performance and may increase the ability to generalize using hyper parameter optimization (HPO) techniques. HPO is a popular topic that…
Shrooq Alsenan, Isra Al-Turaiki, Mashael Aldayel, Mohamed Tounsi + 1 more
'Yijie Ding'] RNA-binding proteins (RBPs) play an important role in regulating biological processes, such as gene regulation. Understanding their behaviors, for example, their binding site, can be helpful in understanding RBP-related diseases. Studies have focused on predicting RNA binding by means of machine learning…
Mathias Lechner, Ramin Hasani, Philipp Neubauer, Sophie Neubauer + 1 more
'Daniela Rus'] Hyperparameter tuning is a fundamental aspect of machine learning research. Setting up the infrastructure for systematic optimization of hyperparameters can take a significant amount of time. Here, we present PyHopper, a black-box optimization platform designed to streamline the hyperparameter tuning…
Patrick Koch, Oleg Golovidov, Steven D. Gardner, Brett Wujek + 2 more
'Joshua Griffin' 'Yan Xu'] Machine learning applications often require hyperparameter tuning. The hyperparameters usually drive both the efficiency of the model training process and the resulting model quality. For hyperparameter tuning, machine learning algorithms are complex black-boxes. This creates a class of…
Peter Michael Habelitz, Janis Keuper
—We introduce an open source python framework named PHS - Parallel Hyperparameter Search to enable hyperparameter optimization on numerous compute instances of any arbitrary python function. This is achieved with minimal modifications inside the target function. Possible applications appear in expensive to evaluate…
Ankur Sinha, Paritosh Pankaj
—In this paper, we formulate the hyperparameter tuning problem in machine learning as a bilevel program. The bilevel program is solved using a micro genetic algorithm that is enhanced with a linear program. While the genetic algorithm searches over discrete hyperparameters, the linear program enhancement allows hyper…
Geethu Joy, Christian Huyck, Xin‐She Yang
Almost all optimization algorithms have algorithm-dependent parameters, and the setting of such parameter values can largely influence the behaviour of the algorithm under consideration. Thus, proper parameter tuning should be carried out to ensure the algorithm used for optimization may perform well and can be…
Rahib H. Abiyev, Mustafa Tunay
A novel learning algorithm for solving global numerical optimization problems is proposed. The proposed learning algorithm is intense stochastic search method which is based on evaluation and optimization of a hypercube and is called the hypercube optimization (HO) algorithm. The HO algorithm comprises the…
Kazunori D Yamada
In the deep learning era, a gradient descent method is the most common method to optimize parameters of neural networks. Among various mathematical optimization methods, a gradient descent method is the most naive method. Although controlling a learning rate of the method is necessary for quick convergence, the…
Zoe Kutulakos, Patrick Slade
Assistive robotic devices like exoskeletons offer the promise of improving mobility for millions of people. However, developing devices that improve an objective mobility metric is challenging. Human-in-the-loop optimization is a systematic approach for personalizing robotic assistance to maximize a mobility metric…
Adithya Sagar, Rachel LeCover, Christine Shoemaker, Jeffrey Varner
Mathematical modeling is a powerful tool to analyze, and ultimately design biochemical networks. However, the estimation of the parameters that appear in biochemical models is a significant challenge. Parameter estimation typically involves expensive function evaluations and noisy data, making it difficult to quickly…
Mustafa Tunay, Elnaz Pashaei, Elham Pashaei
The hypercube optimization search (HOS) approach is a new efficient and robust metaheuristic algorithm that simulates the dove's movement in quest of new food sites in nature, utilizing hypercubes to depict the search zones. In medical informatics, the classification of medical data is one of the most challenging tasks…
Yifan Wu, Aron Walsh, Alex Ganose
What is the minimum number of experiments, or calculations, required to find an optimal solution? Relevant chemical problems range from identifying a compound with target functionality within a given phase space to controlling materials synthesis and device fabrication conditions. A common feature in this application…
Riley Hickman, Matteo Aldeghi, Alán Aspuru-Guzik
Model-based optimization strategies, such as Bayesian optimization (BO), have been deployed across the natural sciences in design and discovery campaigns due to their sample efficiency and flexibility. The combination of such strategies with automated laboratory equipment and/or high-performance computing in a…
Stephan Grein, David R. Penas, Daniel Weindl, Polina Lakrisenko + 2 more
Dynamic models are central to the computational life sciences but typically contain unknown parameters that must be inferred from experimental data. High-throughput measurements have made this task increasingly challenging, yielding high-dimensional search spaces and non-convex objectives with many local optima. This…
Sterling Baird, Jason R. Hall, Taylor D. Sparks
Would you rather search for a line inside a cube or a point inside a square? Physics-based simulations and wet-lab experiments often have symmetries (degeneracies) that allow reducing problem dimensionality or search space, but constraining these degeneracies is often unsupported or difficult to implement in many…
Fabian Fröhlich, Peter K. Sorger
Ordinary differential equation (ODE) models are widely used to describe biochemical processes, since they effectively represent mass action kinetics. Optimization-based calibration of ODE models on experimental data can be challenging, even for low-dimensional problems. However, reliable model calibration is a…
Sungho Shin, Ophelia Venturelli, Victor M. Zavala
We present a nonlinear programming (NLP) framework for the scalable solution of parameter estimation problems that arise in dynamic modeling of biological systems. Such problems are computationally challenging because they often involve highly nonlinear and stif differential equations as well as many experimental data…
Andre KY Low, Flore Mekki-Berrada, Aleksandr Ostudin, Jiaxun Xie + 7 more
The development of automated high-throughput experimental platforms has enabled fast sampling of high-dimensional decision spaces. To reach target properties efficiently, these platforms are increasingly paired with intelligent experimental design. When solving optimization problems, Bayesian-based optimizers are often…
Changin Oh, Kathleen P. Wilkie
We present the Toroidal Search Algorithm (TSA), a novel population-based metaheuristic optimization method inspired by the topology of a torus. Conventional metaheuristics frequently suffer from boundary stagnation, a phenomenon that severely degrades performance in bounded and high-dimensional search spaces. TSA…