16 papers · ranked by Valyu relevance
Ara Ghukasyan, Jack S. Baker, Oktay Göktaş, Juan Carrasquilla + 1 more
'Santosh Kumar Radha'] As quantum computers become increasingly practical, so does the prospect of using quantum computation to improve upon traditional algorithms. Kernel methods in machine learning is one area where such improvements could be realized in the near future. Paired with kernel methods like support-vector…
Qingzhong Ai, Shiyu Liu, Lirong He, Zenglin Xu
Background: Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the empirical performance. Radial basis function (RBF) kernel with median…
Weiguo Gao
Length Extrapolation Authors: ['Weiguo Gao'] When the predicted sequence length exceeds the length seen during training, the transformer's inference accuracy diminishes. To address these challenges, the ability to generalize or extrapolate to longer sequence lengths has garnered increased attention. Existing relative…
Mourão-Miranda, Janaina, Hussain, Zakria + 6 more
Multiple Kernel Learning (MKL) models combine several kernels in supervised and unsupervised settings to integrate multiple data representations or sources, each represented by a different kernel. MKL seeks an optimal linear combination of base kernels that maximizes a generalized performance measure under a…
Sobom M. Somé, Célestin C. Kokonendji, Smaïl Adjabi, Naushad Ali Mamode Khan + 1 more
'Naushad Ali Mamode Khan' 'Said Beddek'] A modified gamma kernel should not be automatically preferred to the standard gamma kernel, especially for univariate convex densities with a pole at the origin. In the multivariate case, multiple combined gamma kernels, defined as a product of univariate standard and modified…
Rina Su, Yu Guo, Caiying Wu, Qiyu Jin + 1 more
The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy by exploiting interdependencies among multiple kernels based on correlations or…
Junpu Zhang, Liang Li, Siwei Wang, Jiyuan Liu + 3 more
'Xinwang Liu' 'En Zhu'] Clustering is a representative unsupervised method widely applied in multi-modal and multi-view scenarios. Multiple kernel clustering (MKC) aims to group data by integrating complementary information from base kernels. As a representative, late fusion MKC first decomposes the kernels into…
Yan Chen Yan Chen, Liang Du, Lei Duan
—Kernel methods are extensively employed for nonlinear data clustering, yet their effectiveness heavily relies on selecting suitable kernels and associated parameters, posing challenges in advance determination. In response, Multiple Kernel Clustering (MKC) has emerged as a solution, allowing the fusion of information…
Nima Negarandeh, Carlos Mora, Ramin Bostanabad
Gaussian processes (GPs) are powerful probabilistic models that define flexible priors over functions, offering strong interpretability and uncertainty quantification. However, GP models often rely on simple, stationary kernels which can lead to suboptimal predictions and miscalibrated uncertainty estimates, especially…
David Picard
In this paper we propose a new non-linear classifier based on a combination of locally linear classifiers. A well known optimization formulation is given as we cast the problem in a ℓ1 Multiple Kernel Learning (MKL) problem using many locally linear kernels. Since the number of such kernels is huge, we provide a…
Sajad Fathi Hafshejani, Zahra Moberfard
In the last few years, various types of machine learning algorithms, such as Support Vector Machine (SVM), Support Vector Regression (SVR), and Non-negative Matrix Factorization (NMF) have been introduced. The kernel approach is an effective method for increasing the classification accuracy of machine learning…
Theresa Wagner, Franziska Nestler, Martin Stoll
Methods, and Kernel Derivatives Authors: ['Theresa Wagner' 'Franziska Nestler' 'Martin Stoll'] Abstract. One of the main computational bottlenecks when working with kernel based learning is dealing with the large and typically dense kernel matrix. Techniques dealing with fast approximations of the matrix vector product…
Marcus M. Noack, James A. Sethian
Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The mathematical methods we discuss in this paper are an extension of the…
Danlu Zhang, Stephanie M. Eick, Howard H. Chang
Features for Estimating Joint Health Effects of Multiple Exposures Authors: ['Danlu Zhang' 'Stephanie M. Eick' 'Howard H. Chang'] Environmental epidemiology has traditionally focused on examining health effects of single exposures, more recently with adjustment for co-occurring exposures. Advancements in exposure…
James B. Young
The purpose of this review is to introduce the reader to graph kernels and the corresponding literature, with an emphasis on those with direct application to chemoinformatics. Graph kernels are functions that allow for the inference of properties of molecules and compounds, which can help with tasks such as finding…
Minoru Kusaba, Megumi Iwayama, Ryo Yoshida
In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this study, we propose a novel functional output regression model based on kernel…