14 papers · ranked by Valyu relevance
Zhou, Zhijian, Tian, Xunye + 10 more
To adapt kernel two-sample and independence testing to complex structured data, aggregation of multiple kernels is frequently employed to boost testing power compared to single-kernel tests. However, we observe a phenomenon that directly maximizing multiple kernel-based statistics may result in highly similar kernels…
Yixi Chen, Weixuan Liang, Tianrui Liu, Junjie Huang + 3 more
Kernel power k-means (KPKM) leverages a family of means to mitigate local minima issues in kernel k-means. However, KPKM faces two key limitations: (1) the computational burden of the full kernel matrix restricts its use on extensive data, and (2) the lack of authentic centroid-sample assignment learning reduces its…
Tanner, John, Davies, Nicholas + 12 more
1 Centre for Quantum Information, Simulation and Algorithms, The University of Western Australia, 35 Stirling Hwy, Crawley WA, 6009, Australia 2 Pawsey Supercomputing Centre, 1 Bryce Avenue, Kensington WA, 6151, Australia 3 School of Physics, Mathematics and Computing, The University of Western Australia, 35 Stirling…
Md Ashad Alam
RKUM is an R package developed for implementing robust kernel-based unsupervised methods. It provides functions for estimating the robust kernel covariance operator (CO) and the robust kernel cross-covariance operator (CCO) using generalized loss functions instead of the conventional quadratic loss. These operators…
Congwei Song
This paper proposes a general machine learning framework called the localization method, which is fundamentally built on two core concepts: localization kernels and local means -- key components that underpin the self-attention mechanism. To establish a rigorous theoretical foundation, the framework is formally defined…
SeungYun Han, Fei Xia, Sylvain Gigan, Bruno Loureiro + 1 more
Optical kernel machines offer high throughput and low latency. A nonlinear optical kernel can handle complex nonlinear data, but power consumption is typically high with the conventional nonlinear optical approach. To overcome this issue, we present an optical kernel with structural nonlinearity that can be…
Yang Cao, Sikun Yang, Kai He, Wenjun Ma + 3 more
Measuring similarity between incomplete data is a fundamental challenge in web mining, recommendation systems, and user behavior analysis. Traditional approaches either discard incomplete data or perform imputation as a preprocessing step, leading to information loss and biased similarity estimates. This paper presents…
Anant Agnihotri, Michael Krebsbach, Florentin Reiter, Thomas Wellens
Quantum support vector machines are classification algorithms that rely on quantum-generated kernels. The fidelity quantum kernel commonly used in quantum support vector machines suffers from exponential concentration as system size increases, preventing an efficient scaling beyond fewqubit systems. We introduce the…
Chiraag Kaushik, Justin Romberg, Vidya Muthukumar
We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function k(·, ·). Our approach uses decoupling results for U-statistics and the non-commutative Khintchine inequality to obtain upper and lower bounds depending only on scalar…
Md Shafiqul Islam, Shakti P. Padhy, Douglas Allaire, Raymundo Arróyave
Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains one of the most challenging and computationally expensive steps in probabilistic…
Islam, Mohammad Tariqul, Liu, Du + 2 more
Centered kernel alignment (CKA) is a popular metric for comparing representations, determining equivalence of networks, and neuroscience research. However, CKA does not account for the underlying manifold and relies on numerous heuristics that cause it to behave differently at different scales of data. In this work, we…
Álvaro Sánchez-Paniagua Ríos, Juan P. Llerena, Alberto Lastra, Nuria Torrado + 1 more
The performance of Support Vector Machines (SVMs) critically depends on the kernel function choice, which enables implicit mapping of data into high-dimensional feature spaces. While classical kernels like Radial Basis Function (RBF) remain popular, orthogonal polynomial kernels offer mathematically interpretable…
Roozbeh Gharakhloo, Maksim Kosmakov, Kenta Miyahara
In this article, we derive explicit formulae expressing multiple orthogonal polynomials in terms of standard orthogonal polynomials. We treat both the real-line and unit-circle settings: multiple orthogonal polynomials on the real line (MOPRL) are reduced to orthogonal polynomials on the real line (OPRL), while…
Rui Liu, Jan Hannig, J. S. Marron
Smoothing methods find signals in noisy data. A challenge for Statistical inference is the choice of smoothing parameter. SiZer addressed this challenge in one-dimension by detecting significant slopes across multiple scales, but was not a completely valid testing procedure. This was addressed by the development of an…