15 papers · ranked by Valyu relevance
Ji Liu, Stephen J. Wright
The randomized Kaczmarz (RK) algorithm is a simple but powerful approach for solving consistent linear systems Ax = b. This paper proposes an accelerated randomized Kaczmarz (ARK) algorithm with better convergence than the standard RK algorithm on ill conditioned problems. The per-iteration cost of RK and ARK are…
Dirk A. Lorenz, Thomas Pock
In this paper, we propose an inertial forward backward splitting algorithm to compute a zero of the sum of two monotone operators, with one of the two operators being co-coercive. The algorithm is inspired by the accelerated gradient method of Nesterov, but can be applied to a much larger class of problems including…
Roberto Carrasco, Enzo Meneses, Héctor Ferrada, Cristóbal A. Navarro + 1 more
In recent years, applications such as real-time simulations, autonomous systems, and video games increasingly demand the processing of complex geometric models under stringent time constraints. Traditional geometric algorithms, including the convex hull, are subject to these challenges. A common approach to improve…
Palma London, Shai Vardi, Adam Wierman, Hanling Yi
This paper presents an acceleration framework for packing linear programming problems where the amount of data available is limited, i.e., where the number of constraints m is small compared to the variable dimension n. The framework can be used as a black box to speed up linear programming solvers dramatically, by two…
Yu-Wen Chen, Antonio Orvieto, Aurélien Lucchi
Derivative-free optimization (DFO) has recently gained a lot of momentum in machine learning, spawning interest in the community to design faster methods for problems where gradients are not accessible. While some attention has been given to the concept of acceleration in the DFO literature, existing stochastic…
Soheil Shahrouz, Saber Salehkaleybar, Matin Hashemi
—Given a social network modeled as a weighted graph G, the influence maximization problem seeks k vertices to become initially influenced, to maximize the expected number of influenced nodes under a particular diffusion model. The influence maximization problem has been proven to be NP-hard, and most proposed solutions…
Michael Zargham, Alejandro Ribeiro, Ali Jadbabaie
—We develop an Accelerated Back Pressure (ABP) algorithm using Accelerated Dual Descent (ADD), a distributed approximate Newton-like algorithm that only uses local information. Our construction is based on writing the backpressure algorithm as the solution to a network feasibility problem solved via stochastic dual…
Shengjun Zhang, Colleen P. Bailey
—This paper investigates accelerating the convergence of distributed optimization algorithms on non-convex problems. We propose a distributed primal-dual stochastic gradient descent (SGD) equipped with "powerball" method to accelerate. We show that the proposed algorithm achieves the linear speedup convergence rate…
Yangyang Xu
Motivated by big data applications, first-order methods have been extremely popular in recent years. However, naive gradient methods generally converge slowly. Hence, much efforts have been made to accelerate various first-order methods. This paper proposes two accelerated methods towards solving structured linearly…
Zixuan Li, Mingxing Duan, Huizhang Luo, Wangdong Yang + 2 more
Using GPU Tensor Cores Authors: ['Zixuan Li' 'Mingxing Duan' 'Huizhang Luo' 'Wangdong Yang' 'Kenli Li' 'Keqin Li'] Abstract—Sparse tensors are prevalent in real-world applications, often characterized by their large-scale, high-order, and highdimensional nature. Directly handling raw tensors is impractical due to the…
Shan Haoxuan, Guo, Cong, Wei + 6 more
—The rapid scaling of large language models demands more efficient hardware. Quantization offers a promising trade-off between efficiency and performance. With ultra-low-bit quantization, there are abundant opportunities for results reuse, and thus it can be boosted with lookup tables (LUTs) based acceleration.…
Matti Karppa, Petteri Kaski
We study the problem of multiplying two bit matrices with entries either over the Boolean algebra (0, 1, ∨, ∧) or over the binary field (0, 1, +, ·). We engineer high-performance open-source algorithm implementations for contemporary multiple-accelerator shared-memory architectures, with the objective of…
Salim Farah, Magdy Bayoumi
Traffic simulation software is becoming increasingly popular as more cities worldwide use it to better manage their crowded traffic networks. An important requirement for such software is the ability to produce accurate results in real time, requiring great computation resources. This work proposes an ASIC-based…
Pengcheng Yao
—Graph-specific computing with the support of dedicated accelerator has greatly boosted the graph processing in both efficiency and energy. Nevertheless, their data conflict management is still sequential in essential when some vertex needs a large number of conflicting updates at the same time, leading to prohibitive…
Shubhendra Pal Singhal, M. Srıdevı
—Optimization of searching the best possible action depending on various states like state of environment, system goal etc. has been a major area of study in computer systems. In any search algorithm, searching best possible solution from the pool of every possibility known can lead to the construction of the whole…