14 papers · ranked by Valyu relevance
Junhao Cai, Taegun An, Chengjun Jin, Sung Il Choi + 2 more
Distributed multi-stage image compression—where visual content traverses multiple processing nodes under varying quality requirements—poses challenges. Progressive methods enable bitstream truncation but underutilize available compute resources; successive compression repeats costly pixel-domain operations and suffers…
Kumar Viswanatha, Sharadh Ramaswamy, Ankur Saxena, Emrah Akyol + 1 more
'Kenneth Rose'] This paper considers the problem of distributed source coding for a large network. A major obstacle that poses an existential threat to practical deployment of conventional approaches to distributed coding is the exponential growth of the decoder complexity with the number of sources and the encoding…
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
—Communication overhead is one of the major performance bottlenecks in large-scale distributed computing systems, in particular for machine learning applications. Conventionally, compression techniques are used to reduce the load of communication by combining intermediate results of the same computation task as much as…
Derya Malak, Ali Tajer
Kolmogorov's representation theorem provides a framework for decomposing any arbitrary realvalued, multivariate, and continuous function into a two-layer nested superposition of a finite number of functions. The functions at these two layers, are referred to as the inner and outer functions with the key property that…
Yuzhu Duan, Ziwen Yang, Xiaoming Duan, Shanying Zhu
This paper designs a communication-efficient distributed optimization algorithm for optimization problems subject to coupled equality constraints. By means of duality theory, the original problem is reformulated to tackle the coupled equality constraints. Furthermore, compressed communication is employed to enhance…
Prathamesh Mayekar
A Thesis by Prathamesh Mayekar under the Guidance of Himanshu Tyagi Electrical Communication Engineering Indian Institute of Science Bangalore – 560 012, INDIA April 2022 ©Prathamesh Mayekar April 2022 All rights reserved TO Aai, Baba, and Kshitij []
Konstantinos Konstantinidis, Aditya Ramamoorthy
—Many big data algorithms executed on MapReducelike systems have a shuffle phase that often dominates the overall job execution time. Recent work has demonstrated schemes where the communication load in the shuffle phase can be traded off for the computation load in the map phase. In this work, we focus on a class of…
Jer Shyuan Ng, Wei Yang Bryan Lim, Nguyen Cong Luong, Zehui Xiong + 4 more
'Alia Asheralieva' 'Dusit Niyato' 'Cyril Leung' 'Chunyan Miao'] Abstract—Distributed computing has become a common approach for large-scale computation of tasks due to benefits such as high reliability, scalability, computation speed, and costeffectiveness. However, distributed computing faces critical issues related…
Lalitha Sankar, H. Vincent Poor
— A problem of distributed state estimation at multiple agents that are physically connected and have competitive interests is mapped to a distributed source coding problem with additional privacy constraints. The agents interact to estimate their own states to a desired fidelity from their (sensor) measurements which…
Qifa Yan, Sheng Yang, Michele Wigger
—This paper investigates distributed computing systems where computations are split into "Map" and "Reduce" functions. A new coded scheme, called distributed computing and coded communication (D3C), is proposed, and its communication load is analyzed as a function of the available storage space and the number of…
Canran Wang, Netanel Raviv
—We consider the problem of encoding information in a system of N = K + R processors that operate in a decentralized manner, i.e., without a central processor which orchestrates the operation. The system involves K source processors, each holding some data modeled as a vector over a finite field. The remaining R…
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
More specifically, a general distributed computing framework, motivated by commonly used structures like MapReduce, is considered, where the overall computation is decomposed into computing a set of "Map" and "Reduce" functions distributedly across multiple computing nodes. A coded scheme, named "Coded Distributed…
Haoning Chen, Minquan Cheng, Zhenhao Huang, Youlong Wu
Computation Cost Authors: ['Haoning Chen' 'Minquan Cheng' 'Zhenhao Huang' 'Youlong Wu'] Abstract—The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate…
Yahya H. Ezzeldin, Mohammed Karmoose, Christina Fragouli
—In this paper, we revisit the communication vs. distributed computing trade-off, studied within the framework of MapReduce in [1]. An implicit assumption in the aforementioned work is that each server performs all possible computations on all the files stored in its memory. Our starting observation is that, if servers…