13 papers · ranked by Valyu relevance
Harsh Vardhan, Da Wang
Distributed high dimensional mean estimation is a common aggregation routine used often in distributed optimization methods. Most of these applications call for a communicationconstrained setting where vectors, whose mean is to be estimated, have to be compressed before sharing. One could independently encode and…
S. Das, Subhrakanti Dey
—Compression techniques are essential in distributed optimization and learning algorithms with high-dimensional model parameters, particularly in scenarios with tight communication constraints such as limited bandwidth. This article presents a communication-efficient second-order distributed optimization algorithm…
Yuzhu Duan, Ziwen Yang, Xiaoming Duan, Shanying Zhu
This paper designs a communication-efficient distributed optimization algorithm for optimization problems subject to coupled equality constraints. By means of duality theory, the original problem is reformulated to tackle the coupled equality constraints. Furthermore, compressed communication is employed to enhance…
Haonan Wang, Minghui Liwang, Yiguang Hong, Karl H. Johansson + 1 more
In this paper, we propose a unified compression algorithm for distributed nonconvex opitmization with both the locally- and globally-bounded communication compressors, including 1-bit compressors, saturating quantizers, and the globally-bounded compressors with both relative and absolute compression errors, as well as…
Aygün, Ozan, Ozyilkan, Ezgi + 2 more
—The diamond relay channel, where a source communicates with a destination via two parallel relays, is one of the canonical models for cooperative communications. We focus on the primitive variant, where each relay observes a noisy version of the source signal and forwards a compressed description over an orthogonal…
Wenxiang Lin, Xinglin Pan, Ruibo Fan, Shaohuai Shi + 1 more
Communication has emerged as a critical bottleneck in the distributed training of large language models (LLMs). While numerous approaches have been proposed to reduce communication overhead, the potential of lossless compression has remained largely underexplored since compression and decompression typically consume…
Jiamin Wang, Zhijing Ye, Xiaodong Yu
Collective communication is a major bottleneck for multi-node GPU workloads in scientific computing and distributed deep learning, especially when inter-node bandwidth is limited. Although NCCL provides optimized GPU-centric collectives, large messages can still dominate end-to-end performance. Existing…
K. K. Krishnan Namboodiri, Elizabath Peter, Derya Malak, Petros Elia
—This work establishes the fundamental limits of the classical problem of multi-user distributed computing of linearly separable functions. In particular, we consider a distributed computing setting involving L users, each requesting a linearly separable function over K basis subfunctions from a master node, who is…
Yulong Zhang, Ying Cui, Zili Meng, Abhishek Kumar + 1 more
—Large-scale video streaming events attract millions of simultaneous viewers, stressing existing delivery infrastructures. Client-driven adaptation reacts slowly to shared congestion, while server-based coordination introduces scalability bottlenecks and single points of failure. We present COMETS, a coordinated…
Javad Maheri, K. K. Krishnan Namboodiri, Petros Elia
We consider a distributed computing system in which a master node coordinates $N$ workers to evaluate a function over $n$ input files, where this function accepts general decomposition. In particular, we focus on the general case where the requested function admits a $d$-uniform decomposition, meaning that it can be…
Zhouxiang Zhao, Zhaohui Yang, Mingzhe Chen, Chen Zhu + 1 more
—Visible light communication (VLC) is emerging as a key technology for future wireless communication systems due to its unique physical-layer advantages over traditional radio-frequency (RF)-based systems. However, its integration with higher-layer techniques, such as semantic communication, remains underexplored. This…
Qiaoling Zhang, Changlu Lin, Minquan Cheng
Coded caching and device-to-device (D2D) communication are two effective techniques for alleviating network traffic. Secure transmission and file privacy have also become critical concerns in these domains. However, prevailing coded caching schemes typically assume that a user's cached content is inaccessible to…
Boyu Han, Xu Du, Karl H. Johansson, Apostolos I. Rikos
Distributed optimization offers significant advantages over centralized methods in terms of scalability and robustness when solving large-scale problems. In this paper, we propose a novel decentralized optimization algorithm that integrates Inexact Consensus ADMM (IC-ADMM) with a finite-time decentralized quantized…