AarXiv2023

Compression for Distributed Optimization and Timely Updates

Prathamesh Mayekar

Abstract

A Thesis by Prathamesh Mayekar under the Guidance of Himanshu Tyagi Electrical Communication Engineering Indian Institute of Science Bangalore – 560 012, INDIA April 2022 ©Prathamesh Mayekar April 2022 All rights reserved TO Aai, Baba, and Kshitij []

§ The Valyu brief

The paper, in five minutes

Read from the full text via Valyu Contents

The thesis establishes lower bounds and creates optimal quantizers for gradient compression, mean estimation, and timely entropic communication in distributed optimization.

What’s new

i.Information‑theoretic lower bounds for finite‑precision gradient optimization
ii.Fast quantizers that achieve these lower bounds
iii.Efficient estimators for distributed mean estimation using side information
iv.Optimal entropic compression schemes for timely updates

How they did it

The author derives theoretical lower bounds using information theory, then designs quantization and compression algorithms that meet these bounds. Algorithms are analyzed and evaluated within standard first‑order optimization and mean‑estimation frameworks.

What they found

Fast quantizers match the established lower bounds for gradient compression
Efficient estimators improve over state‑of‑the‑art mean‑estimation methods

§ The Valyu brief

Reading the full paper and taking notes. This takes a few seconds…

§ Ask this paper

Ask a question about this paper

Valyu reads the full text and answers from what the paper actually says.

§ Related work in other archives

Compression for Distributed Optimization and Timely Updates

The paper, in five minutes

Ask a question about this paper

Similar papers in all four archives

The paper, in five minutes

Similar papers in all four archives