• Home
  • Search
  • A Unifying Approximate Method of Multipliers for Distributed Composite Optimization
  • Open Access IconOpen Access
  • Cite Icon11
  • https://doi.org/10.1109/tac.2022.3173171Copy DOI Icon

A Unifying Approximate Method of Multipliers for Distributed Composite Optimization

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

This article investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions throughout the network. To address such a problem, a general approximate method of multipliers (AMM) is developed, which attempts to approximate the method of multipliers by virtue of a surrogate function with numerous options. We then design the possibly nonseparable, time-varying surrogate function in various ways, leading to different distributed realizations of AMM. We demonstrate that AMM generalizes more than ten state-of-the-art distributed optimization algorithms, and certain specific designs of its surrogate function result in a variety of new algorithms to the literature. Furthermore, we show that AMM is able to achieve an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$O(1/k)$</tex-math></inline-formula> rate of convergence to optimality, and the convergence rate becomes linear when the problem is locally restricted strongly convex and smooth. Such convergence rates provide new or stronger convergence results to many prior methods that can be viewed as specializations of AMM.

Similar Papers
  • Research Article
  • Citations16

Nabla fractional distributed optimization algorithms over undirected/directed graphs

  • Jan 11, 2024
  • Journal of the Franklin Institute
  • Xiaolin Hong +3
  • Research Article
  • Citations3

Inverse-free distributed neurodynamic optimization algorithms for sparse reconstruction

  • Dec 15, 2023
  • Signal Processing
  • Xin Han +3
  • Single Report

Scalable Real-Time Negotiation Toolkit

  • Oct 01, 2004
  • Victor R Lesser
  • Research Article
  • Citations885

A survey of distributed optimization

  • Jan 01, 2019
  • Annual Reviews in Control
  • Tao Yang +9
  • Research Article
  • Citations7

On the Rates of Convergence From Surrogate Risk Minimizers to the Bayes Optimal Classifier.

  • Oct 01, 2022
  • IEEE Transactions on Neural Networks and Learning Systems
  • Jingwei Zhang +2
  • Research Article

A second-order multi-agent distributed optimisation algorithm on matrix-weighted networks

  • Feb 26, 2026
  • International Journal of Systems Science
  • Ruxin Xiong +3
  • Research Article
  • Citations1

Numerical benchmarking of dual decomposition-based optimization algorithms for distributed model predictive control

  • Nov 19, 2024
  • Results in Control and Optimization
  • Vassilios Yfantis +2
  • Research Article
  • Citations10

Nabla Fractional Distributed Optimization Algorithm Over Unbalanced Graphs

  • Jan 01, 2024
  • IEEE Control Systems Letters
  • Xiaolin Hong +4
  • Research Article
  • Citations29

Distributed Optimization of Uncertain Multiagent Systems With Disturbances and Actuator Faults via Exosystem Observer-Based Output Regulation

  • Feb 01, 2023
  • IEEE Transactions on Circuits and Systems I: Regular Papers
  • Jian Kang +2
  • Book Chapter
  • Citations9

Collaborative Learning over Wireless Networks: An Introductory Overview

  • Jun 30, 2022
  • Emre Ozfatura +2
  • Conference Article
  • Citations21

Achieving Acceleration in Distributed Optimization via Direct Discretization of the Heavy-Ball ODE

  • Jul 01, 2019
  • Jingzhao Zhang +3
  • Research Article
  • Citations96

Distributed Online Algorithm for Optimal Real-Time Energy Distribution in the Smart Grid

  • Feb 01, 2014
  • IEEE Internet of Things Journal
  • Yu Wang +2
  • Research Article
  • Citations33

Discrete-Time Second-Order Distributed Consensus Time Synchronization Algorithm for Wireless Sensor Networks

  • Oct 16, 2008
  • EURASIP Journal on Wireless Communications and Networking
  • Gang Xiong +1
  • Research Article
  • Citations2

Distributed Algorithm Over Time-Varying Unbalanced Graphs for Optimization Problem Subject to Multiple Local Constraints

  • Mar 01, 2025
  • IEEE Transactions on Control of Network Systems
  • Hongzhe Liu +3
  • Supplementary Content

Parallel and Decentralized Algorithms for Big-data Optimization over Networks

  • Jul 22, 2021
  • Figshare
  • Amir Daneshmand
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.