• Home
  • Search
  • A Note on the Unification of Adaptive Online Learning.
  • Cite Icon8
  • https://doi.org/10.1109/tnnls.2016.2527053Copy DOI Icon

A Note on the Unification of Adaptive Online Learning.

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

In online convex optimization, adaptive algorithms, which can utilize the second-order information of the loss function's (sub)gradient, have shown improvements over standard gradient methods. This paper presents a framework Follow the Bregman Divergence Leader that unifies various existing adaptive algorithms from which new insights are revealed. Under the proposed framework, two simple adaptive online algorithms with improvable performance guarantee are derived. Furthermore, a general equation derived from a matrix analysis generalizes the adaptive learning to nonlinear case with kernel trick.

Similar Papers
  • Conference Article
  • Citations4

A simplified adaptive scheduling algorithm for increased throughput guarantees

  • Apr 01, 2010
  • Jawad Rasool +1
  • Research Article
  • Citations1

Distributed online adaptive subgradient optimization with dynamic bound of learning rate over time‐varying networks

  • Sep 15, 2022
  • IET Control Theory & Applications
  • Runyue Fang +2
  • Research Article

Enhanced Fault Detection in Software Using an Adaptive Neural Algorithm

  • Jan 01, 2025
  • International Journal of Advanced Computer Science and Applications
  • Jasem Alostad
  • PDF
  • Research Article
  • Citations3

Research on Adaptive Iterative Learning Control of Air Pressure in Railway Tunnel With IOTs Data

  • Dec 26, 2019
  • IEEE Access
  • Yinjun Zhang +2
  • Research Article
  • Citations329

Clustering Incomplete Data Using Kernel-Based Fuzzy C-means Algorithm

  • Dec 01, 2003
  • Neural Processing Letters
  • Dao-Qiang Zhang +1
  • Research Article
  • Citations2

Learning boolean halfspaces with small weights from membership queries

  • Jul 29, 2016
  • Theoretical Computer Science
  • Hasan Abasi +2
  • Research Article
  • Citations1

A Smart Waste Management: an Adaptive Algorithm for Classification of Degradable and Non-Degradable Waste using Machine Learning Model

  • Dec 23, 2024
  • Panamerican Mathematical Journal
  • Manohar K Kodmelwar
  • Research Article
  • Citations113

An Introduction to Neural Networks

  • Jul 01, 1996
  • Journal of Cognitive Neuroscience
  • Joel Davis
  • Research Article
  • Citations136

The Engine of Reason, the Seat of the Soul: A Philosophical Journey into the Brain

  • Jul 01, 1996
  • Journal of Cognitive Neuroscience
  • David P Freidman
  • Research Article
  • Citations28

On a new adaptive lattice algorithm for recursive filters

  • Apr 01, 1982
  • IEEE Transactions on Acoustics, Speech, and Signal Processing
  • I Ayala
  • PDF
  • Research Article
  • Citations3

A variable-scale S-type kernel fractional low-power adaptive filtering algorithm

  • Jan 01, 2021
  • Acta Physica Sinica
  • Yuan-Lian Huo +4
  • Book Chapter
  • Citations7

A New Baseline for Automated Hyper-Parameter Optimization

  • Jan 01, 2019
  • Marius Geitle +1
  • Conference Article
  • Citations8

Adaptive Online Time-Series Prediction for Virtual Metrology in Semiconductor Manufacturing

  • May 01, 2023
  • Simon Zabrocki +5
  • Research Article
  • Citations43

A collaborative control protocol for agricultural robot routing with online adaptation

  • Jun 17, 2019
  • Computers & Industrial Engineering
  • Puwadol Oak Dusadeerungsikul +1
  • Conference Article
  • Citations1

A new stereo matching algorithm based on adaptive window

  • May 01, 2012
  • Yingyun Yang +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.