Journal article · 2026 · Open access

The Augmented Lagrangian Methods: Overview and Recent Advances

Kangkang Deng, Rui Wang, Zhenyuan Zhu, Junyu Zhang, Zaiwen Wen

SIAM Review, 68(3), 471–576 · Published 6 August 2026 · DOI 10.1137/24m1706153

Open PDFView at the publisherCite this paper

In brief

“The Augmented Lagrangian Methods: Overview and Recent Advances” is a 2026 journal article by Kangkang Deng and 4 co-authors, published in SIAM Review. OpenAlex counts 17 citations as of 17 November 2026, which puts it in the top 7% of works published in 2026 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
17
Most cited in
2026 (15)
Field-weighted impact
20.79
References
233
Authors
5

Abstract

Large-scale constrained optimization is pivotal in modern scientific, engineering, and industrial computation, often involving complex systems with numerous variables and constraints. This paper provides a unified and comprehensive perspective on constructing augmented Lagrangian functions (based on the Hestenes–Powell–Rockafellar augmented Lagrangian) for various optimization problems, including nonlinear programming and convex and nonconvex composite programming. We present the augmented Lagrangian method (ALM), covering its theoretical foundations in both convex and nonconvex cases, and discuss several successful examples and applications. Recent advancements have extended the ALM’s capabilities to handle nonconvex constraints and ensure global convergence to first- and second-order stationary points. For nonsmooth convex problems, the ALM utilizes proximal operations, preserving desirable properties such as locally linear convergence rates. Furthermore, recent progress has refined the complexity analysis of the ALM and tackled challenging integer programming instances. This review aims to offer a thorough understanding of the ALM’s benefits and limitations, exploring different ALM variants designed to enhance convergence and computational performance. We also illustrate effective algorithms for ALM subproblems across different types of optimization problems and highlight practical implementations in several fields.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Deng, K., Wang, R., Zhu, Z., Zhang, J., & Wen, Z. (2026). The Augmented Lagrangian Methods: Overview and Recent Advances. SIAM Review, 68(3), 471–576. https://doi.org/10.1137/24m1706153

MLA 9

Deng, Kangkang, et al. “The Augmented Lagrangian Methods: Overview and Recent Advances.” SIAM Review, vol. 68, no. 3, 2026, pp. 471–576. https://doi.org/10.1137/24m1706153.

Chicago

Deng, Kangkang, Rui Wang, Zhenyuan Zhu, Junyu Zhang, and Zaiwen Wen. 2026. “The Augmented Lagrangian Methods: Overview and Recent Advances.” SIAM Review 68 (3): 471–576. https://doi.org/10.1137/24m1706153.

Harvard

Deng, K. et al. (2026) ‘The Augmented Lagrangian Methods: Overview and Recent Advances’, SIAM Review, 68(3), pp. 471–576. doi:10.1137/24m1706153.

IEEE

K. Deng, R. Wang, Z. Zhu, J. Zhang, and Z. Wen, “The Augmented Lagrangian Methods: Overview and Recent Advances,” SIAM Review, vol. 68, no. 3, pp. 471–576, 2026, doi: 10.1137/24m1706153.

BibTeX

@article{deng2026augmented,
  title     = {{The Augmented Lagrangian Methods: Overview and Recent Advances}},
  author    = {Deng, Kangkang and Wang, Rui and Zhu, Zhenyuan and Zhang, Junyu and Wen, Zaiwen},
  journal   = {SIAM Review},
  year      = {2026},
  volume    = {68},
  number    = {3},
  pages     = {471--576},
  doi       = {10.1137/24m1706153},
  url       = {https://doi.org/10.1137/24m1706153}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Mathematics › Numerical Analysis › Advanced Optimization Algorithms Research

  • augmented Lagrangian method
  • augmented Lagrangian function
  • constrained optimization
  • nonlinear programming
  • non-convex constraints
  • global convergence
  • second-order stationary points
  • nonsmooth convex optimization

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

Deng, K., Wang, R., Zhu, Z., Zhang, J., & Wen, Z. (2026). The Augmented Lagrangian Methods: Overview and Recent Advances. SIAM Review, 68(3), 471–576. https://doi.org/10.1137/24m1706153

How many times has this paper been cited?

17 times, according to OpenAlex on 17 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Kangkang Deng, Rui Wang, Zhenyuan Zhu, Junyu Zhang, Zaiwen Wen.

What is the DOI of this paper?

10.1137/24m1706153, permanently at https://doi.org/10.1137/24m1706153. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 17 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.