Book chapter · 2022 · Open access

Foundations of Smooth Optimization

Stephen J. Wright, Benjamin Recht

Cambridge University Press eBooks, 15–25 · Published 31 March 2022 · DOI 10.1017/9781009004282.003

Free PDFView at the publisherCite this paper

In brief

“Foundations of Smooth Optimization” is a 2022 book chapter by Stephen J. Wright and Benjamin Recht, published in Cambridge University Press eBooks. OpenAlex counts 0 citations as of 16 November 2026. It is open access: the full text is free to read at Cambridge University Press eBooks.

Citations
0
Authors
2

Abstract

We outline theoretical foundations for smooth optimization problems. First, we define the different types of minimizers (solutions) of unconstrained optimization problems. Next, we state Taylor’s theorem, the fundamental theorem of smooth optimization, which allows us to approximate general smooth functions by simpler (linear or quadratic) functions based on information at the current point. We show how minima can be characterized by optimality conditions involving the gradient or Hessian, which can be checked in practice. Finally, we define the convexity of sets and functions, an important property that arises often in practice and that can be exploited by the algorithms described in the remainder of the book.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wright, S. J., & Recht, B. (2022). Foundations of Smooth Optimization. Cambridge University Press eBooks, 15–25. https://doi.org/10.1017/9781009004282.003

MLA 9

Wright, Stephen J., and Benjamin Recht. “Foundations of Smooth Optimization.” Cambridge University Press eBooks, 2022, pp. 15–25. https://doi.org/10.1017/9781009004282.003.

Chicago

Wright, Stephen J. and Benjamin Recht. 2022. “Foundations of Smooth Optimization.” Cambridge University Press eBooks: 15–25. https://doi.org/10.1017/9781009004282.003.

Harvard

Wright, S. J. and Recht, B. (2022) ‘Foundations of Smooth Optimization’, Cambridge University Press eBooks, pp. 15–25. doi:10.1017/9781009004282.003.

IEEE

S. J. Wright and B. Recht, “Foundations of Smooth Optimization,” Cambridge University Press eBooks, pp. 15–25, 2022, doi: 10.1017/9781009004282.003.

BibTeX

@incollection{wright2022foundations,
  title     = {{Foundations of Smooth Optimization}},
  author    = {Wright, Stephen J. and Recht, Benjamin},
  booktitle = {Cambridge University Press eBooks},
  publisher = {Cambridge University Press},
  year      = {2022},
  pages     = {15--25},
  doi       = {10.1017/9781009004282.003},
  url       = {https://doi.org/10.1017/9781009004282.003}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Topic and keywords

Physical Sciences › Mathematics › Numerical Analysis › Advanced Optimization Algorithms Research

  • smooth optimization
  • unconstrained optimization
  • minimizers
  • Taylor's theorem
  • optimality conditions
  • gradient
  • Hessian matrix
  • convex sets

Work with this paper

Most-cited papers in Mathematics

All highly cited Mathematics papers

Questions about this paper

How do I cite this paper in APA style?

Wright, S. J., & Recht, B. (2022). Foundations of Smooth Optimization. Cambridge University Press eBooks, 15–25. https://doi.org/10.1017/9781009004282.003

How many times has this paper been cited?

0 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Cambridge University Press eBooks.

Who wrote this paper?

Stephen J. Wright, Benjamin Recht.

What is the DOI of this paper?

10.1017/9781009004282.003. The permanent link is https://doi.org/10.1017/9781009004282.003.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.