Preprint · 2024 · Open access
The Challenges of Optimization For Data Science
arXiv (Cornell University) · Published 15 April 2024 · DOI 10.48550/arxiv.2404.09810
In brief
“The Challenges of Optimization For Data Science” is a 2024 preprint by Christian Varner and Vivak Patel, published in arXiv (Cornell University). OpenAlex counts 2 citations as of 16 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 2
- Most cited in
- 2024 (1)
- References
- 17
- Authors
- 2
Abstract
Optimization problems arising in data science have given rise to a number of new derivative-based optimization methods. Such methods often use standard smoothness assumptions -- namely, global Lipschitz continuity of the gradient function -- to establish a convergence theory. Unfortunately, in this work, we show that common optimization problems from data science applications are not globally Lipschitz smooth, nor do they satisfy some more recently developed smoothness conditions in literature. Instead, we show that such optimization problems are better modeled as having locally Lipschitz continuous gradients. We then construct explicit examples satisfying this assumption on which existing classes of optimization methods are either unreliable or experience an explosion in evaluation complexity. In summary, we show that optimization problems arising in data science are particularly difficult to solve, and that there is a need for methods that can reliably and practically solve these problems.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Varner, C., & Patel, V. (2024). The Challenges of Optimization For Data Science. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2404.09810
MLA 9
Varner, Christian, and Vivak Patel. “The Challenges of Optimization For Data Science.” arXiv (Cornell University), 2024. https://doi.org/10.48550/arxiv.2404.09810.
Chicago
Varner, Christian and Vivak Patel. 2024. “The Challenges of Optimization For Data Science.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2404.09810.
Harvard
Varner, C. and Patel, V. (2024) ‘The Challenges of Optimization For Data Science’, arXiv (Cornell University). doi:10.48550/arxiv.2404.09810.
IEEE
C. Varner and V. Patel, “The Challenges of Optimization For Data Science,” arXiv (Cornell University), 2024, doi: 10.48550/arxiv.2404.09810.
BibTeX
@misc{varner2024challenges,
title = {{The Challenges of Optimization For Data Science}},
author = {Varner, Christian and Patel, Vivak},
howpublished = {arXiv (Cornell University)},
year = {2024},
doi = {10.48550/arxiv.2404.09810},
url = {https://doi.org/10.48550/arxiv.2404.09810}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
- gradient-based optimization
- smoothness assumption
- convergence theory
- evaluation complexity
- nonsmooth optimization
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Varner, C., & Patel, V. (2024). The Challenges of Optimization For Data Science. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2404.09810
How many times has this paper been cited?
2 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Christian Varner, Vivak Patel.
What is the DOI of this paper?
10.48550/arxiv.2404.09810. The permanent link is https://doi.org/10.48550/arxiv.2404.09810.
Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.