Preprint · 2019 · Open access

Automated Machine Learning via ADMM.

Sijia Liu, Parikshit Ram, Djallel Bouneffouf, Gregory Bramble, Andrew R. Conn, Horst Samulowitz, Alexander Gray

arXiv (Cornell University) · Published 1 May 2019

Open full textCite this paper

In brief

“Automated Machine Learning via ADMM.” is a 2019 preprint by Sijia Liu and 6 co-authors, published in arXiv (Cornell University). OpenAlex counts 10 citations as of 19 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
10
Most cited in
2020 (4)
References
33
Authors
7

Abstract

We study the automated machine learning (AutoML) problem of jointly selecting appropriate algorithms from an algorithm portfolio as well as optimizing their hyper-parameters for certain learning tasks. The main challenges include a) the coupling between algorithm selection and hyper-parameter optimization (HPO), and b) the black-box optimization nature of the problem where the optimizer cannot access the gradients of the loss function but may query function values. To circumvent these difficulties, we propose a new AutoML framework by leveraging the alternating direction method of multipliers (ADMM) scheme. Due to the splitting properties of ADMM, algorithm selection and HPO can be decomposed through the augmented Lagrangian function. As a result, HPO with mixed continuous and integer constraints are efficiently handled through a query-efficient Bayesian optimization approach and Euclidean projection operator that yields a closed-form solution. Algorithm selection in ADMM is naturally interpreted as a combinatorial bandit problem. The effectiveness of our proposed methodology is compared to state-of-the-art AutoML schemes such as TPOT and Auto-sklearn on numerous benchmark data sets.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Liu, S., Ram, P., Bouneffouf, D., Bramble, G., Conn, A. R., Samulowitz, H., & Gray, A. (2019). Automated Machine Learning via ADMM. arXiv (Cornell University). https://arxiv.org/abs/1905.00424

MLA 9

Liu, Sijia, et al. “Automated Machine Learning via ADMM.” arXiv (Cornell University), 2019. https://arxiv.org/abs/1905.00424.

Chicago

Liu, Sijia, Parikshit Ram, Djallel Bouneffouf, Gregory Bramble, Andrew R. Conn, Horst Samulowitz, and Alexander Gray. 2019. “Automated Machine Learning via ADMM.” arXiv (Cornell University). https://arxiv.org/abs/1905.00424.

Harvard

Liu, S. et al. (2019) ‘Automated Machine Learning via ADMM.’, arXiv (Cornell University). Available at: https://arxiv.org/abs/1905.00424.

IEEE

S. Liu et al., “Automated Machine Learning via ADMM.,” arXiv (Cornell University), 2019.

BibTeX

@misc{liu2019automated,
  title     = {{Automated Machine Learning via ADMM.}},
  author    = {Liu, Sijia and Ram, Parikshit and Bouneffouf, Djallel and Bramble, Gregory and Conn, Andrew R. and Samulowitz, Horst and Gray, Alexander},
  howpublished = {arXiv (Cornell University)},
  year      = {2019},
  url       = {https://arxiv.org/abs/1905.00424}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201922
202044
202122
202211
202311

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Machine Learning and Data Classification

  • automated machine learning
  • algorithm selection
  • hyperparameter optimization
  • alternating direction method of multipliers
  • augmented Lagrangian method
  • black-box optimization
  • Bayesian optimization
  • Euclidean projection

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Liu, S., Ram, P., Bouneffouf, D., Bramble, G., Conn, A. R., Samulowitz, H., & Gray, A. (2019). Automated Machine Learning via ADMM. arXiv (Cornell University). https://arxiv.org/abs/1905.00424

How many times has this paper been cited?

10 times, according to OpenAlex on 19 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the full text from this page.

Who wrote this paper?

Sijia Liu, Parikshit Ram, Djallel Bouneffouf, Gregory Bramble, Andrew R. Conn, Horst Samulowitz, Alexander Gray.

Bibliographic data from OpenAlex (CC0), last checked 19 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.