Preprint · 2018 · Open access

Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo

Marton Havasi, José Miguel Hernández-Lobato, Juan José Murillo-Fuentes

arXiv (Cornell University), 31, 7506–7516 · Published 14 June 2018 · DOI 10.48550/arxiv.1806.05490

Open PDFView at the publisherCite this paper

In brief

“Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo” is a 2018 preprint by Marton Havasi and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 106 citations as of 18 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
106
Most cited in
2021 (21)
References
28
Authors
3

Abstract

Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that exact inference is intractable. The current state-of-the-art inference method, Variational Inference (VI), employs a Gaussian approximation to the posterior distribution. This can be a potentially poor unimodal approximation of the generally multimodal posterior. In this work, we provide evidence for the non-Gaussian nature of the posterior and we apply the Stochastic Gradient Hamiltonian Monte Carlo method to generate samples. To efficiently optimize the hyperparameters, we introduce the Moving Window MCEM algorithm. This results in significantly better predictions at a lower computational cost than its VI counterpart. Thus our method establishes a new state-of-the-art for inference in DGPs.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Havasi, M., Hernández-Lobato, J. M., & Murillo-Fuentes, J. J. (2018). Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo. arXiv (Cornell University), 31, 7506–7516. https://doi.org/10.48550/arxiv.1806.05490

MLA 9

Havasi, Marton, et al. “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo.” arXiv (Cornell University), vol. 31, 2018, pp. 7506–7516. https://doi.org/10.48550/arxiv.1806.05490.

Chicago

Havasi, Marton, José Miguel Hernández-Lobato, and Juan José Murillo-Fuentes. 2018. “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo.” arXiv (Cornell University) 31: 7506–7516. https://doi.org/10.48550/arxiv.1806.05490.

Harvard

Havasi, M., Hernández-Lobato, J. M. and Murillo-Fuentes, J. J. (2018) ‘Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo’, arXiv (Cornell University), 31, pp. 7506–7516. doi:10.48550/arxiv.1806.05490.

IEEE

M. Havasi, J. M. Hernández-Lobato, and J. J. Murillo-Fuentes, “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo,” arXiv (Cornell University), vol. 31, pp. 7506–7516, 2018, doi: 10.48550/arxiv.1806.05490.

BibTeX

@misc{havasi2018inference,
  title     = {{Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo}},
  author    = {Havasi, Marton and Hernández-Lobato, José Miguel and Murillo-Fuentes, Juan José},
  howpublished = {arXiv (Cornell University)},
  year      = {2018},
  volume    = {31},
  pages     = {7506--7516},
  doi       = {10.48550/arxiv.1806.05490},
  url       = {https://doi.org/10.48550/arxiv.1806.05490}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20191616
20201717
20212121
20221515
20231515
202477
202588
202677

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference

  • deep Gaussian processes
  • posterior inference
  • non-Gaussian posterior
  • multimodal posterior
  • hyperparameter optimization
  • uncertainty estimation

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Havasi, M., Hernández-Lobato, J. M., & Murillo-Fuentes, J. J. (2018). Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo. arXiv (Cornell University), 31, 7506–7516. https://doi.org/10.48550/arxiv.1806.05490

How many times has this paper been cited?

106 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Marton Havasi, José Miguel Hernández-Lobato, Juan José Murillo-Fuentes.

What is the DOI of this paper?

10.48550/arxiv.1806.05490, permanently at https://doi.org/10.48550/arxiv.1806.05490. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.