Preprint · 2018 · Open access
Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo
arXiv (Cornell University), 31, 7506–7516 · Published 14 June 2018 · DOI 10.48550/arxiv.1806.05490
In brief
“Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo” is a 2018 preprint by Marton Havasi and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 106 citations as of 18 November 2026. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 106
- Most cited in
- 2021 (21)
- References
- 28
- Authors
- 3
Abstract
Deep Gaussian Processes (DGPs) are hierarchical generalizations of Gaussian Processes that combine well calibrated uncertainty estimates with the high flexibility of multilayer models. One of the biggest challenges with these models is that exact inference is intractable. The current state-of-the-art inference method, Variational Inference (VI), employs a Gaussian approximation to the posterior distribution. This can be a potentially poor unimodal approximation of the generally multimodal posterior. In this work, we provide evidence for the non-Gaussian nature of the posterior and we apply the Stochastic Gradient Hamiltonian Monte Carlo method to generate samples. To efficiently optimize the hyperparameters, we introduce the Moving Window MCEM algorithm. This results in significantly better predictions at a lower computational cost than its VI counterpart. Thus our method establishes a new state-of-the-art for inference in DGPs.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Havasi, M., Hernández-Lobato, J. M., & Murillo-Fuentes, J. J. (2018). Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo. arXiv (Cornell University), 31, 7506–7516. https://doi.org/10.48550/arxiv.1806.05490
MLA 9
Havasi, Marton, et al. “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo.” arXiv (Cornell University), vol. 31, 2018, pp. 7506–7516. https://doi.org/10.48550/arxiv.1806.05490.
Chicago
Havasi, Marton, José Miguel Hernández-Lobato, and Juan José Murillo-Fuentes. 2018. “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo.” arXiv (Cornell University) 31: 7506–7516. https://doi.org/10.48550/arxiv.1806.05490.
Harvard
Havasi, M., Hernández-Lobato, J. M. and Murillo-Fuentes, J. J. (2018) ‘Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo’, arXiv (Cornell University), 31, pp. 7506–7516. doi:10.48550/arxiv.1806.05490.
IEEE
M. Havasi, J. M. Hernández-Lobato, and J. J. Murillo-Fuentes, “Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo,” arXiv (Cornell University), vol. 31, pp. 7506–7516, 2018, doi: 10.48550/arxiv.1806.05490.
BibTeX
@misc{havasi2018inference,
title = {{Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo}},
author = {Havasi, Marton and Hernández-Lobato, José Miguel and Murillo-Fuentes, Juan José},
howpublished = {arXiv (Cornell University)},
year = {2018},
volume = {31},
pages = {7506--7516},
doi = {10.48550/arxiv.1806.05490},
url = {https://doi.org/10.48550/arxiv.1806.05490}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2019 | 16 | |
| 2020 | 17 | |
| 2021 | 21 | |
| 2022 | 15 | |
| 2023 | 15 | |
| 2024 | 7 | |
| 2025 | 8 | |
| 2026 | 7 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- deep Gaussian processes
- posterior inference
- non-Gaussian posterior
- multimodal posterior
- hyperparameter optimization
- uncertainty estimation
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Havasi, M., Hernández-Lobato, J. M., & Murillo-Fuentes, J. J. (2018). Inference in Deep Gaussian Processes using Stochastic Gradient Hamiltonian Monte Carlo. arXiv (Cornell University), 31, 7506–7516. https://doi.org/10.48550/arxiv.1806.05490
How many times has this paper been cited?
106 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Marton Havasi, José Miguel Hernández-Lobato, Juan José Murillo-Fuentes.
What is the DOI of this paper?
10.48550/arxiv.1806.05490, permanently at https://doi.org/10.48550/arxiv.1806.05490. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.