Preprint · 2023 · Open access
Convolutional Deep Kernel Machines
arXiv (Cornell University) · Published 18 September 2023 · DOI 10.48550/arxiv.2309.09814
In brief
“Convolutional Deep Kernel Machines” is a 2023 preprint by Edward Milsom and 2 co-authors, published in arXiv (Cornell University). OpenAlex counts 7 citations as of 18 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 7
- Most cited in
- 2024 (2)
- References
- 37
- Authors
- 3
Abstract
Standard infinite-width limits of neural networks sacrifice the ability for intermediate layers to learn representations from data. Recent work (A theory of representation learning gives a deep generalisation of kernel methods, Yang et al. 2023) modified the Neural Network Gaussian Process (NNGP) limit of Bayesian neural networks so that representation learning is retained. Furthermore, they found that applying this modified limit to a deep Gaussian process gives a practical learning algorithm which they dubbed the deep kernel machine (DKM). However, they only considered the simplest possible setting: regression in small, fully connected networks with e.g. 10 input features. Here, we introduce convolutional deep kernel machines. This required us to develop a novel inter-domain inducing point approximation, as well as introducing and experimentally assessing a number of techniques not previously seen in DKMs, including analogues to batch normalisation, different likelihoods, and different types of top-layer. The resulting model trains in roughly 77 GPU hours, achieving around 99% test accuracy on MNIST, 72% on CIFAR-100, and 92.7% on CIFAR-10, which is SOTA for kernel methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Milsom, E., Anson, B., & Aitchison, L. (2023). Convolutional Deep Kernel Machines. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2309.09814
MLA 9
Milsom, Edward, et al. “Convolutional Deep Kernel Machines.” arXiv (Cornell University), 2023. https://doi.org/10.48550/arxiv.2309.09814.
Chicago
Milsom, Edward, Ben Anson, and Laurence Aitchison. 2023. “Convolutional Deep Kernel Machines.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2309.09814.
Harvard
Milsom, E., Anson, B. and Aitchison, L. (2023) ‘Convolutional Deep Kernel Machines’, arXiv (Cornell University). doi:10.48550/arxiv.2309.09814.
IEEE
E. Milsom, B. Anson, and L. Aitchison, “Convolutional Deep Kernel Machines,” arXiv (Cornell University), 2023, doi: 10.48550/arxiv.2309.09814.
BibTeX
@misc{milsom2023convolutional,
title = {{Convolutional Deep Kernel Machines}},
author = {Milsom, Edward and Anson, Ben and Aitchison, Laurence},
howpublished = {arXiv (Cornell University)},
year = {2023},
doi = {10.48550/arxiv.2309.09814},
url = {https://doi.org/10.48550/arxiv.2309.09814}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2021 | 1 | |
| 2023 | 1 | |
| 2024 | 2 | |
| 2025 | 1 | |
| 2026 | 2 |
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Gaussian Processes and Bayesian Inference
- representation learning
- likelihood
- image classification
- kernel methods
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Milsom, E., Anson, B., & Aitchison, L. (2023). Convolutional Deep Kernel Machines. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2309.09814
How many times has this paper been cited?
7 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Edward Milsom, Ben Anson, Laurence Aitchison.
What is the DOI of this paper?
10.48550/arxiv.2309.09814, permanently at https://doi.org/10.48550/arxiv.2309.09814. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.