Preprint · 2022 · Open access
A visual introduction to information theory
arXiv (Cornell University) · Published 16 June 2022 · DOI 10.48550/arxiv.2206.07867
In brief
“A visual introduction to information theory” is a 2022 preprint by Henry Pinkard and Laura Waller, published in arXiv (Cornell University). OpenAlex counts 5 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 5
- Most cited in
- 2026 (3)
- Authors
- 2
Abstract
Information theory, though originally developed for communications engineering, provides mathematical tools with broad applications across science. These tools characterize the fundamental limits of data compression and transmission in the presence of noise. Here, we present a visual, intuition-driven guide to key concepts in information theory. We show how entropy, mutual information, and channel capacity follow from basic probability, and how they determine the shortest possible encoding of a data source and the maximum rate of reliable communication through a noisy channel. Our presentation assumes only a familiarity with basic probability theory.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Pinkard, H., & Waller, L. (2022). A visual introduction to information theory. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2206.07867
MLA 9
Pinkard, Henry, and Laura Waller. “A visual introduction to information theory.” arXiv (Cornell University), 2022. https://doi.org/10.48550/arxiv.2206.07867.
Chicago
Pinkard, Henry and Laura Waller. 2022. “A visual introduction to information theory.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2206.07867.
Harvard
Pinkard, H. and Waller, L. (2022) ‘A visual introduction to information theory’, arXiv (Cornell University). doi:10.48550/arxiv.2206.07867.
IEEE
H. Pinkard and L. Waller, “A visual introduction to information theory,” arXiv (Cornell University), 2022, doi: 10.48550/arxiv.2206.07867.
BibTeX
@misc{pinkard2022visual,
title = {{A visual introduction to information theory}},
author = {Pinkard, Henry and Waller, Laura},
howpublished = {arXiv (Cornell University)},
year = {2022},
doi = {10.48550/arxiv.2206.07867},
url = {https://doi.org/10.48550/arxiv.2206.07867}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 1 | |
| 2025 | 1 | |
| 2026 | 3 |
Topic and keywords
Physical Sciences › Computer Science › Computer Networks and Communications › Error Correcting Code Techniques
- information theory
- entropy (information theory)
- mutual information
- channel capacity
- data compression
- noisy channels
- communication reliability
- probability theory
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Pinkard, H., & Waller, L. (2022). A visual introduction to information theory. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2206.07867
How many times has this paper been cited?
5 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at arXiv (Cornell University).
Who wrote this paper?
Henry Pinkard, Laura Waller.
What is the DOI of this paper?
10.48550/arxiv.2206.07867. The permanent link is https://doi.org/10.48550/arxiv.2206.07867.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.