Dissertation · 2008 · Open access
Labeling, discovering, and detecting objects in images
DSpace@MIT (Massachusetts Institute of Technology) · Published 1 January 2008
In brief
“Labeling, discovering, and detecting objects in images” is a 2008 dissertation by William T. Freeman and Bryan Christopher Russell, published in DSpace@MIT (Massachusetts Institute of Technology). OpenAlex counts 0 citations as of 15 November 2026. It is open access under a CC BY-NC licence: the full text is free to read at DSpace@MIT (Massachusetts Institute of Technology).
- Citations
- 0
- Authors
- 2
Abstract
Recognizing the many objects that comprise our visual world is a difficult task. Confounding factors, such as intra-class object variation, clutter, pose, lighting, dealing with never-before seen objects, scale, and lack of visual experience often fool existing recognition systems. In this thesis, we explore three issues that address a few of these factors: the importance of labeled image databases for recognition, the ability to discover object categories from simply looking at many images, and the use of large labeled image databases to efficiently detect objects embedded in scenes. For each of the issues above, we will need to cope with large collections of images. We begin by introducing LabelMe, a large labeled image database collected from users via a web annotation tool. The users of the annotation tool provided information about the identity, location, and extent of objects in images. Through this effort, we have collected about 160,000 images and 200,000 object labels to date. We show that the database spans more object categories and scenes and offers a wider range of appearance variation than most other labeled databases for object recognition. We also provide four useful extensions of the database: (i) resolving synonym ambiguities that arise in the object labels, (ii) recovering object-part relationships, (iii) extracting a depth ordering of the labeled objects in an image, and (iv) providing a semi-automatic process for the fast labeling of images. We then seek to learn models of objects in the extreme case when no supervision is provided. We draw inspiration from the success of unsupervised topic discovery in text. We apply the Latent Dirichlet Allocation model of Blei et al. to unlabeled images to automatically discover object categories. To achieve this, we employ the visual words representation of images, which is analogous to the words in text. We show that our unsupervised model achieves comparable classification performance to a model trained with supervision on an unseen image set depicting several object classes. We also successfully localize the discovered object classes in images. While the image representation used for the object discovery process is simple to compute and can distinguish between different object categories, it does not capture explicit spatial information about regions in different parts of the image. We describe a procedure for combining image segmentation with the object discovery process to provide increased spatial support. We show that this procedure finds object models with improved performance on the categorization and localization task for images depicting scenes containing multiple objects. We then return to the problem of learning about objects with…
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Freeman, W. T., & Russell, B. C. (2008). Labeling, discovering, and detecting objects in images. DSpace@MIT (Massachusetts Institute of Technology). http://hdl.handle.net/1721.1/43057
MLA 9
Freeman, William T., and Bryan Christopher Russell. “Labeling, discovering, and detecting objects in images.” DSpace@MIT (Massachusetts Institute of Technology), 2008. http://hdl.handle.net/1721.1/43057.
Chicago
Freeman, William T. and Bryan Christopher Russell. 2008. “Labeling, discovering, and detecting objects in images.” DSpace@MIT (Massachusetts Institute of Technology). http://hdl.handle.net/1721.1/43057.
Harvard
Freeman, W. T. and Russell, B. C. (2008) ‘Labeling, discovering, and detecting objects in images’, DSpace@MIT (Massachusetts Institute of Technology). Available at: http://hdl.handle.net/1721.1/43057.
IEEE
W. T. Freeman and B. C. Russell, “Labeling, discovering, and detecting objects in images,” DSpace@MIT (Massachusetts Institute of Technology), 2008.
BibTeX
@phdthesis{freeman2008labeling,
title = {{Labeling, discovering, and detecting objects in images}},
author = {Freeman, William T. and Russell, Bryan Christopher},
year = {2008},
url = {http://hdl.handle.net/1721.1/43057}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Image and Video Retrieval Techniques
- object recognition
- LabelMe
- web annotation
- unsupervised topic modeling
- latent Dirichlet allocation
- visual words
- image segmentation
- object localization
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Freeman, W. T., & Russell, B. C. (2008). Labeling, discovering, and detecting objects in images. DSpace@MIT (Massachusetts Institute of Technology). http://hdl.handle.net/1721.1/43057
How many times has this paper been cited?
0 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at DSpace@MIT (Massachusetts Institute of Technology).
Who wrote this paper?
William T. Freeman, Bryan Christopher Russell.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.