Journal article · 2025 · Open access

Controllable Generation With Text-to-Image Diffusion Models: A Survey

Pu Cao, Feng Zhou, Qing Song, Lu Yang

IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(4), 4771–4791 · Published 19 December 2025 · DOI 10.1109/tpami.2025.3646548

Open PDFView at the publisherCite this paper

In brief

“Controllable Generation With Text-to-Image Diffusion Models: A Survey” is a 2025 journal article by Pu Cao and 3 co-authors, published in IEEE Transactions on Pattern Analysis and Machine Intelligence. OpenAlex counts 122 citations as of 16 November 2026, which puts it in the top 1% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
122
Most cited in
2026 (64)
Field-weighted impact
25.62
References
279
Authors
4

Abstract

In the rapidly advancing realm of visual generation, diffusion models have revolutionized the landscape, marking a significant shift in capabilities with their impressive text-guided generative functions. However, relying solely on text for conditioning these models does not fully cater to the varied and complex requirements of different applications and scenarios. Acknowledging this shortfall, a variety of studies aim to control pre-trained text-to-image (T2I) models to support novel conditions. In this survey, we undertake a thorough review of the literature on controllable generation with T2I diffusion models, covering both the theoretical foundations and practical advancements in this domain. Our review begins with a brief introduction to the basics of denoising diffusion probabilistic models (DDPMs) and widely used T2I diffusion models. Additionally, we provide a detailed overview of research in this area, categorizing it from the condition perspective into three directions: generation with specific conditions, generation with multiple conditions, and universal controllable generation. For each category, we analyze the underlying control mechanisms and review representative methods based on their core techniques.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Cao, P., Zhou, F., Song, Q., & Yang, L. (2025). Controllable Generation With Text-to-Image Diffusion Models: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(4), 4771–4791. https://doi.org/10.1109/tpami.2025.3646548

MLA 9

Cao, Pu, et al. “Controllable Generation With Text-to-Image Diffusion Models: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 48, no. 4, 2025, pp. 4771–4791. https://doi.org/10.1109/tpami.2025.3646548.

Chicago

Cao, Pu, Feng Zhou, Qing Song, and Lu Yang. 2025. “Controllable Generation With Text-to-Image Diffusion Models: A Survey.” IEEE Transactions on Pattern Analysis and Machine Intelligence 48 (4): 4771–4791. https://doi.org/10.1109/tpami.2025.3646548.

Harvard

Cao, P. et al. (2025) ‘Controllable Generation With Text-to-Image Diffusion Models: A Survey’, IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(4), pp. 4771–4791. doi:10.1109/tpami.2025.3646548.

IEEE

P. Cao, F. Zhou, Q. Song, and L. Yang, “Controllable Generation With Text-to-Image Diffusion Models: A Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 48, no. 4, pp. 4771–4791, 2025, doi: 10.1109/tpami.2025.3646548.

BibTeX

@article{cao2025controllable,
  title     = {{Controllable Generation With Text-to-Image Diffusion Models: A Survey}},
  author    = {Cao, Pu and Zhou, Feng and Song, Qing and Yang, Lu},
  journal   = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year      = {2025},
  volume    = {48},
  number    = {4},
  pages     = {4771--4791},
  doi       = {10.1109/tpami.2025.3646548},
  url       = {https://doi.org/10.1109/tpami.2025.3646548}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20241313
20254545
20266464

Its field-weighted citation impact is 25.62: it has been cited 25.62 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Generative Adversarial Networks and Image Synthesis

  • controllable image generation
  • text-to-image diffusion models
  • denoising diffusion probabilistic models
  • text-to-image generation
  • control mechanisms

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Cao, P., Zhou, F., Song, Q., & Yang, L. (2025). Controllable Generation With Text-to-Image Diffusion Models: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(4), 4771–4791. https://doi.org/10.1109/tpami.2025.3646548

How many times has this paper been cited?

122 times, according to OpenAlex on 16 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Pu Cao, Feng Zhou, Qing Song, Lu Yang.

What is the DOI of this paper?

10.1109/tpami.2025.3646548, permanently at https://doi.org/10.1109/tpami.2025.3646548. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 16 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.