Journal article · 2025 · Open access
Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning
PLoS Computational Biology, 21(3), e1012899 · Published 17 March 2025 · DOI 10.1371/journal.pcbi.1012899
In brief
“Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning” is a 2025 journal article by Huu Hoang and 6 co-authors, published in PLoS Computational Biology. OpenAlex counts 10 citations as of 18 November 2026, which puts it in the top 7% of works published in 2025 by citations. It is open access under a CC BY licence: the full text is free to read at PLoS Computational Biology.
- Citations
- 10
- Most cited in
- 2025 (4)
- Field-weighted impact
- 2.66
- References
- 86
- Authors
- 7
Abstract
Although the cerebellum is typically associated with supervised learning algorithms, it also exhibits extensive involvement in reward processing. In this study, we investigated the cerebellum's role in executing reinforcement learning algorithms, with a particular emphasis on essential reward-prediction errors. We employed the Q-learning model to accurately reproduce the licking responses of mice in a Go/No-go auditory-discrimination task. This method enabled the calculation of reinforcement learning variables, such as reward, predicted reward, and reward-prediction errors in each learning trial. Through tensor component analysis of two-photon Ca2+ imaging data from more than 6,000 Purkinje cells, we found that climbing fiber inputs of the two distinct components, which were specifically activated during Go and No-go cues in the learning process, showed an inverse relationship with predictive reward-prediction errors. Assuming bidirectional parallel-fiber Purkinje-cell synaptic plasticity, we constructed a cerebellar neural-network model with 5,000 spiking neurons of granule cells, Purkinje cells, cerebellar nuclei neurons, and inferior olive neurons. The network model qualitatively reproduced distinct changes in licking behaviors, climbing-fiber firing rates, and their synchronization during discrimination learning separately for Go/No-go conditions. We found that Purkinje cells in the two components could develop specific motor commands for their respective auditory cues, guided by the predictive reward-prediction errors from their climbing fiber inputs. These results indicate a possible role of context-specific actors in modular reinforcement learning, integrating with cerebellar supervised learning capabilities.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Hoang, H., Tsutsumi, S., Matsuzaki, M., Kano, M., Toyama, K., Kitamura, K., & Kawato, M. (2025). Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning. PLoS Computational Biology, 21(3), e1012899. https://doi.org/10.1371/journal.pcbi.1012899
MLA 9
Hoang, Huu, et al. “Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning.” PLoS Computational Biology, vol. 21, no. 3, 2025, p. e1012899. https://doi.org/10.1371/journal.pcbi.1012899.
Chicago
Hoang, Huu, Shinichiro Tsutsumi, M Matsuzaki, Masanobu Kano, Keisuke Toyama, Kazuo Kitamura, and Mitsuo Kawato. 2025. “Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning.” PLoS Computational Biology 21 (3): e1012899. https://doi.org/10.1371/journal.pcbi.1012899.
Harvard
Hoang, H. et al. (2025) ‘Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning’, PLoS Computational Biology, 21(3), p. e1012899. doi:10.1371/journal.pcbi.1012899.
IEEE
H. Hoang et al., “Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning,” PLoS Computational Biology, vol. 21, no. 3, p. e1012899, 2025, doi: 10.1371/journal.pcbi.1012899.
BibTeX
@article{hoang2025predictive,
title = {{Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning}},
author = {Hoang, Huu and Tsutsumi, Shinichiro and Matsuzaki, M and Kano, Masanobu and Toyama, Keisuke and Kitamura, Kazuo and Kawato, Mitsuo},
journal = {PLoS Computational Biology},
year = {2025},
volume = {21},
number = {3},
pages = {e1012899},
doi = {10.1371/journal.pcbi.1012899},
url = {https://doi.org/10.1371/journal.pcbi.1012899}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 2 | |
| 2025 | 4 | |
| 2026 | 4 |
Its field-weighted citation impact is 2.66: it has been cited 2.66 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Life Sciences › Neuroscience › Cognitive Neuroscience › Memory and Neural Mechanisms
- cerebellum
- climbing fibers
- reward prediction error
- modular reinforcement learning
- Purkinje cells
- Q-learning
- go/no-go discrimination
- auditory discrimination
Work with this paper
Most-cited papers in Neuroscience
- The Rat Brain in Stereotaxic CoordinatesGeorge Paxinos, CHARLES R. R. WATSON · Elsevier eBooks · 1982 · 52,413 citations
- The assessment and analysis of handedness: The Edinburgh inventoryRichard Charles Oldfield · Neuropsychologia · 1971 · 36,725 citations
- EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysisArnaud Delorme A, Scott Makeig · Journal of Neuroscience Methods · 2004 · 25,302 citations
- The Ecological Approach to Visual PerceptionMarc H. Bornstein, James J. Gibson · Journal of Aesthetics and Art Criticism · 1980 · 22,977 citations
- The Psychophysics ToolboxDavid H. Brainard · Spatial Vision · 1997 · 20,208 citations
Questions about this paper
How do I cite this paper in APA style?
Hoang, H., Tsutsumi, S., Matsuzaki, M., Kano, M., Toyama, K., Kitamura, K., & Kawato, M. (2025). Predictive reward-prediction errors of climbing fiber inputs integrate modular reinforcement learning with supervised learning. PLoS Computational Biology, 21(3), e1012899. https://doi.org/10.1371/journal.pcbi.1012899
How many times has this paper been cited?
10 times, according to OpenAlex on 18 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at PLoS Computational Biology: sign in and open the full text from this page.
Who wrote this paper?
Huu Hoang, Shinichiro Tsutsumi, M Matsuzaki, Masanobu Kano, Keisuke Toyama, Kazuo Kitamura, Mitsuo Kawato.
What is the DOI of this paper?
10.1371/journal.pcbi.1012899, permanently at https://doi.org/10.1371/journal.pcbi.1012899. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 18 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.