Paper · 2021 · Open access

Estimating the Unique Information of Continuous Variables

Ari Pakman, Amin Nejatbakhsh, Dar Gilboa, Abdullah Makkeh, Luca Mazzucato, Michael Wibral, Elad Schneidman

PubMed, 34, 20295–20307 · Published 30 January 2021 · DOI 10.48550/arxiv.2102.00218

Open full textView at the publisherCite this paper

In brief

“Estimating the Unique Information of Continuous Variables” is a 2021 paper by Ari Pakman and 6 co-authors, published in PubMed. OpenAlex counts 38 citations as of 20 November 2026, which puts it in the top 3% of works published in 2021 by citations. It is open access: the full text is free to read at PubMed Central.

Citations
38
Most cited in
2026 (11)
Field-weighted impact
2.00
References
64
Authors
7

Abstract

The integration and transfer of information from multiple sources to multiple targets is a core motive of neural systems. The emerging field of partial information decomposition (PID) provides a novel information-theoretic lens into these mechanisms by identifying synergistic, redundant, and unique contributions to the mutual information between one and several variables. While many works have studied aspects of PID for Gaussian and discrete distributions, the case of general continuous distributions is still uncharted territory. In this work we present a method for estimating the unique information in continuous distributions, for the case of one versus two variables. Our method solves the associated optimization problem over the space of distributions with fixed bivariate marginals by combining copula decompositions and techniques developed to optimize variational autoencoders. We obtain excellent agreement with known analytic results for Gaussians, and illustrate the power of our new approach in several brain-inspired neural models. Our method is capable of recovering the effective connectivity of a chaotic network of rate neurons, and uncovers a complex trade-off between redundancy, synergy and unique information in recurrent networks trained to solve a generalized XOR task.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Pakman, A., Nejatbakhsh, A., Gilboa, D., Makkeh, A., Mazzucato, L., Wibral, M., & Schneidman, E. (2021). Estimating the Unique Information of Continuous Variables. PubMed, 34, 20295–20307. https://doi.org/10.48550/arxiv.2102.00218

MLA 9

Pakman, Ari, et al. “Estimating the Unique Information of Continuous Variables.” PubMed, vol. 34, 2021, pp. 20295–20307. https://doi.org/10.48550/arxiv.2102.00218.

Chicago

Pakman, Ari, Amin Nejatbakhsh, Dar Gilboa, Abdullah Makkeh, Luca Mazzucato, Michael Wibral, and Elad Schneidman. 2021. “Estimating the Unique Information of Continuous Variables.” PubMed 34: 20295–20307. https://doi.org/10.48550/arxiv.2102.00218.

Harvard

Pakman, A. et al. (2021) ‘Estimating the Unique Information of Continuous Variables’, PubMed, 34, pp. 20295–20307. doi:10.48550/arxiv.2102.00218.

IEEE

A. Pakman et al., “Estimating the Unique Information of Continuous Variables,” PubMed, vol. 34, pp. 20295–20307, 2021, doi: 10.48550/arxiv.2102.00218.

BibTeX

@article{pakman2021estimating,
  title     = {{Estimating the Unique Information of Continuous Variables}},
  author    = {Pakman, Ari and Nejatbakhsh, Amin and Gilboa, Dar and Makkeh, Abdullah and Mazzucato, Luca and Wibral, Michael and Schneidman, Elad},
  journal   = {PubMed},
  year      = {2021},
  volume    = {34},
  pages     = {20295--20307},
  doi       = {10.48550/arxiv.2102.00218},
  url       = {https://doi.org/10.48550/arxiv.2102.00218}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202255
202377
202477
202588
20261111

Its field-weighted citation impact is 2.00: it has been cited 2.00 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies

  • partial information decomposition
  • unique information
  • continuous distributions
  • variational autoencoder
  • effective connectivity
  • chaotic neural networks
  • recurrent neural networks
  • brain-inspired models

Work with this paper

Most-cited papers in Neuroscience

All highly cited Neuroscience papers

Questions about this paper

How do I cite this paper in APA style?

Pakman, A., Nejatbakhsh, A., Gilboa, D., Makkeh, A., Mazzucato, L., Wibral, M., & Schneidman, E. (2021). Estimating the Unique Information of Continuous Variables. PubMed, 34, 20295–20307. https://doi.org/10.48550/arxiv.2102.00218

How many times has this paper been cited?

38 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at PubMed Central: sign in and open the full text from this page.

Who wrote this paper?

Ari Pakman, Amin Nejatbakhsh, Dar Gilboa, Abdullah Makkeh, Luca Mazzucato, Michael Wibral, Elad Schneidman.

What is the DOI of this paper?

10.48550/arxiv.2102.00218, permanently at https://doi.org/10.48550/arxiv.2102.00218. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.