Estimating information in time-varying signals

S.A. Cepeda Humerez, J. Ruess, G. Tkačik, PLoS Computational Biology 15 (2019) e1007290.

OA 2019_PLoS_Cepeda-Humerez.pdf 3.08 MB

Journal Article | Published | English

Scopus indexed
Across diverse biological systems—ranging from neural networks to intracellular signaling and genetic regulatory networks—the information about changes in the environment is frequently encoded in the full temporal dynamics of the network nodes. A pressing data-analysis challenge has thus been to efficiently estimate the amount of information that these dynamics convey from experimental data. Here we develop and evaluate decoding-based estimation methods to lower bound the mutual information about a finite set of inputs, encoded in single-cell high-dimensional time series data. For biological reaction networks governed by the chemical Master equation, we derive model-based information approximations and analytical upper bounds, against which we benchmark our proposed model-free decoding estimators. In contrast to the frequently-used k-nearest-neighbor estimator, decoding-based estimators robustly extract a large fraction of the available information from high-dimensional trajectories with a realistic number of data samples. We apply these estimators to previously published data on Erk and Ca2+ signaling in mammalian cells and to yeast stress-response, and find that substantial amount of information about environmental state can be encoded by non-trivial response statistics even in stationary signals. We argue that these single-cell, decoding-based information estimates, rather than the commonly-used tests for significant differences between selected population response statistics, provide a proper and unbiased measure for the performance of biological signaling networks.
Publishing Year
Date Published
Journal Title
PLoS computational biology

Cite this

Cepeda Humerez SA, Ruess J, Tkačik G. Estimating information in time-varying signals. PLoS computational biology. 2019;15(9):e1007290. doi:10.1371/journal.pcbi.1007290
Cepeda Humerez, S. A., Ruess, J., & Tkačik, G. (2019). Estimating information in time-varying signals. PLoS Computational Biology. Public Library of Science.
Cepeda Humerez, Sarah A, Jakob Ruess, and Gašper Tkačik. “Estimating Information in Time-Varying Signals.” PLoS Computational Biology. Public Library of Science, 2019.
S. A. Cepeda Humerez, J. Ruess, and G. Tkačik, “Estimating information in time-varying signals,” PLoS computational biology, vol. 15, no. 9. Public Library of Science, p. e1007290, 2019.
Cepeda Humerez SA, Ruess J, Tkačik G. 2019. Estimating information in time-varying signals. PLoS computational biology. 15(9), e1007290.
Cepeda Humerez, Sarah A., et al. “Estimating Information in Time-Varying Signals.” PLoS Computational Biology, vol. 15, no. 9, Public Library of Science, 2019, p. e1007290, doi:10.1371/journal.pcbi.1007290.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
Main File(s)
Access Level
OA Open Access
Date Uploaded
MD5 Checksum

Material in IST:
Part of this Dissertation


Marked Publications

Open Data IST Research Explorer


PMID: 31479447
PubMed | Europe PMC

Search this title in

Google Scholar