Across diverse biological systems—ranging from neural networks to intracellular signaling and genetic regulatory networks—the information about changes in the environment is frequently encoded in the full temporal dynamics of the network nodes. A pressing data-analysis challenge has thus been to efficiently estimate the amount of information that these dynamics convey from experimental data. Here we develop and evaluate decoding-based estimation methods to lower bound the mutual information about a finite set of inputs, encoded in single-cell high-dimensional time series data. For biological reaction networks governed by the chemical Master equation, we derive model-based information approximations and analytical upper bounds, against which we benchmark our proposed model-free decoding estimators. In contrast to the frequently-used k-nearest-neighbor estimator, decoding-based estimators robustly extract a large fraction of the available information from high-dimensional trajectories with a realistic number of data samples. We apply these estimators to previously published data on Erk and Ca2+ signaling in mammalian cells and to yeast stress-response, and find that substantial amount of information about environmental state can be encoded by non-trivial response statistics even in stationary signals. We argue that these single-cell, decoding-based information estimates, rather than the commonly-used tests for significant differences between selected population response statistics, provide a proper and unbiased measure for the performance of biological signaling networks.
PLoS computational biology
Cepeda Humerez SA, Ruess J, Tkačik G. Estimating information in time-varying signals. PLoS computational biology. 2019;15(9):e1007290. doi:10.1371/journal.pcbi.1007290
Cepeda Humerez, S. A., Ruess, J., & Tkačik, G. (2019). Estimating information in time-varying signals. PLoS Computational Biology. Public Library of Science. https://doi.org/10.1371/journal.pcbi.1007290
Cepeda Humerez, Sarah A, Jakob Ruess, and Gašper Tkačik. “Estimating Information in Time-Varying Signals.” PLoS Computational Biology. Public Library of Science, 2019. https://doi.org/10.1371/journal.pcbi.1007290.
S. A. Cepeda Humerez, J. Ruess, and G. Tkačik, “Estimating information in time-varying signals,” PLoS computational biology, vol. 15, no. 9. Public Library of Science, p. e1007290, 2019.
Cepeda Humerez SA, Ruess J, Tkačik G. 2019. Estimating information in time-varying signals. PLoS computational biology. 15(9), e1007290.
Cepeda Humerez, Sarah A., et al. “Estimating Information in Time-Varying Signals.” PLoS Computational Biology, vol. 15, no. 9, Public Library of Science, 2019, p. e1007290, doi:10.1371/journal.pcbi.1007290.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
2019_PLoS_Cepeda-Humerez.pdf 3.08 MB
Material in ISTA:
Part of this Dissertation