A simple method for estimating the entropy of neural activity

M. Berry, G. Tkacik, J. Dubuis, O. Marre, R. Da Silveira, Journal of Statistical Mechanics Theory and Experiment 2013 (2013).

Download
No fulltext has been uploaded. References only!

Journal Article | Published | English
Author
; ; ; ;
Department
Abstract
The number of possible activity patterns in a population of neurons grows exponentially with the size of the population. Typical experiments explore only a tiny fraction of the large space of possible activity patterns in the case of populations with more than 10 or 20 neurons. It is thus impossible, in this undersampled regime, to estimate the probabilities with which most of the activity patterns occur. As a result, the corresponding entropy - which is a measure of the computational power of the neural population - cannot be estimated directly. We propose a simple scheme for estimating the entropy in the undersampled regime, which bounds its value from both below and above. The lower bound is the usual 'naive' entropy of the experimental frequencies. The upper bound results from a hybrid approximation of the entropy which makes use of the naive estimate, a maximum entropy fit, and a coverage adjustment. We apply our simple scheme to artificial data, in order to check their accuracy; we also compare its performance to those of several previously defined entropy estimators. We then apply it to actual measurements of neural activity in populations with up to 100 cells. Finally, we discuss the similarities and differences between the proposed simple estimation scheme and various earlier methods. © 2013 IOP Publishing Ltd and SISSA Medialab srl.
Publishing Year
Date Published
2013-03-12
Journal Title
Journal of Statistical Mechanics Theory and Experiment
Volume
2013
Issue
3
Article Number
P03015
IST-REx-ID

Cite this

Berry M, Tkacik G, Dubuis J, Marre O, Da Silveira R. A simple method for estimating the entropy of neural activity. Journal of Statistical Mechanics Theory and Experiment. 2013;2013(3). doi:10.1088/1742-5468/2013/03/P03015
Berry, M., Tkacik, G., Dubuis, J., Marre, O., & Da Silveira, R. (2013). A simple method for estimating the entropy of neural activity. Journal of Statistical Mechanics Theory and Experiment, 2013(3). https://doi.org/10.1088/1742-5468/2013/03/P03015
Berry, Michael, Gasper Tkacik, Julien Dubuis, Olivier Marre, and Ravá Da Silveira. “A Simple Method for Estimating the Entropy of Neural Activity.” Journal of Statistical Mechanics Theory and Experiment 2013, no. 3 (2013). https://doi.org/10.1088/1742-5468/2013/03/P03015.
M. Berry, G. Tkacik, J. Dubuis, O. Marre, and R. Da Silveira, “A simple method for estimating the entropy of neural activity,” Journal of Statistical Mechanics Theory and Experiment, vol. 2013, no. 3, 2013.
Berry M, Tkacik G, Dubuis J, Marre O, Da Silveira R. 2013. A simple method for estimating the entropy of neural activity. Journal of Statistical Mechanics Theory and Experiment. 2013(3).
Berry, Michael, et al. “A Simple Method for Estimating the Entropy of Neural Activity.” Journal of Statistical Mechanics Theory and Experiment, vol. 2013, no. 3, P03015, IOP Publishing Ltd., 2013, doi:10.1088/1742-5468/2013/03/P03015.

Export

Marked Publications

Open Data IST Research Explorer

Search this title in

Google Scholar