Skip to main content

Simple neural networks that optimize decisions

Eric Brown, Juan Gao, Philip Holmes, Rafal Bogacz, Mark Gilzenrat, Jonathan D. Cohen, Simple neural networks that optimize decisions. International Journal of Bifurcation and Chaos, 15(3), pp. 803–826. June 2005. PDF, 605 Kbytes.

Abstract

We review simple connectionist and firing rate models for mutually inhibiting pools of neurons that discriminate between pairs of stimuli. Both are two-dimensional nonlinear stochastic ordinary differential equations, and although they differ in how inputs and stimuli enter, we show that they are equivalent under state variable and parameter coordinate changes. A key parameter is gain: the maximum slope of the sigmoidal activation function. We develop piecewise-linear and purely linear models, and one-dimensional reductions to Ornstein Uhlenbeck processes that can be viewed as linear filters, and show that reaction time and error rate statistics are well approximated by these simpler models. We then pose and solve the optimal gain problem for the Ornstein Uhlenbeck processes, finding explicit gain schedules that minimize error rates for time-varying stimuli. We relate these to time courses of norepinephrine release in cortical areas, and argue that transient firing rate changes in the brainstem nucleus locus coeruleus may be responsible for approximate gain optimization.

Bibtex entry.

Contact details

Publication Admin