Jump to content

Spike response model

From Wikipedia, the free encyclopedia

The spike response model (SRM)[1] is a spiking neuron model in which spikes are generated by either a deterministic[2] or a stochastic[1] threshold process. In the SRM, the membrane voltage V is described as a linear sum of the postsynaptic potentials (PSPs) caused by spike arrivals to which the effects of refractoriness and adaptation are added. The threshold is either fixed or dynamic. In the latter case it increases after each spike. The SRM is flexible enough to account for a variety of neuronal firing pattern in response to step current input.[2] The SRM has also been used in the theory of computation to quantify the capacity of spiking neural networks;[3] and in the neurosciences to predict the subthreshold voltage and the firing times of cortical neurons during stimulation with a time-dependent current stimulation.[4] The name Spike Response Model points to the property that the two important filters and of the model can be interpreted as the response of the membrane potential to an incoming spike (response kernel , the PSP) and to an outgoing spike (response kernel , also called refractory kernel). The SRM has been formulated in continuous time and in discrete time.[5] The SRM can be viewed as a generalized linear model (GLM)[6][7] or as an (integrated version of) a generalized integrate-and-fire model with adaptation.[2][8][9]

Model equations for SRM in continuous time

[edit]

In the SRM, at each moment in time t, a spike can be generated stochastically with instantaneous stochastic intensity or 'escape function'[8][9][5]

that depends on the momentary difference between the membrane voltage V(t) and the dynamic threshold .

The membrane voltage V(t) at time t is given by[8][5]

where tf is the firing time of spike number f of the neuron, Vrest is the resting voltage in the absence of input, I(t-s) is the input current at time t − s and is a linear filter (also called kernel) that describes the contribution of an input current pulse at time t − s to the voltage at time t. The contributions to the voltage caused by a spike at time are described by the refractory kernel . In particular,

describes the time course of the action potential starting at time as well as the spike-afterpotential.

The dynamic threshold is given by[8][4]

where is the firing threshold of an inactive neuron and describes the increase of the threshold after a spike at time . In case of a fixed threshold [i.e., =0], the refractory kernel should include only the spike-afterpotential, but not the shape of the spike itself.

A common choice[8][9][5] for the 'escape rate' (that is consistent with biological data[4]) is

where is a time constant that describes how quickly a spike is fired once the membrane potential reaches the threshold and is a sharpness parameter. For the threshold becomes sharp and spike firing occurs deterministically at the moment when the membrane potential hits the threshold from below. The sharpness value found in experiments is which that neuronal firing becomes non-neglibable as soon the membrane potential is a few mV below the formal firing threshold. The escape rate process via a soft threshold is reviewed in Chapter 9 of the textbook Neuronal Dynamics.[8]

In a network of N SRM neurons , the membrane voltage of neuron is given by[5]

where are the firing times of neuron j (i.e., its spike train), and describes the time course of the spike and the spike after-potential for neuron i, and describe the amplitude and time course of an excitatory or inhibitory postsynaptic potential (PSP) caused by the spike of the presynaptic neuron j. The time course of the PSP results from the convolution of the postsynaptic current caused by the arrival of a presynaptic spike from neuron j.

Model equations for SRM in discrete time

[edit]

For simulations, the SRM is usually implemented in discrete time.[5][10] In time step of duration , a spike is generated with probability

that depends on the momentary difference between the membrane voltage V and the dynamic threshold . The function F is often taken as a standard sigmoidal [11] with steepness parameter . But the functional form of F can also be calculated from the stochastic intensity in continuous time as where is the distance to threshold.[8][5]

The membrane voltage in discrete time is given by

where tf is the discretized firing time of the neuron, Vrest is the resting voltage in the absence of input, and is the input current at time (integrated over one time step). The input filter and the spike-afterpotential are defined as in the case of the SRM in continuous time.

For networks of SRM neurons in discrete time we define the spike train of neuron j as a sequence of zeros and ones, and rewrite the membrane potential as[5]

In this notation, the refractory kernel and the PSP shape can be interpreted as linear response filters applied to the binary spike trains .

Main applications of the SRM

[edit]

Theory of computation with pulsed neural networks

[edit]

Since the formulation as SRM provides an explicit expression for the membrane voltage (without the detour via a differential equations), SRMs have been the dominant mathematical model in a formal theory of computation with spiking neurons.[12][13][3]

Prediction of voltage and spike times of cortical neurons

[edit]

The SRM with dynamic threshold has been used to predict the firing time of cortical neurons with a precision of a few milliseconds.[4] Neurons were stimulated, via current injection, with time-dependent currents of different means and variance while the membrane voltage was recorded. The reliability of predicted spikes was close to the intrinsic reliability when the same time-dependent current was repeated several times. Moreover, extracting the shape of the filters and directly from the experimental data revealed that adaptation extends over time scales from tens of milliseconds to tens of seconds.[14][15] Thanks to the convexity properties of the likelihood in Generalized Linear Models,[6][7] parameter extraction is efficient.[16]

Associative memory in networks of spiking neurons

[edit]

SRM0 neurons have been used to construct an associative memory in a network of spiking neurons.[5][11] The SRM network[5] which stored a finite number of stationary patterns as attractors using a Hopfield-type connectivity matrix[17] was one of the first examples of attractor networks with spiking neurons.[18][19][20]

Population activity equations in large networks of spiking neurons

[edit]

For SRM neurons, an important variable characterizing the internal state of the neuron is the time since the last spike (or 'age' of the neuron) which enters into the refractory kernel . The population activity equations for SRM neurons can be formulated alternatively either as integral equations,[5][10][21] or as partial differential equations for the 'refractory density'.[5][10] Because the refractory kernel may include a time scale slower than that of the membrane potential, the population equations for SRM neurons provide powerful alternatives[22][21][23] to the more broadly used partial differential equations for the 'membrane potential density'.[19][24][25] Reviews of the population activity equation based on refractory densities can be found in[23] as well in Chapter 14 of the textbook Neuronal Dynamics.[8]

Spike patterns and temporal code

[edit]

SRMs are useful to understand theories of neural coding. A network SRM neurons has stored attractors that form reliable spatio-temporal spike patterns[1] (also known as synfire chains[26]) example of temporal coding for stationary inputs. Moreover, the population activity equations for SRM exhibit temporally precise transients after a stimulus switch, indicating reliable spike firing.[10]

4. History and relation to other models

[edit]

The Spike Response Model has been introduced in a series of papers between 1991[11] and 2000.[2][5][10][27] The name Spike Response Model probably appeared for the first time in 1993.[1] Some papers used exclusively the deterministic limit with a hard threshold[2] others the soft threshold with escape noise.[5] Precursors of the Spike Response Model are the integrate-and-fire model introduced by Lapicque in 1907 as well as models used in auditory neuroscience.[28][29][30][31]

SRM0

[edit]

An important variant of the model is SRM0[10] which is related to time-dependent nonlinear renewal theory. The main difference to the voltage equation of the SRM introduced above is that in the term containing the refractory kernel there is no summation sign over past spikes: only the most recent spike matters. The model SRM0 is closely related to the inhomogeneous Markov interval process[32] and to age-dependent models of refractoriness.[29][30][31]

GLM

[edit]

The equations of the SRM as introduced above are equivalent to Generalized Linear Models in neuroscience (GLM).[6][7] In the neuroscience, GLMs have been introduced as an extension of the Linear-Nonlinear-Poisson model (LNP) by adding self-interaction of an output spike with the internal state of the neuron[6][7] (therefore also called 'Recursive LNP'). The self-interaction is equivalent to the kernel of the SRM. The GLM framework enables to formulate a maximum likelihood approach[33] applied to the likelihood of an observed spike train under the assumption that an SRM could have generated the spike train.[8] Despite the mathematical equivalence there is a conceptual difference in interpretation: in the SRM the variable V is interpreted as membrane voltage whereas in the recursive LNP it is a 'hidden' variable to which no meaning is assigned. The SRM interpretation is useful if measurements of subthreshold voltage are available[4][14][15] whereas the recursive LNP is useful in systems neuroscience where spikes (in response to sensory stimulation) are recorded extracellulary without access to the subthreshold voltage.[6][7]

Adaptive leaky integrate-and-fire models

[edit]

A leaky integrate-and-fire neuron with spike-triggered adaptation has a subthreshold membrane potential generated by the following differential equations

where is the membrane time constant and wk is an adaptation current number, with index k, Erest is the resting potential and tf is the firing time of the neuron and the Greek delta denotes the Dirac delta function. Whenever the voltage reaches the firing threshold the voltage is reset to a value Vr below the firing threshold. Integration of the linear differential equations gives a formula identical to the voltage equation of the SRM.[2] However, in this case, the refractory kernel does not include the spike shape but only the spike-afterpotential. In the absence of adaptation currents, we retrieve the standard LIF model which is equivalent to a refractory kernel that decays exponentially with the membrane time constant .

[edit]

Reference section

[edit]
  1. ^ a b c d Gerstner, Wulfram; Ritz, Raphael; van Hemmen, J. Leo (1993-10-01). "Why spikes? Hebbian learning and retrieval of time-resolved excitation patterns". Biological Cybernetics. 69 (5): 503–515. doi:10.1007/BF00199450. ISSN 1432-0770. PMID 7903867. S2CID 6195748.
  2. ^ a b c d e f Gerstner, Wulfram; van Hemmen, J. Leo; Cowan, Jack D. (1996-11-15). "What Matters in Neuronal Locking?". Neural Computation. 8 (8): 1653–1676. doi:10.1162/neco.1996.8.8.1653. ISSN 0899-7667. PMID 8888612. S2CID 1301248.
  3. ^ a b Maass, Wolfgang (1997-02-01). "Fast Sigmoidal Networks via Spiking Neurons". Neural Computation. 9 (2): 279–304. doi:10.1162/neco.1997.9.2.279. ISSN 0899-7667. PMID 9117904. S2CID 34984298.
  4. ^ a b c d e Jolivet, Renaud; Rauch, Alexander; Lüscher, Hans-Rudolf; Gerstner, Wulfram (August 2006). "Predicting spike timing of neocortical pyramidal neurons by simple threshold models". Journal of Computational Neuroscience. 21 (1): 35–49. doi:10.1007/s10827-006-7074-5. ISSN 0929-5313. PMID 16633938. S2CID 8911457.
  5. ^ a b c d e f g h i j k l m n Gerstner, Wulfram; Hemmen, J. Leo van (1992-01-01). "Associative memory in a network of 'spiking' neurons". Network: Computation in Neural Systems. 3 (2): 139–164. doi:10.1088/0954-898X_3_2_004. ISSN 0954-898X.
  6. ^ a b c d e Truccolo, Wilson; Eden, Uri T.; Fellows, Matthew R.; Donoghue, John P.; Brown, Emery N. (2005-02-01). "A Point Process Framework for Relating Neural Spiking Activity to Spiking History, Neural Ensemble, and Extrinsic Covariate Effects". Journal of Neurophysiology. 93 (2): 1074–1089. doi:10.1152/jn.00697.2004. ISSN 0022-3077. PMID 15356183.
  7. ^ a b c d e Pillow, Jonathan W.; Shlens, Jonathon; Paninski, Liam; Sher, Alexander; Litke, Alan M.; Chichilnisky, E. J.; Simoncelli, Eero P. (August 2008). "Spatio-temporal correlations and visual signalling in a complete neuronal population". Nature. 454 (7207): 995–999. Bibcode:2008Natur.454..995P. doi:10.1038/nature07140. ISSN 1476-4687. PMC 2684455. PMID 18650810.
  8. ^ a b c d e f g h i j k l Gerstner, Wulfram. (24 July 2014). Neuronal dynamics : from single neurons to networks and models of cognition. Kistler, Werner M., 1969-, Naud, Richard., Paninski, Liam. Cambridge, United Kingdom. ISBN 978-1-107-06083-8. OCLC 861774542.{{cite book}}: CS1 maint: location missing publisher (link)
  9. ^ a b c Gerstner, Wulfram. (2002). Spiking neuron models : single neurons, populations, plasticity. Kistler, Werner M., 1969-. Cambridge, U.K.: Cambridge University Press. ISBN 0-511-07817-X. OCLC 57417395.
  10. ^ a b c d e f Gerstner, Wulfram (2000-01-01). "Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking". Neural Computation. 12 (1): 43–89. doi:10.1162/089976600300015899. ISSN 0899-7667. PMID 10636933. S2CID 7832768.
  11. ^ a b c GERSTNER, Wulfram (1991). [papers.nips.cc/paper/371-associative-memory-in-a-network-of-biological-neurons.pdf "Associative memory in a network of biological neurons"] (PDF). Advances in Neural Information Processing Systems. 3: 84–90. {{cite journal}}: Check |url= value (help)
  12. ^ Pulsed neural networks. Maass, Wolfgang, 1949 August 21-, Bishop, Christopher M. Cambridge, Mass.: MIT Press. 1999. ISBN 978-0-262-27876-8. OCLC 42856203.{{cite book}}: CS1 maint: others (link)
  13. ^ Bohte, Sander M.; Kok, Joost N.; La Poutré, Han (2002-10-01). "Error-backpropagation in temporally encoded networks of spiking neurons". Neurocomputing. 48 (1): 17–37. doi:10.1016/S0925-2312(01)00658-0. ISSN 0925-2312.
  14. ^ a b Pozzorini, Christian; Naud, Richard; Mensi, Skander; Gerstner, Wulfram (July 2013). "Temporal whitening by power-law adaptation in neocortical neurons". Nature Neuroscience. 16 (7): 942–948. doi:10.1038/nn.3431. ISSN 1546-1726. PMID 23749146. S2CID 1873019.
  15. ^ a b Mensi, Skander; Naud, Richard; Pozzorini, Christian; Avermann, Michael; Petersen, Carl C. H.; Gerstner, Wulfram (2011-12-07). "Parameter extraction and classification of three cortical neuron types reveals two distinct adaptation mechanisms". Journal of Neurophysiology. 107 (6): 1756–1775. doi:10.1152/jn.00408.2011. ISSN 0022-3077. PMID 22157113.
  16. ^ Pozzorini, Christian; Mensi, Skander; Hagens, Olivier; Naud, Richard; Koch, Christof; Gerstner, Wulfram (2015-06-17). "Automated High-Throughput Characterization of Single Neurons by Means of Simplified Spiking Models". PLOS Computational Biology. 11 (6): e1004275. Bibcode:2015PLSCB..11E4275P. doi:10.1371/journal.pcbi.1004275. ISSN 1553-7358. PMC 4470831. PMID 26083597.
  17. ^ Hopfield, J. J. (1982-04-01). "Neural networks and physical systems with emergent collective computational abilities". Proceedings of the National Academy of Sciences. 79 (8): 2554–2558. Bibcode:1982PNAS...79.2554H. doi:10.1073/pnas.79.8.2554. ISSN 0027-8424. PMC 346238. PMID 6953413.
  18. ^ Amit, Daniel J.; Tsodyks, M. V. (1991-01-01). "Quantitative study of attractor neural network retrieving at low spike rates: I. substrate—spikes, rates and neuronal gain". Network: Computation in Neural Systems. 2 (3): 259–273. doi:10.1088/0954-898X_2_3_003. ISSN 0954-898X.
  19. ^ a b Amit, D. (1997-04-01). "Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex". Cerebral Cortex. 7 (3): 237–252. doi:10.1093/cercor/7.3.237. ISSN 1460-2199. PMID 9143444.
  20. ^ Brader, Joseph M.; Senn, Walter; Fusi, Stefano (2007-09-20). "Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics". Neural Computation. 19 (11): 2881–2912. doi:10.1162/neco.2007.19.11.2881. ISSN 0899-7667. PMID 17883345. S2CID 5933554.
  21. ^ a b Schwalger, Tilo; Deger, Moritz; Gerstner, Wulfram (2017-04-19). Graham, Lyle J. (ed.). "Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size". PLOS Computational Biology. 13 (4): e1005507. arXiv:1611.00294. Bibcode:2017PLSCB..13E5507S. doi:10.1371/journal.pcbi.1005507. ISSN 1553-7358. PMC 5415267. PMID 28422957.
  22. ^ Naud, Richard; Gerstner, Wulfram (2012-10-04). "Coding and Decoding with Adapting Neurons: A Population Approach to the Peri-Stimulus Time Histogram". PLOS Computational Biology. 8 (10): e1002711. Bibcode:2012PLSCB...8E2711N. doi:10.1371/journal.pcbi.1002711. ISSN 1553-7358. PMC 3464223. PMID 23055914.
  23. ^ a b Schwalger, Tilo; Chizhov, Anton V (2019-10-01). "Mind the last spike — firing rate models for mesoscopic populations of spiking neurons". Current Opinion in Neurobiology. Computational Neuroscience. 58: 155–166. arXiv:1909.10007. doi:10.1016/j.conb.2019.08.003. ISSN 0959-4388. PMID 31590003. S2CID 202719555.
  24. ^ Treves, Alessandro (January 1993). "Mean-field analysis of neuronal spike dynamics". Network: Computation in Neural Systems. 4 (3): 259–284. doi:10.1088/0954-898X_4_3_002. ISSN 0954-898X.
  25. ^ Brunel, Nicolas (2000-05-01). "Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons". Journal of Computational Neuroscience. 8 (3): 183–208. doi:10.1023/A:1008925309027. ISSN 1573-6873. PMID 10809012. S2CID 1849650.
  26. ^ Abeles, Moshe (2009). "Synfire chains". Scholarpedia. 4 (7): 1441. Bibcode:2009SchpJ...4.1441A. doi:10.4249/scholarpedia.1441. ISSN 1941-6016.
  27. ^ Gerstner, Wulfram (1995-01-01). "Time structure of the activity in neural network models". Physical Review E. 51 (1): 738–758. Bibcode:1995PhRvE..51..738G. doi:10.1103/PhysRevE.51.738. PMID 9962697.
  28. ^ Weiss, Thomas F. (1966-11-01). "A model of the peripheral auditory system". Kybernetik. 3 (4): 153–175. doi:10.1007/BF00290252. ISSN 1432-0770. PMID 5982096. S2CID 30861035.
  29. ^ a b Johnson, Don H.; Swami, Ananthram (1983-08-01). "The transmission of signals by auditory-nerve fiber discharge patterns". The Journal of the Acoustical Society of America. 74 (2): 493–501. Bibcode:1983ASAJ...74..493J. doi:10.1121/1.389815. ISSN 0001-4966. PMID 6311884.
  30. ^ a b Berry, Michael J.; Meister, Markus (1998-03-15). "Refractoriness and Neural Precision". The Journal of Neuroscience. 18 (6): 2200–2211. doi:10.1523/JNEUROSCI.18-06-02200.1998. ISSN 0270-6474. PMC 6792934. PMID 9482804.
  31. ^ a b Gaumond, R P; Molnar, C E; Kim, D O (September 1982). "Stimulus and recovery dependence of cat cochlear nerve fiber spike discharge probability". Journal of Neurophysiology. 48 (3): 856–873. doi:10.1152/jn.1982.48.3.856. ISSN 0022-3077. PMID 6290620.
  32. ^ Kass, Robert E.; Ventura, Valérie (2001-08-01). "A Spike-Train Probability Model". Neural Computation. 13 (8): 1713–1720. doi:10.1162/08997660152469314. ISSN 0899-7667. PMID 11506667. S2CID 9909632.
  33. ^ Brillinger, D. R. (1988-08-01). "Maximum likelihood analysis of spike trains of interacting nerve cells". Biological Cybernetics. 59 (3): 189–200. doi:10.1007/BF00318010. ISSN 1432-0770. PMID 3179344. S2CID 10164135.
  34. ^ Gerstner, Wulfram (2008). "Spike-response model". Scholarpedia. 3 (12): 1343. Bibcode:2008SchpJ...3.1343G. doi:10.4249/scholarpedia.1343. ISSN 1941-6016.