How Pixel Features Respond to Input Rate

Abstract

We asked how the spike rate produced by a fully active pixel determines the average voltage feature passed to downstream classifiers. We compared direct membrane simulations with a simpler theory that treats the system as steady and approximately linear.

The theory reproduced the general filtering pattern and mean-response shape, but predicted responses that were too large and failed to capture variation between presentations. Accurately predicting voltage averaged over one presentation therefore still requires direct simulation of individual event counts and timings in this system.

Results

Voltage moments across input rates

Each presentation began from rest. We varied input rate and conductance per event, then averaged the voltage rise over the presentation (Fig. 1).

Two panels show how the simulated mean voltage and its standard deviation change with input rate for three event strengths.
Figure 1: (A) Simulated mean voltage feature and (B) sample SD, in mV, across 101 input rates. Each condition summarizes 512 independent presentations. Black, red and cyan denote 0.6, 1.2, 2.4 μS added per event; curves summarize the presentations and are not confidence intervals.

Higher rates should raise mean voltage. Variation could be nonmonotonic because event counts and timing differ between presentations and membrane responses are nonlinear.

Mean voltage rose with both input rate and event strength. Its SD rose at low rates, then levelled off or fell for the two weaker event strengths, but remained high for the strongest. This may reflect relatively steadier event counts plus shunting and saturation; we did not test these mechanisms separately.

Input-rate response distributions

Here we kept presentation duration and event strength fixed, and changed only the input rate from sparse to dense drive (Fig. 2).

Three histograms show voltage responses changing from mostly near zero to a broad continuous spread as input rate increases.
Figure 2: Distributions of the voltage feature at (A–C) 0.25, 3, 25 spikes/s, respectively, and 1.2 μS, using 4096 independent presentations per condition. Each bar gives the probability within one shared fixed-width bin. The vertical axis is logarithmic and voltage is in mV.

Input rate determines the expected number of events, not the exact number in any one presentation. A presentation may contain no events, one event or many; even equal event counts can give different average voltages when their timing differs.

At the lowest rate, most responses were near zero. The middle rate produced a mixture of sparse responses, while the highest rate produced a broad, almost continuous spread of responses.

Filtering before and after averaging

This figure shows the theory’s response around three steady input rates. It is a theoretical prediction; we did not measure these curves by deliberately varying the input rate over time (Fig. 3).

Two panels show the predicted response to slow and fast input changes before and after averaging voltage over the presentation.
Figure 3: Theoretical responses at 1.2 μS. The simulated input rate was not deliberately varied over time to measure these curves. Black, red and cyan denote steady input rates of 0.25, 3, 25 spikes/s. (A) shows the synapse and membrane response. (B) also includes 200 ms time averaging. Magnitude is in dB relative to the steady response at the lowest input rate; frequency is in Hz.

The model responds similarly to slow changes, but increasingly suppresses changes that are faster than the synapse and membrane can follow. Stronger input also reduces the response to slow changes because it increases shunting and leaves less voltage difference to drive excitation. Averaging over a fixed window adds the regularly spaced dips and rebounds in the response.

Theory versus simulation

The simpler theory replaces each random conductance history with its mean steady state, then assumes that the remaining fluctuations are small (Fig. 4).

Two panels compare theoretical curves with simulated points for mean voltage and standard deviation across input rates.
Figure 4: Steady-state predictions (solid curves) and simulated estimates (points) of (A) mean feature and (B) sample SD, in mV. Each estimate uses 512 presentations per rate. Black, red and cyan denote 0.6, 1.2, 2.4 μS added per event.

If quantitatively accurate, this approximation would reproduce the simulated mean and SD curves.

Predicted means preserved the broad curvature and event-strength ordering (Pearson correlation 0.923), but were too large by a median factor of 1.975. The predicted and simulated SDs agreed poorly (Pearson correlation 0.291), especially for the largest event strength. The theory therefore explains the general filtering pattern, but not the amount of variation across finite presentations.

Methods

  1. Set the conditions. We used a fully active pixel and varied its input rate from 0 to 25 spikes/s across 101 conditions. We also varied the conductance added by each event across 0.6, 1.2, 2.4 μS. Each condition used 512 independent encoding draws of a 200 ms presentation. Separate distribution measurements used 4096 draws at 0.25, 3, 25 spikes/s and 1.2 μS.

  2. Generate input events. At each simulation step 𝑘, we made an independent yes-or-no event draw with probability 𝑝event=𝑟inputΔ𝑡sim1000, where 𝑟input is input rate in spikes/s and Δ𝑡sim=0.1 ms. Physical time was 𝑡𝑘=𝑘Δ𝑡sim and 𝑁𝑡=𝑇presentΔ𝑡sim steps formed one presentation. We used separate reproducible random streams for the moment and distribution measurements. Every presentation began with zero conductance and the membrane at its resting voltage.

  3. Integrate conductance and voltage. AMPA conductance decayed with time constant 𝜏AMPA=2 ms, and each event then added its assigned conductance. Membrane voltage obeyed

    𝐶𝑚𝑑𝑉𝑚𝑑𝑡=𝑔𝐿(𝐸𝐿𝑉𝑚)+𝑔(𝑡)(𝐸𝑒𝑉𝑚).
    (1)

    Here 𝑡 is physical time in ms, 𝑉𝑚 is membrane voltage in mV, 𝑔 is excitatory conductance in μS, 𝐶𝑚=1 nF is capacitance, 𝑔𝐿=0.05 μS is leak conductance, and 𝐸𝐿=−65 mV and 𝐸𝑒=0 mV are reversal potentials. Within each step, we held the updated conductance fixed and used the exact exponential voltage solution in single precision.

  4. Measure the voltage feature. For each encoding draw, we approximated

    𝑧feature=1𝑇present0𝑇present(𝑉𝑚(𝑡)𝐸𝐿)d𝑡.
    (2)

    Here 𝑧feature is the mean voltage rise above rest, in mV, and 𝑇present=200 ms is presentation duration. The recorded estimate subtracted resting voltage and averaged the 𝑁𝑡 voltages measured after each simulation update.

  1. Summarize the simulated responses. For every rate–strength condition, we calculated the mean and sample SD across encoding draws; the SD used the usual 𝑛1 variance denominator. For the distribution measurements, we used 60 equal-width bins from zero to the largest response rounded up to the next 5 mV, then divided each bin count by the number of draws.

  2. Calculate the steady-state prediction. For each condition, we calculated the mean conductance and its equilibrium voltage. We then assumed that small fluctuations around this steady state followed a linear synaptic and membrane response. Averaging across the presentation gave 𝐻𝑟(𝜔), the predicted mapping from input fluctuations to the voltage feature at angular frequency 𝜔 in rad/ms, with predicted variance

    Var(𝑧feature)=12𝜋|𝐻𝑟(𝜔)|2(𝑟input1000)d𝜔.
    (3)

    Appendix: simulation and theory details specifies this approximation, and Appendix: how the simpler theory is derived shows where it comes from.

  3. Integrate and compare. We numerically integrated Equation 3 on a logarithmically spaced frequency grid, included the unrepresented near-zero-frequency tail and repeated the calculation on a coarser grid as a check. We compared predicted and simulated means and SDs using Pearson correlation, mean absolute error and the median predicted-to-simulated ratio. We excluded pairs in which both values were zero, calculated ratios only for positive simulated values and left undefined correlations undefined. We expressed frequency-response magnitude relative to the zero-frequency response at the lowest input rate.

  1. Show the simulated evidence. We displayed the recorded means and sample SDs for every rate–strength condition, together with the probability in each shared bin for the three distribution measurements. We reused the retained analysis without generating new draws or confidence intervals.

  2. Show the theoretical evidence. We displayed the predicted response to different frequencies before and after time averaging, then overlaid the predicted and simulated means and SDs for the same conditions. The frequency-response figure shows a theoretical mechanism, not a measured response to an input rate deliberately varied over time. We did not recalculate the statistics or rerun the simulation while preparing the figures.

Dataset

Appendix: simulation and theory details

Simulate one pixel’s voltage feature

We set the normalized pixel intensity to its maximum, 𝑥=1, and varied only its input rate 𝑟input, from 0 to 25 spikes/s. At each simulation step, the pixel either generated an event or did not. The event probability was

𝑝event=𝑟inputΔ𝑡sim1000.(A1)
(4)

Here 𝑟input is the input rate in spikes/s and Δ𝑡sim=0.1 ms is the length of one simulation step. Over a presentation lasting 𝑇present=200 ms, the expected event count is 𝑟input𝑇present1000. We therefore controlled the rate; the number of events in an individual presentation remained random.

Each event increased AMPA conductance, which then decayed over time:

𝑔[𝑘]=𝛽AMPA𝑔[𝑘1]+𝑤event𝑠[𝑘],(A2)
(5)
𝛽AMPA=exp(Δ𝑡sim𝜏AMPA),(A3)
(6)
𝐶𝑚𝑑𝑉𝑚𝑑𝑡=𝑔𝐿(𝐸𝐿𝑉𝑚)+𝑔(𝑡)(𝐸𝑒𝑉𝑚).(A4)
(7)

The indicator 𝑠[𝑘] equals one when step 𝑘 contains an event and zero otherwise. The AMPA conductance at that step is 𝑔[𝑘]; each event adds 𝑤event. Between events, conductance retains the fraction 𝛽AMPA from the previous step, as set by the AMPA decay time 𝜏AMPA. Membrane voltage 𝑉𝑚(𝑡) then follows Equation A4, where 𝐶𝑚 is membrane capacitance, 𝑔𝐿 is leak conductance, 𝐸𝐿 is the resting leak potential and 𝐸𝑒 is the excitatory reversal potential.

We used 𝐶𝑚=1 nF, 𝑔𝐿=0.05 μS, 𝐸𝐿=65 mV, 𝐸𝑒=0 mV, 𝜏AMPA=2 ms, and event strengths 𝑤event{0.6, 1.2, 2.4} μS. Every presentation began with no AMPA conductance, 𝑔(0)=0, and the membrane at rest, 𝑉𝑚(0)=𝐸𝐿. We defined its voltage feature as

𝑧feature=1𝑇present0𝑇present(𝑉𝑚(𝑡)𝐸𝐿)d𝑡.(A5)
(8)

The feature 𝑧feature is the average voltage above rest during the presentation. In the discrete simulation, we approximated this integral by averaging the voltage after each update and subtracting 𝐸𝐿.

For the mean and SD estimates in Figure 1, we generated 512 new presentations at each of 101 input rates and each conductance. For the full response distributions in Figure 2, we generated 4096 new presentations at each selected rate. This direct simulation preserves the random event counts and timings, the start from rest, and their combined effect within the finite presentation[1].

Replace random input with its steady average

The simpler theory begins by replacing the changing AMPA conductance with its long-run average. For an ongoing Poisson input at rate 𝑟=𝑟input, filtered-shot-noise theory[2] gives this mean as

𝑔̄𝑟=𝑟𝑤event𝜏AMPA1000.(A6)
(9)

Holding conductance at this mean gives the corresponding steady membrane voltage:

𝑣̄𝑟=𝑔𝐿𝐸𝐿+𝑔̄𝑟𝐸𝑒𝑔𝐿+𝑔̄𝑟.(A7)
(10)

Because this voltage does not change during the presentation, the predicted mean feature is simply its rise above rest:

𝜇linear(𝑧)=𝑣̄𝑟𝐸𝐿.(A8)
(11)

An overbar marks a steady average. Thus 𝑔̄𝑟 is the mean conductance at input rate 𝑟, 𝑣̄𝑟 is the voltage produced by that mean conductance, and 𝜇linear(𝑧) is the theory’s predicted mean voltage feature. From events to steady conductance and voltage derives Equations A6–A8 from the continuous conductance and membrane equations.

Predict responses to slow and fast changes

Next, we asked how a small change in input rate would change voltage around the steady state. Treating these changes as small makes the equations linear and gives

𝐺𝑟(𝜔)=𝑤event𝑖𝜔+1𝜏AMPA𝐸𝑒𝑣̄𝑟𝑖𝜔𝐶𝑚+𝑔𝐿+𝑔̄𝑟.(A9)
(12)

Here 𝜔 is angular frequency in rad/ms and 𝑖 is the imaginary unit. The transfer function 𝐺𝑟(𝜔) tells us how strongly voltage responds to an input change at each frequency. It describes small changes around the steady state, not the full start-from-rest simulation. Synapse and membrane response derives Equation A9.

The experiment does not use instantaneous voltage: it averages voltage over the presentation. That averaging has its own frequency response,

𝐴𝑇present(𝜔)=1exp(𝑖𝜔𝑇present)𝑖𝜔𝑇present.(A10)
(13)

which multiplies the synapse-and-membrane response to give the complete response from input rate to voltage feature:

𝐻𝑟(𝜔)=𝐴𝑇present(𝜔)𝐺𝑟(𝜔).(A11)
(14)

Here 𝐴𝑇present(𝜔) describes averaging over presentation duration 𝑇present, and 𝐻𝑟(𝜔) describes the complete path from input-rate change to the averaged voltage feature. Averaging over the presentation derives Equations A10 and A11.

To generate Figure 3, we evaluated Equations A9 and A11 from 0.1 to 200 Hz at 0.25, 3, 25 spikes/s for the nominal 1.2 μS event strength. We converted frequency 𝑓 in Hz to angular frequency using 𝜔=2𝜋𝑓1000. To compare response shapes, we expressed every magnitude relative to the steady response at the lowest input rate:

𝑀𝑋(𝑓)=20log10(|𝑋𝑟(2𝜋𝑓1000)||𝑋𝑟low(0)|).(A12)
(15)

Here 𝑀𝑋(𝑓) is response magnitude in decibels (dB). We used 𝑋𝑟=𝐺𝑟 for Figure 3A and 𝑋𝑟=𝐻𝑟 for Figure 3B. The variable 𝑓 is the frequency of the input change in Hz, and 𝑟low is the lowest steady input rate used as the reference.

Predict variation in the voltage feature

An ideal Poisson event train has equal fluctuation power at every frequency. After subtracting its mean, its power across positive and negative frequencies on the millisecond time base is

𝑆in(𝜔)=𝑟input1000.(A13)
(16)

The filter scales that input power by |𝐻𝑟(𝜔)|2. The predicted power spectrum of the voltage feature and its total variance are therefore

𝑆𝑧(𝜔)=|𝐻𝑟(𝜔)|2𝑆in(𝜔),(A14)
(17)
Varlinear(𝑧)=12𝜋|𝐻𝑟(𝜔)|2𝑆in(𝜔)d𝜔.(A15)
(18)

Here 𝑆in(𝜔) is the input power at each frequency, 𝑆𝑧(𝜔) is the resulting feature power, and Varlinear(𝑧) is the predicted variance of the voltage feature. From Poisson events to feature variance derives Equations A13–A15.

We evaluated the integral in Equation A15 numerically on a logarithmically spaced frequency grid. We repeated the calculation with half as many points to check that the numerical result was stable.

Why the simpler theory misses the variation

The simpler theory first averages conductance and then calculates the voltage response, written 𝑧(𝐸[𝑔]). The simulation instead calculates a response for every random conductance history and then averages those responses, written 𝐸[𝑧(𝑔)]. Because voltage saturates, these two operations are not interchangeable. Here the approximate relationship is

𝐸[𝑧(𝑔)]<𝑧(𝐸[𝑔]).
(19)

The steady theory also treats input as if it acted throughout the whole presentation. In the simulation, an event arriving near the end contributes to the average in Equation A5 for only a short time.

More generally, the simulated feature distribution combines presentations with different event counts and, within each count, different event timings:

𝑝𝑍(𝑧)=𝑛=0𝑃(𝑁=𝑛)𝑝𝑍|𝑁(𝑧|𝑛).(D2)
(20)

Here 𝑍 is the random voltage feature, 𝑁 is the event count, 𝑃(𝑁=𝑛) is the probability of observing 𝑛 events, and 𝑝𝑍|𝑁(𝑧|𝑛) is the distribution of feature values among presentations containing exactly 𝑛 events.

Equation A15 instead describes small fluctuations around one steady state. At low rates, a presentation with no events stays exactly at rest, a single large event produces a response that depends strongly on its arrival time, and multiple events interact through shunting and voltage saturation. This irregular mixture explains why the theoretical SD rose too sharply and peaked too early, especially for the strongest events.

Appendix: how the simpler theory is derived

From events to steady conductance and voltage

In the simulation, 𝑠[𝑘] records whether step 𝑘 contains an event. For the continuous-time calculation, we represent the same event sequence as 𝑠(𝑡)=𝑗𝛿(𝑡𝑡𝑗): a train of instantaneous impulses at event times 𝑡𝑗. AMPA conductance then follows

𝑑𝑔𝑑𝑡=𝑔𝜏AMPA+𝑤event𝑠(𝑡).(B1)
(21)

Here 𝛿(𝑡𝑡𝑗) is a Dirac impulse marking event 𝑗 at time 𝑡𝑗. Each impulse adds 𝑤event conductance, while existing conductance decays with time constant 𝜏AMPA.

A steady input rate of 𝑟 spikes/s is 𝑟1000 events per millisecond. To find the long-run mean conductance, we average Equation B1 and set its mean rate of change to zero:

0=𝑔̄𝑟𝜏AMPA+𝑤event𝑟1000,
(22)

Solving this equation gives Equation A6. At the corresponding steady membrane voltage, inward and outward current balance:

0=𝑔𝐿(𝐸𝐿𝑣̄𝑟)+𝑔̄𝑟(𝐸𝑒𝑣̄𝑟),(B2)
(23)

Rearranging the terms containing 𝑣̄𝑟 gives Equation A7.

Small changes through the synapse and membrane

We write each changing quantity as its steady value plus a small fluctuation:

𝑔=𝑔̄𝑟+𝛿𝑔,𝑣=𝑣̄𝑟+𝛿𝑣,𝑠=𝑟1000+𝛿𝑠.
(24)

Substituting these expressions into Equation B1 makes the steady terms cancel, leaving an equation for the conductance fluctuation:

𝑑𝛿𝑔𝑑𝑡=𝛿𝑔𝜏AMPA+𝑤event𝛿𝑠.(B3)
(25)

In the frequency domain, differentiation with respect to time becomes multiplication by 𝑖𝜔. The conductance response is therefore

𝛿𝑔(𝜔)=𝑤event𝑖𝜔+1𝜏AMPA𝛿𝑠(𝜔).(B4)
(26)

We apply the same decomposition to the membrane equation, Equation A4. The steady terms cancel through Equation B2. Because the theory assumes small fluctuations, it drops their product 𝛿𝑔𝛿𝑣, which is second order. This leaves

𝐶𝑚𝑑𝛿𝑣𝑑𝑡=(𝑔𝐿+𝑔̄𝑟)𝛿𝑣+(𝐸𝑒𝑣̄𝑟)𝛿𝑔.(B5)
(27)

Transforming Equation B5 into the frequency domain and substituting Equation B4 gives Equation A9. Its denominator contains two filters: one from AMPA conductance and one from the membrane. The numerator contains the conductance added per event and the local voltage difference driving excitation.

Averaging over the presentation

After assuming that fluctuations are small, the feature in Equation A5 is simply their average voltage during the presentation:

𝛿𝑧feature=1𝑇present0𝑇present𝛿𝑣(𝑡)d𝑡.(B6)
(28)

Averaging gives equal weight, 1𝑇present, to every time from zero to 𝑇present and zero weight outside that interval. The frequency response of this rectangular averaging window is

𝐴𝑇present(𝜔)=1𝑇present0𝑇presentexp(𝑖𝜔𝑡)d𝑡=1exp(𝑖𝜔𝑇present)𝑖𝜔𝑇present,
(29)

which is Equation A10. Because the averaging happens after the membrane response, their two frequency responses multiply, giving Equation A11. The identity 1exp(𝑖𝑥)=2𝑖exp(𝑖𝑥2)sin(𝑥2) shows that the magnitude is

|𝐴𝑇present(𝜔)|=|sin(𝜔𝑇present2)𝜔𝑇present2|,
(30)

With 𝑇𝑠=𝑇present1000 s and 𝜔=2𝜋𝑓1000,

|𝐴𝑇present(2𝜋𝑓1000)|=|sin(𝜋𝑓𝑇𝑠)𝜋𝑓𝑇𝑠|.(D1)
(31)

This response becomes zero at 𝑓=𝑛𝑇𝑠, where 𝑛 is any nonzero integer. At those frequencies, the presentation contains a whole number of cycles, so positive and negative parts cancel in the average. The repeated dips and rebounds come from this sinc-shaped averaging response; the synapse and membrane make the overall response fall at higher frequencies.

From Poisson events to feature variance

For ideal Poisson input at 𝑟input1000 events per millisecond, counts in separate time intervals are independent and the variance of each count equals its mean. After subtracting the mean event rate, the input autocovariance is

𝐶𝛿𝑠()=(𝑟input1000)𝛿().(B7)
(32)

Here 𝐶𝛿𝑠() measures how the centred input relates to itself after a time lag . The Dirac delta 𝛿() means that this ideal input is correlated with itself only at zero lag.

The frequency transform of a Dirac delta is constant, which gives the flat input spectrum in Equation A13. A linear filter multiplies that spectrum by the squared magnitude of its frequency response, giving Equation A14. Adding the feature power across all frequencies then gives its variance:

Var(𝑧)=𝑅𝑧(0)=12𝜋𝑆𝑧(𝜔)d𝜔,
(33)

Substituting Equation A14 gives Equation A15. This result is exact for the simplified model with steady input and small linear fluctuations. It is only an approximation to the simulated system, which is nonlinear, begins each presentation from rest and contains a finite random number of events.

References

  1. Marco Brigham and Alain Destexhe: Nonstationary Filtered Shot-Noise Processes and Applications to Neuronal Membranes. Physical Review E, 2015. doi:10.1103/PhysRevE.91.062102
  2. Lars Wolff and Benjamin Lindner: Mean, Variance, and Autocorrelation of Subthreshold Potential Fluctuations Driven by Filtered Conductance Shot Noise. Neural Computation, 2010. doi:10.1162/neco.2009.02-09-958