Dynamic clicks task paper
10 Nov 2017, Neuro-Theory journal club. BCM

Task



Rats: 14 Long Evans rats. Controlled water schedule → water reward & punishment noise.
Training: Automated training protocol
Stimulus duration: 0.5 - 2 sec.
Sessions: At least 50 trials. Percent correct above 75% and fixation-drop rate below 25%. Average of 120 min on a single-day. Anti-biasing algorithm generates trials with correct answer on opposite side of rat’s favored side.

Claims from paper

Aim of study 

  • probe whether rodents can optimally discount evidence by adapting the timescale over which they accumulate it.  

Claimed results

  1. Optimal timescale for evidence discounting depends on both:
  1. environment volatility
  1. noise in sensory processing
  1. Rats accumulate (almost) optimally, if both variables above are considered.
  1. Rats adapt their integration timescale to the volatility of the environment (short → long → short).
  1. Model makes quantitative predictions about timing of changes of mind.
  1. Overall, paper establishes a quantitative behavioral framework to study adaptive evidence accumulation.

Optimal evidence accumulation model

Called ‘nonlinear theory’ in the paper

  • dadt=δR,tδL,t2hκsinh(κa)\displaystyle \frac{da}{dt} = \delta_{R,t}-\delta_{L,t}-\frac{2h}{\kappa}\sinh(\kappa a)

aa    is the posterior-odds ratio
δR,t,  δL,t\delta_{R,t},\ \ \delta_{L,t}     are the right and left auditory click trains (sum of delta functions)
hh    is the hazard rate, or volatility of the environment
κ\kappa    is the click reliability parameter. It indicates how much evidence a single click provides.

Linear model

Called  ‘linear discounting agent’ in the paper

  • dadt=δR,tδL,tλa\displaystyle \frac{da}{dt} = \delta_{R,t}-\delta_{L,t}-\lambda \cdot a

λ\lambda    is the discounting rate
1/λ1 / \lambda   is the integration timescale


  • Discounting rate λ\lambda varies with sensory noise nn (panel G below)
  • Behavioral λ\lambda is estimated by fitting an exponential, aebtae^{bt}, to the reverse kernel curve