Literature DB >> 21713111

Hyperbolic discounting emerges from the scalar property of interval timing.

Xu Cui1.   

Abstract

Entities:  

Year:  2011        PMID: 21713111      PMCID: PMC3112317          DOI: 10.3389/fnint.2011.00024

Source DB:  PubMed          Journal:  Front Integr Neurosci        ISSN: 1662-5145


× No keyword cloud information.
Ten dollars today is more attractive than the same amount of money tomorrow and is consistent with the well known proverb, “a bird in the hand is worth two in the bush.” We all know that the value of a reward is discounted over time. How the value discounts over time and what is the rationale for such discounting, however, is less clear. Classical economic theory has assumed an exponential form of discounting which has been repeatedly shown insufficient for explaining the data(Frederick and Loewenstein, 2002). Hyperbolic discounting, with a faster discount rate in the beginning than in the distant future, is found to fit the data better empirically. Consequently, it is of great interest to understand why people and other animals discount future rewards hyperbolically. In the past, a number of explanations have been offered. Not surprisingly these explanations can be categorized into either value-based models or time-based models. In value-based models, hyperbolic discounting emerges when discount rates are assumed to be stochastic (Farmer and Geanakoplos, 2009), or there is uncertainty of the risk that the future reward will not be realized (Sozou, 1998), or there is uncertainty of the timing of the realization (Dasgupta and Maskin, 2005). In time-based models, hyperbolic discounting can be shown to result from the perceptual distortion of time (Takahashi, 2005; Kim and Zauberman, 2009). Recently, Ray and Bossaerts (2011) offered another time-based explanation beginning with the crucial observation that subjective or psychological time is different from objective or physical time. They argued that the discounting function is indeed exponential with respect to the subject's internal clock, but it appears to be hyperbolic to observers who use objective time – the measurement of which isn't dependent upon biological systems and their inherent variability. Specifically, they made three assumptions: Increment of psychological time is stochastic and auto-correlated (i.e., the internal clock is positive quadrant dependent). Increment of psychological time is stationary. Value discounting over psychological time is exponential. Ray and Bossaerts performed both analytical proof and numeric simulation. When the auto-correlation of psychological time increments is reduced to 0, the discounting function becomes the classical exponential form; when the auto-correlation is non zero (e.g., 0.3), the discounting function becomes hyperbolic. Thus, hyperbolic discounting naturally emerges when psychological time advances in a self-correlated way – i.e., if the current increment is large, it's likely that the next increment is also large. This explanation is quite interesting and unlike other subjective time-based models (e.g., Takahashi, 2005; Kim and Zauberman, 2009) in which psychological time is a concave function of physical time, the psychological time in this model is actually synchronized with the physical time on average. This is an important property because experiments have shown that while we have uncertainty in estimating time intervals, the average of our estimates is actually quite accurate (Church et al., 1994; Rakitin et al., 1998; Buhusi and Meck, 2005). On the other hand, the representation of psychological time in this model does not follow the scalar property (or Weber's law) of timing and time perception, which has been demonstrated in numerous studies – including those involving optimal foraging (see Gibbon et al., 1984, 1997; Bateson, 2003 for reviews). The scalar property of interval timing means that the coefficient of variation of time estimates is a constant, thereby producing timescale invariance (Gibbon, 1977). Based on numeric simulation, the coefficient of variation in the Ray and Bossaerts (2011) model is decreasing over time. Here we demonstrate that hyperbolic discounting can be shown to result from the scalar property of time perception alone, without the assumption of internal exponential discounting over time. In a nutshell, Weber's law states that the incremental amount of change required for a stimulus to be perceptually differentiated or noticeable is proportional to the current stimulus magnitude. Time perception is well known to abide by Weber's law across a wide range of durations (Buhusi and Meck, 2005; Grondin, 2010 – but see Lewis and Miall, 2009). We reason that if the change in duration is not noticeable, then the change of the corresponding reward value should not be noticeable either. Otherwise people can detect the difference of time based on the difference of value. Let's assume that both the perception of value and time follow Weber's law with Weber fractions a and b, respectively. Imagine that a subject perceives the value of reward is V at time t. As time advances, the perceived value decreases. Consider a delay τ in time where the subject just perceives a noticeable change in time. With the scalar property of time perception, we have The delay also causes the perceived value to decrease. As the delay τ is a barely noticeable change, the change of value V, denoted as Δ, should also be barely noticeable (see Figure 1). That is:
Figure 1

A “just noticeable” change in time will result in a “just noticeable” change in the corresponding value.

A “just noticeable” change in time will result in a “just noticeable” change in the corresponding value. Combining the two equations together we get: We want to find an explicit form of V(t) satisfying the above condition. One solution is: This discounting function is hyperbolic, as the discount rate, |dV/dt/V|, is a decreasing function of t. This model has two advantages: (1) the free parameters, a and b, have psychological meaning and can be independently measured – see Meck, 2006; (2) the model does not assume any form of discounting to start with. However, it should be emphasized that the assumptions made in this model, i.e., Weber's law in time and value perception, are only valid within certain time ranges. Particularly, in the sub-second range, time perception typically does not always follow Weber's law so clearly (see Gibbon, 1977; Grondin, 2010).
  10 in total

Review 1.  Timing and time perception: a review of recent behavioral and neuroscience findings and theoretical directions.

Authors:  Simon Grondin
Journal:  Atten Percept Psychophys       Date:  2010-04       Impact factor: 2.199

Review 2.  What makes us tick? Functional and neural mechanisms of interval timing.

Authors:  Catalin V Buhusi; Warren H Meck
Journal:  Nat Rev Neurosci       Date:  2005-10       Impact factor: 34.870

3.  The precision of temporal judgement: milliseconds, many minutes, and beyond.

Authors:  P A Lewis; R C Miall
Journal:  Philos Trans R Soc Lond B Biol Sci       Date:  2009-07-12       Impact factor: 6.237

4.  Scalar expectancy theory and peak-interval timing in humans.

Authors:  B C Rakitin; J Gibbon; T B Penney; C Malapani; S C Hinton; W H Meck
Journal:  J Exp Psychol Anim Behav Process       Date:  1998-01

Review 5.  Toward a neurobiology of temporal cognition: advances and challenges.

Authors:  J Gibbon; C Malapani; C L Dale; C Gallistel
Journal:  Curr Opin Neurobiol       Date:  1997-04       Impact factor: 6.627

6.  Neuroanatomical localization of an internal clock: a functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems.

Authors:  Warren H Meck
Journal:  Brain Res       Date:  2006-08-04       Impact factor: 3.252

7.  Loss of self-control in intertemporal choice may be attributable to logarithmic time-perception.

Authors:  Taiki Takahashi
Journal:  Med Hypotheses       Date:  2005       Impact factor: 1.538

8.  Application of scalar timing theory to individual trials.

Authors:  R M Church; W H Meck; J Gibbon
Journal:  J Exp Psychol Anim Behav Process       Date:  1994-04

9.  Scalar timing in memory.

Authors:  J Gibbon; R M Church; W H Meck
Journal:  Ann N Y Acad Sci       Date:  1984       Impact factor: 5.691

10.  Positive temporal dependence of the biological clock implies hyperbolic discounting.

Authors:  Debajyoti Ray; Peter Bossaerts
Journal:  Front Neurosci       Date:  2011-01-28       Impact factor: 4.677

  10 in total
  14 in total

Review 1.  The hunt for the perfect discounting function and a reckoning of time perception.

Authors:  Vijay Mk Namboodiri; Marshall G Hussain Shuler
Journal:  Curr Opin Neurobiol       Date:  2016-07-29       Impact factor: 6.627

Review 2.  Cognitive and behavioral training interventions to promote self-control.

Authors:  Travis Smith; Kelsey Panfil; Carrie Bailey; Kimberly Kirkpatrick
Journal:  J Exp Psychol Anim Learn Cogn       Date:  2019-05-09       Impact factor: 2.478

3.  Everywhere and everything: The power and ubiquity of time.

Authors:  Andrew T Marshall; Kimberly Kirkpatrick
Journal:  Int J Comp Psychol       Date:  2015

4.  Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats.

Authors:  Kimberly Kirkpatrick; Andrew T Marshall; Aaron P Smith
Journal:  Comp Cogn Behav Rev       Date:  2015

5.  Effects of benztropine analogs on delay discounting in rats.

Authors:  Paul L Soto; Takato Hiranita
Journal:  Psychopharmacology (Berl)       Date:  2020-09-22       Impact factor: 4.530

6.  Dissociations between interval timing and intertemporal choice following administration of fluoxetine, cocaine, or methamphetamine.

Authors:  Sarah R Heilbronner; Warren H Meck
Journal:  Behav Processes       Date:  2013-10-14       Impact factor: 1.777

7.  Optimal temporal risk assessment.

Authors:  Fuat Balci; David Freestone; Patrick Simen; Laura Desouza; Jonathan D Cohen; Philip Holmes
Journal:  Front Integr Neurosci       Date:  2011-09-27

8.  Acquisition of "Start" and "Stop" response thresholds in peak-interval timing is differentially sensitive to protein synthesis inhibition in the dorsal and ventral striatum.

Authors:  Christopher J Macdonald; Ruey-Kuang Cheng; Warren H Meck
Journal:  Front Integr Neurosci       Date:  2012-03-14

9.  Time, self, and intertemporal choice.

Authors:  Cintia Retz Lucci
Journal:  Front Neurosci       Date:  2013-05-27       Impact factor: 4.677

10.  Fos expression in the prefrontal cortex and ventral striatum after exposure to a free-operant timing schedule.

Authors:  L Valencia-Torres; C M Olarte-Sánchez; S Body; T H C Cheung; K C F Fone; C M Bradshaw; E Szabadi
Journal:  Behav Brain Res       Date:  2012-08-16       Impact factor: 3.332

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.