Hyperbolic discounting

In economics, hyperbolic discounting is a time-inconsistent model of delay discounting. It is one of the cornerstones of behavioral economics[1][2] and its brain-basis is actively being studied by neuroeconomics researchers.[3]

The discounted utility approach states that intertemporal choices are no different from other choices, except that some consequences are delayed and hence must be anticipated and discounted (i.e., reweighted to take into account the delay).

Given two similar rewards, humans show a preference for one that arrives sooner rather than later. Humans are said to discount the value of the later reward, by a factor that increases with the length of the delay. In the financial world, this process is normally modeled in the form of exponential discounting, a time-consistent model of discounting. Many psychological studies have since demonstrated deviations in instinctive preference from the constant discount rate assumed in exponential discounting.[4] Hyperbolic discounting is an alternative mathematical model that agrees more closely with these findings.[5]

According to hyperbolic discounting, valuations fall relatively rapidly for earlier delay periods (as in, from now to one week), but then fall more slowly for longer delay periods (for instance, more than a few days). For example, in an early study subjects said they would be indifferent between receiving $15 immediately or $30 after 3 months, $60 after 1 year, or $100 after 3 years. These indifferences reflect annual discount rates that declined from 277% to 139% to 63% as delays got longer.[6] This contrasts with exponential discounting, in which valuation falls by a constant factor per unit delay and the discount rate stays the same.

The standard experiment used to reveal a test subject's hyperbolic discounting curve is to compare short-term preferences with long-term preferences. For instance: "Would you prefer a dollar today or three dollars tomorrow?" or "Would you prefer a dollar in one year or three dollars in one year and one day?" It has been claimed that a significant fraction of subjects will take the lesser amount today, but will gladly wait one extra day in a year in order to receive the higher amount instead.[6] Individuals with such preferences are described as "present-biased".

The most important consequence of hyperbolic discounting is that it creates temporary preferences for small rewards that occur sooner over larger, later ones. Individuals using hyperbolic discounting reveal a strong tendency to make choices that are inconsistent over time – they make choices today that their future self would prefer not to have made, despite knowing the same information. This dynamic inconsistency happens because hyperbolas distort the relative value of options with a fixed difference in delays in proportion to how far the choice-maker is from those options.[7]

Observations

The phenomenon of hyperbolic discounting is implicit in Richard Herrnstein's "matching law", which states that when dividing their time or effort between two non-exclusive, ongoing sources of reward, most subjects allocate in direct proportion to the rate and size of rewards from the two sources, and in inverse proportion to their delays.[8] That is, subjects' choices "match" these parameters.

After the report of this effect in the case of delay,[9] George Ainslie pointed out that in a single choice between a larger, later and a smaller, sooner reward, inverse proportionality to delay would be described by a plot of value by delay that had a hyperbolic shape, and that when the smaller, sooner reward is preferred, this preference can be reversed by increasing both rewards' delays by the same absolute amount. Ainslie's research showed that a substantial number of subjects reported that they would prefer $50 immediately rather than $100 in six months, but would NOT prefer $50 in 3 months rather than $100 in nine months, even though this was the same choice seen at 3 months’ greater distance. More significantly, those subjects who said they preferred $50 in 3 months to $100 in 9 months said they would NOT prefer $50 in 12 months to $100 in 18 months—again, the same pair of options at a different distance—showing that the preference-reversal effect did not depend on the excitement of getting an immediate reward.[10] Nor does it depend on human culture; the first preference reversal findings were in rats and pigeons.[11][12][13]

Many subsequent experiments have confirmed that spontaneous preferences by both human and nonhuman subjects follow a hyperbolic curve rather than the conventional, exponential curve that would produce consistent choice over time.[14][15] For instance, when offered the choice between $50 now and $100 a year from now, many people will choose the immediate $50. However, given the choice between $50 in five years or $100 in six years almost everyone will choose $100 in six years, even though that is the same choice seen at five years' greater distance.

Hyperbolic discounting has also been found to relate to real-world examples of self-control. Indeed, a variety of studies have used measures of hyperbolic discounting to find that drug-dependent individuals discount delayed consequences more than matched nondependent controls, suggesting that extreme delay discounting is a fundamental behavioral process in drug dependence.[16][17][18] Some evidence suggests pathological gamblers also discount delayed outcomes at higher rates than matched controls.[19] Whether high rates of hyperbolic discounting precede addictions or vice versa is currently unknown, although some studies have reported that high-rate discounters are more likely to consume alcohol[20] and cocaine[21] than lower-rate discounters. Likewise, some have suggested that high-rate hyperbolic discounting makes unpredictable (gambling) outcomes more satisfying.[22]

The degree of discounting is vitally important in describing hyperbolic discounting, especially in the discounting of specific rewards such as money. The discounting of monetary rewards varies across age groups due to the varying discount rate.[14] The rate depends on a variety of factors, including the species being observed, age, experience, and the amount of time needed to consume the reward.[23][24]

Mathematical model

Step-by-step explanation

Suppose that in a study, participants are offered the choice between taking x dollars immediately or taking y dollars n days later. Suppose further that one participant in that study employs exponential discounting and another employs hyperbolic discounting.

Each participant will realize that a) they should take x dollars immediately if they can invest the dollar in a different venture that will yield more than y dollars n days later and b) they will be indifferent between the choices (selecting one at random) if the best available alternative will likewise yield y dollars n days later. (Assume, for the sake of simplicity, that the values of all available investments are compounded daily.) Each participant correctly understands the fundamental question being asked: "For any given value of y dollars and n days, what is the minimum amount of money, i.e., the minimum value for x dollars, that I should be willing to accept? In other words, how many dollars would I need to invest today to get y dollars n days from now?" Each will take x dollars if x is greater than the answer that they calculate, and each will take y dollars n days from now if x is smaller than that answer. However, the methods that they use to calculate that amount and the answers that they get will be different, and only the exponential discounter will use the correct method and get a reliably correct result:

• The exponential discounter will think "The best alternative investment available (that is, the best investment available in the absence of this choice) gives me a return of r percent per day; in other words, once a day it adds to its value r percent of the value that it had the previous day. That is, every day it multiplies its value once by (100% + r%). So if I hold the investment for n days, its value will have multiplied itself by this amount n times, making that value (100% + r%)^n of what it was at the start – that is, (1 + r%)^n times what it was at the start. So to figure out how much I would need to start with today to get y dollars n days from now, I need to divide y dollars by ([1 + r%]^n). If my other choice of how much money to take is greater than this result, then I should take the other amount, invest it in the other venture that I have in mind, and get even more at the end. If this result is greater than my other choice, then I should take y dollars n days from now, because it turns out that by giving up the other choice I am essentially investing that smaller amount of money to get y dollars n days from now, meaning that I'm getting an even greater return by waiting n days for y dollars, making this my best available investment."
• The hyperbolic discounter, however, will think "If I want y dollars n days from now, then the amount that I need to invest today is y divided by n, because that amount times n equals y dollars. [There lies the hyperbolic discounter's error.] If my other choice is greater than this result, I should take it instead because x times n will be greater than y times n; if it is less than this result, then I should wait n days for y dollars."

Where the exponential discounter reasons correctly and the hyperbolic discounter goes wrong is that as n becomes very large, the value of (1 + r %)^n becomes much larger than the value of n, with the effect that the value of y / [(1 + r %)^n] becomes much smaller than the value of y /n. Therefore, the minimum value of x (the number of dollars in the immediate choice) that suffices to be greater than that amount will be much smaller than the hyperbolic discounter thinks, with the result that they will perceive x-values in the range from y / [(1 + r %)^n] to y/n (inclusive at the low end) as being too small and, as a result, irrationally turn those alternatives down when they are in fact the better investment.

Formal model

Hyperbolic discounting is mathematically described as

${\displaystyle g(D)={\frac {1}{1+kD}}\,}$

where g(D) is the discount factor that multiplies the value of the reward, D is the delay in the reward, and k is a parameter governing the degree of discounting. This is compared with the formula for exponential discounting:

${\displaystyle f(D)=e^{-kD}\,}$

Comparison

If ${\displaystyle f(D)=2^{-D}\,}$ is an exponential discounting function and ${\displaystyle g(D)={\frac {1}{1+D}}\,}$ a hyperbolic function (with D the number of weeks of delay), then the exponential discounting a week later from "now" (D=0) is ${\displaystyle {\frac {f(1)}{f(0)}}={\frac {1}{2}}\,}$, and the exponential discounting a week from week D is ${\displaystyle {\frac {f(D+1)}{f(D)}}={\frac {1}{2}}\,}$, which means they are the same. For g(D), ${\displaystyle {\frac {g(1)}{g(0)}}={\frac {1}{2}}\,}$, which is the same as for f, while ${\displaystyle {\frac {g(D+1)}{g(D)}}=1-{\frac {1}{D+2}}\,}$. From this one can see that the two types of discounting are the same "now", but when D is much greater than 1, for instance 52 (one year), ${\displaystyle {\frac {g(D+1)}{g(D)}}\,}$ will tend to go to 1, so that the hyperbolic discounting of a week in the far future is virtually zero, while the exponential discount factor is still 1/2, so there is still substantial discounting in the far future.

Quasi-hyperbolic approximation

The "quasi-hyperbolic" discount function, proposed by Laibson (1997),[7] approximates the hyperbolic discount function above in discrete time by

${\displaystyle f_{QH}(0)=1,\,}$

and

${\displaystyle f_{QH}(D)=\beta \times \delta ^{D},\,}$

where β and δ are constants between 0 and 1; and again D is the delay in the reward, and f_QH(D) is the discount factor. The condition f(0) = 1 is stating that rewards taken at the present time are not discounted.

Quasi-hyperbolic time preferences are also referred to as "beta-delta" preferences. They retain much of the analytical tractability of exponential discounting while capturing the key qualitative feature of discounting with true hyperbolas.

Explanations

Uncertain risks

Whether discounting future gains is rational or not—and at what rate such gains should be discounted—depends greatly on circumstances. Many examples exist in the financial world, for example, where it is reasonable to assume that there is an implicit risk that the reward will not be available at the future date, and furthermore that this risk increases with time. Consider paying $50 for dinner today or delaying payment for sixty years but paying $100,000. In this case, the restaurateur would be reasonable to discount the promised future value as there is significant risk that it might not be paid (e.g. due to the death of the restaurateur or the diner).

Uncertainty of this type can be quantified with Bayesian analysis.[25] For example, suppose that the probability for the reward to be available after time t is, for known hazard rate λ,

${\displaystyle P(R_{t}|\lambda )=\exp(-\lambda t),\,}$

but the rate is unknown to the decision maker. If the prior probability distribution of λ is

${\displaystyle p(\lambda )=\exp(-\lambda /k)/k,\,}$

then the decision maker will expect that the probability of the reward after time t is

${\displaystyle P(R_{t})=\int _{0}^{\infty }P(R_{t}|\lambda )p(\lambda )d\lambda ={\frac {1}{1+kt}},\,}$

which is exactly the hyperbolic discount rate. Similar conclusions can be obtained from other plausible distributions for λ.[25]

Applications

More recently these observations about discount functions have been used to study saving for retirement, borrowing on credit cards, and procrastination. It has frequently been used to explain addiction.[26][27] Hyperbolic discounting has also been offered as an explanation of the divergence between privacy attitudes and behaviour.[28]

Present values of annuities

Present value of a standard annuity

The present value of a series of equal annual cash flows in arrears discounted hyperbolically is

${\displaystyle V=P{\frac {\ln(1+kD)}{k}},\,}$

where V is the present value, P is the annual cash flow, D is the number of annual payments and k is the factor governing the discounting.

Criticism

Several alternative explanations of non-exponential discounting have been proposed. An article from 2003 noted that this pattern might be better explained by a similarity heuristic than by hyperbolic discounting.[29] Subjects have also reported changing relative preferences as they see more details of what they are choosing—a “temporal construal” effect.[30]

A study by Daniel Read introduces "subadditive discounting": the fact that discounting over a delay increases if the delay is divided into smaller intervals. This hypothesis may explain the main finding of many studies in support of hyperbolic discounting—the observation that impatience declines with time–while also accounting for observations not predicted by hyperbolic discounting.[31] However, although these observations depart from exponential discounting, they do not entail preference reversal as time from the choice to the earlier reward increases.

Arousal of appetite or emotion does sometimes lead to preference reversal, and this has been the most widely accepted alternative to a simply hyperbolic function: hyperboloid or quasi-hyperbolic discounting fuses exponential curves with an arousal bump as a visceral reward becomes imminent.[32] Such cases are obviously important, but still do not account for cases where either both or neither choice is made during arousal.

The most obvious objection to hyperbolic discounting is that many or most people learn to choose consistently over time in most situations. Similarly, a 2014 paper criticized the existing studies for mostly using data collected from university students and being too quick to conclude that the hyperbolic model of discounting is correct.[33] Human experiments have frequently reported wide between-subject variations.[6][10][34] If overcoming the tendency to temporary preference takes learning, the next obvious task for experimenters is to test theories of how and when this learning occurs (e.g. Ainslie, 2012).[35]

See also

• Akrasia
• Deferred gratification
• Intertemporal choice
• Temporal motivation theory
• Time preference
• Time value of money

References

1. Ainslie, G. (2015). "The Cardinal Anomalies that Led to Behavioral Economics: Cognitive or Motivational?". Managerial and Decision Economics. 37 (4–5): 261–273. doi:10.1002/mde.2715.
2. Grüne-Yanoff, Till (2015). "Models of Temporal Discounting 1937–2000: An Interdisciplinary Exchange between Economics and Psychology". Science in Context. 28 (4): 675–713. doi:10.1017/S0269889715000307.
3. Hampton WH, Venkatraman V, Olson IR (2017). "Dissociable frontostriatal white matter connectivity underlies reward and motor impulsivity". NeuroImage. 150 (4): 336–343. doi:10.1016/j.neuroimage.2017.02.021. PMC 5494201. PMID 28189592.
4. Frederick, Shane; Loewenstein, George; O'Donoghue, Ted (2002). "Time Discounting and Time Preference: A Critical Review". Journal of Economic Literature. 40 (2): 351–401. CiteSeerX 10.1.1.197.5565. doi:10.1257/002205102320161311.
5. Green, Leonard; Myerson, Joel (2004). "A discounting framework for choice with delayed and probabilistic rewards". Psychological Bulletin. 130 (5): 769–792. doi:10.1037/0033-2909.130.5.769. PMC 1382186. PMID 15367080.
6. Thaler, R. H. (1981). "Some Empirical Evidence on Dynamic Inconsistency". Economics Letters. 8 (3): 201–207. doi:10.1016/0165-1765(81)90067-7.
7. Laibson, David (1997). "Golden Eggs and Hyperbolic Discounting". Quarterly Journal of Economics. 112 (2): 443–477. CiteSeerX 10.1.1.337.3544. doi:10.1162/003355397555253.
8. DeVilliers, P.; Herrnstein, R.J. (1976). "Toward a law of response strength". Psychological Bulletin. 83 (6): 1131–1153. doi:10.1037/0033-2909.83.6.1131.
9. Chung, S. H.; Herrnstein, R. J. (1967). "Choice and delay of Reinforcement". Journal of the Experimental Analysis of Behavior. 10 (1): 67–74. doi:10.1901/jeab.1967.10-67. PMC 1338319. PMID 16811307.
10. Ainslie, George and Haendel, V. (1983) The motives of the will. in E. Gottheil, K. Druley, T. Skodola, H. Waxman (eds.),Etiology Aspects of Alcohol and Drug Abuse, Springfield, Ill.: Charles C. Thomas, pp. 119-140.
11. Ainslie, G. W. (1974). "Impulse control in pigeons". Journal of the Experimental Analysis of Behavior. 21 (3): 485–489. doi:10.1901/jeab.1974.21-485. PMC 1333221. PMID 16811760.
12. Ainslie, George; Herrnstein, R (1981). "Preference reversal and delayed reinforcement". Animal Learning and Behavior. 9 (4): 476–482. doi:10.3758/bf03209777.
13. Deluty, M.Z.; Whitehouse, W.G.; Millitz, M.; Hineline, P. (1983). "Self-control and commitment involving aversive events". Behavioral Analysis Letters. 3: 213–219.
14. Green, L.; Fry, A. F.; Myerson, J. (1994). "Discounting of delayed rewards: A life span comparison". Psychological Science. 5 (1): 33–36. doi:10.1111/j.1467-9280.1994.tb00610.x.
15. Kirby, K. N. (1997). "Bidding on the future: Evidence against normative discounting of delayed rewards". Journal of Experimental Psychology: General. 126 (1): 54–70. doi:10.1037/0096-3445.126.1.54.
16. Bickel, Warren K.; Johnson, Matthew W. (2003). "Delay Discounting: A Fundamental Behavioral Process of Drug Dependence". In Loewenstein, George; Read, Daniel; Baumeister, Roy F. (eds.). Time and Decision. New York: Russell Sage Foundation. pp. 419–40. ISBN 978-0-87154-549-7.
17. Madden, G. J.; Petry, N. M.; Bickel, W. K.; Badger, G. J. (1997). "Impulsive and self-control choices in opiate-dependent patients and non-drug-using control participants: Drug and monetary rewards". Experimental and Clinical Psychopharmacology. 5 (3): 256–262. doi:10.1037/1064-1297.5.3.256. PMID 9260073.
18. Vuchinich, R. E.; Simpson, C. A. (1998). "Hyperbolic temporal discounting in social drinkers and problem drinkers". Experimental and Clinical Psychopharmacology. 6 (3): 292–305. doi:10.1037/1064-1297.6.3.292. PMID 9725113.
19. Petry, N. M.; Casarella, T. (1999). "Excessive discounting of delayed rewards in substance abusers with gambling problems". Drug and Alcohol Dependence. 56 (1): 25–32. doi:10.1016/S0376-8716(99)00010-1. PMID 10462089.
20. Poulos, C. X.; Le, A. D.; Parker, J. L. (1995). "Impulsivity predicts individual susceptibility to high levels of alcohol self administration". Behavioural Pharmacology. 6 (8): 810–814. doi:10.1097/00008877-199512000-00006. PMID 11224384.
21. Perry, J. L.; Larson, E. B.; German, J. P.; Madden, G. J.; Carroll, M. E. (2005). "Impulsivity (delay discounting) as a predictor of acquisition of i.v. cocaine self-administration in female rats". Psychopharmacology. 178 (2–3): 193–201. doi:10.1007/s00213-004-1994-4. PMID 15338104.
22. Madden, G. J.; Ewan, E. E.; Lagorio, C. H. (2007). "Toward an animal model of gambling: Delay discounting and the allure of unpredictable outcomes". Journal of Gambling Studies. 23 (1): 63–83. doi:10.1007/s10899-006-9041-5. PMID 17171542.
23. Loewenstein, G.; Prelec, D. (1992). Choices Over Time. New York: Russell Sage Foundation. ISBN 978-0-87154-558-9.
24. Raineri, A.; Rachlin, H. (1993). "The effect of temporal constraints on the value of money and other commodities". Journal of Behavioral Decision Making. 6 (2): 77–94. doi:10.1002/bdm.3960060202.
25. Sozou, P. D. (1998). "On hyperbolic discounting and uncertain hazard rates". Proceedings of the Royal Society B: Biological Sciences. 265 (1409): 2015–2020. doi:10.1098/rspb.1998.0534. PMC 1689473.
26. O'Donoghue, T.; Rabin, M. (1999). "Doing it now or later". The American Economic Review. 89: 103–124. doi:10.1257/aer.89.1.103.
27. O'Donoghue, T.; Rabin, M. (2000). "The economics of immediate gratification". Journal of Behavioral Decision Making. 13 (2): 233–250. CiteSeerX 10.1.1.48.7971. doi:10.1002/(sici)1099-0771(200004/06)13:2<233::aid-bdm325>3.0.co;2-u.
28. Acquisti, Alessandro; Grossklags, Jens (2004). "Privacy Attitudes and Privacy Behavior". In Camp, L. Jean; Lewis, Stephen (eds.). The Economics of Information Security. Springer. pp. 165–78. doi:10.1007/1-4020-8090-5_13. ISBN 978-1-4020-8089-0.
29. Rubinstein, Ariel (2003). ""Economics and Psychology"? The Case of Hyperbolic Discounting". International Economic Review. 44 (4): 1207–1216. CiteSeerX 10.1.1.452.3042. doi:10.1111/1468-2354.t01-1-00106.
30. Trope, Yaacov; Liberman, Nira (2003). "Temporal construal". Psychological Review. 110 (3): 403–421. doi:10.1037/0033-295x.110.3.403. PMID 12885109.
31. Read, Daniel (2001). "Is time-discounting hyperbolic or subadditive?". Journal of Risk and Uncertainty. 23 (1): 5–32. doi:10.1023/A:1011198414683.
32. McClure, Samuel M.; Laibson, David I.; Loewenstein, George; Cohen, Jonathan D. (2004). "The grasshopper and the ant: Separate neural systems value immediate and delayed monetary rewards". Science. 306 (5695): 503–507. doi:10.1126/science.1100907. PMID 15486304.
33. Andersen, Steffen; Harrison, Glenn W.; Lau, Morten; Rutström, E. Elisabet (October 2014). "Discounting Behavior: A Reconsideration". European Economic Review. 71: 15–33. CiteSeerX 10.1.1.176.4381. doi:10.1016/j.euroecorev.2014.06.009.
34. Kable, Joseph W.; Glimcher, Paul W. (2007). "The neural correlates of subjective value during intertemporal choice". Nature Neuroscience. 10 (12): 1625–1633. doi:10.1038/nn2007. PMC 2845395. PMID 17982449.
35. Ainslie, George (2011). "Pure hyperbolic discount curves predict "eyes open" self-control". Theory and Decision. 73: 3–34. doi:10.1007/s11238-011-9272-5.

Further reading

• Ainslie, G. W. (1975). "Specious reward: A behavioral theory of impulsiveness and impulsive control". Psychological Bulletin. 82 (4): 463–496. doi:10.1037/h0076860. PMID 1099599.
• Ainslie, G. (1992). Picoeconomics: The Strategic Interaction of Successive Motivational States Within the Person. Cambridge: Cambridge University Press.
• Ainslie, G. (2001). Breakdown of Will. Cambridge: Cambridge University Press. ISBN 978-0-521-59694-7.
• Rachlin, H. (2000). The Science of Self-Control. Cambridge; London: Harvard University Press.