Tuesday, April 22, 2014

On economic "consensus" and the benefits of climate change

Note: Slight edits to graphs and text to make things clearer and more comparable.

Richard Tol is a man who likes to court controversy. I won't deem to analyse his motivations here -- suffice it to say that I respect his professional research at the same time as I find his social media interactions maddeningly obscurechurlish and inconsistent. However, I'm pretty sure that he relishes the the role of provocateur in the climate change debate and will admit no shame in that.

Little wonder then, that his work acts as grist to the mill for sceptical op-eds of a more -- shall we say --considered persuasion. That is, opinion pieces that at least try to marshal some credible scientific evidence against decisive climate change action, rather than just mouthing off some inane contrarian talking points (it's a giant communist conspiracy, etc). Bjørn Lomborg and Matt Ridley are two writers that have cited Richard's research in arguing forcibly against the tide of mainstream climate opinion. I want to focus on the latter's efforts today, since it ties in rather nicely with an older post of mine: "Nope, Nordhaus is still (mostly) right."

I won't regurgitate the whole post, but rather single out one aspect: The net benefits that climate change may or may not bring at moderate temperature increases. The idea is encapsulated in the following figure of Tol (2009), which shows estimates of economic damages due to temperature increases relative to the present day.

Fig. 1
Note: Dots represent individual studies. The thick centre line is the best fit stemming from an OLS regression: D = 2.46T - 1.11T^2, with an R-squared value of 0.51. The outer lines are 95% confidence intervals derived according to different methods. Source: Tol (2009)

Now, there are various points to made about the implications of Fig. 1. People like Matt Ridley are wont to point out that it demonstrates how climate change will bring benefits to us long before it imposes any costs. Ergo, we should do little or nothing about reducing our emissions today. Of course, there are multiple responses to this position and I tried to lay out various reasons in my previous post as to why this is a very misleading take (sunk benefits and inertia in the climate system, uncertainty and risk aversion, unequal distribution of benefits and costs, tipping points, etc).

However, I have two broader points to make here, for which Ridley will prove a useful foil. For example, here he is in The Spectator last year, arguing "Why Climate Change Is Good For The World":
To be precise, Prof Tol calculated that climate change would be beneficial up to 2.2˚C of warming from 2009[... W]hat you cannot do is deny that this is the current consensus. If you wish to accept the consensus on temperature models, then you should accept the consensus on economic benefit.
Bold in my emphasis. Now it should be pointed out that Ridley's articled elicited various responses, including one by Bob Ward that uncovers some puzzling typos in Richard's paper. Ward goes on to show that in fact only two out of the 14 studies considered in Tol (2009) reveal net positive benefits accruing due to climate change, and one of these was borderline at best. Specifically, Mendelsohn et al. (2000) suggest that 2.5˚C of warming will yield a tiny net global benefit equivalent to 0.1% of GDP. (It is should also be noted that they do not account for non-market impacts -- typically things like ecosystems, biodiversity, etc -- which would almost certainly pull their estimate into negative territory.) That leaves one of Richard's own papers, Tol (2002), which suggests that 1˚C of warming will yield a 2.3% gain in GDP, as the sole study showing any kind of benefits due to climate change.

This is all very well-trodden ground by now, but it underscores just how tenuous -- to put it mildly -- Matt Ridely's appeal to economic consensus is. However, we are still left with a curve that purports to show positive benefits from climate change up until around 2˚C of warming, before turning negative. So here are my two comments:

Comment #1: Outlier and functional form

Given that only one study  (i.e. Tol, 2002) among the 14 surveyed in Tol (2009) shows large-ish benefits from climate change, you may be inclined to think that the initial benefits suggested by Fig. 1 are hinged on this "outlier"... And you would not be wrong: individual observations will always stand to impact the overall outcome in small samples. However, I would also claim that such a result is partially an artefact of functional form. What do I mean by this? I mean that predicting positive benefits at "moderate" levels of warming is in some sense inevitable if we are trying to fit a quadratic function[*] to the limited data available in Tol (2009). This is perhaps best illustrated by re-estimating the above figure, but (i) correcting for the typos discovered by Bob Ward and (ii) excluding the outlier in question.

Fig. 2
Based on Figure 1 in Tol (2009), but corrected for typos and including an additional best-fit line that excludes the most optimistic estimate of benefits due to moderate climate change (i.e. Tol, 2002).

Remember that our modified sample includes only negative -- or neutral at best -- effects on welfare due to climate change. And yet, the new best-fit line (dark grey) suggests that we will still experience net benefits for a further 1.75˚C of warming! Thus we see how the choice of a quadratic function to fit our data virtually guarantees the appearance of initial benefits, even when the data themselves effectively exclude such an outcome.[**] You'll note that I am following Ridley's lead here in ignoring the confidence intervals. This is not a particularly sound strategy from a statistical perspective, but let's keep things simple for the sake of comparison.


Comment #2: New data points

As it happens, several several new estimates of the economic effects of climate change have been made available since Tol (2009) was published. Richard has updated his Fig. 1 accordingly and included it in the latest IPCC WG2 report. You can find it on pg. 84 here. (Although -- surprise! -- even this is not without controversy.) However, this updated version does not include a best-fit line. That is perhaps a wise choice given the issues discussed above. Nevertheless, like me, you may still be curious to see what it looks like now that we have a few additional data points. Here I have re-plotted the data, alongside a best-fit line and 95% confidence interval.

Fig. 3
Based on Figure 10 in IPCC WG2 (2014). As before, the best-fit line is computed according a quadratic function using OLS. This yields D = 0.01T - 0.27T^2, with an R-squared value of 0.49.

Whoops. Looks like those initial benefits have pretty much vanished!

So... What odds on Matt Ridley reporting the updated economic "consensus"?

UPDATE: Richard points me towards a recent working paper of his that uses non-parametric methods to fit a curve to the data. This is all well and good, and I commend his efforts in trying to overcome some of the issues discussed above... Except for one overwhelming problem: Non-parametric methods -- by their very nature -- are singularly ill-suited to small samples! Even Wikipedia manages to throw up a red flag in its opening paragraph on the topic: "Nonparametric regression requires larger sample sizes than regression based on parametric models because the data must supply the model structure as well as the model estimates." Arguably even more problematic is the fact that non-parametric estimations are particularly misleading in the tails. I simply don't see how a non-parametric approach can be expected to produce meaningful results, given that we are dealing with a rather pitiful 20-odd observations. Ultimately, it is not so much a question of parametric versus non-parametric. The real problem is a paucity of data.

UPDATE 2: An errata to Tol (2009) has finally been published. The updated figure is, of course,  the same as much the same as I have drawn above. [Having looked a bit closer, I see the errata includes an additional data point that isn't in the IPCC report (Nordhaus, 2013). In addition, the damage figure given for another study (Roson and van der Mensbrugghe, 2012) has changed slightly. Yay for typos!]

UPDATE 3: Ouch... and double ouch. Statistician Andrew Gelman takes Richard out to the woodshed (making many of the same points that I have here). The result isn't pretty. Make sure to read the comments thread too.


___
[*] Tol (2009) uses a simple regression equation of D = b1*T - b2*T^2 to fit the data. He finds b1 = 2.46 and b1 = 1.11, which is where the thick, central grey line in Fig. 1 comes from.
[**] For the record, I don't wish to come across as overly pedantic or critical of the choice of a quadratic damage function. Indeed, it is hard to think of another simple function that would better lend itself to describing the effect of moderate temperature increases. (Albeit not for higher levels of warming.) I am merely trying to expand on the way in which the interplay of limited data and choice of functional form can combine to give a misleading impression of the risks associated with climate change.

10 comments:

  1. Perhaps one should add that much confusion about that graph could be avoided by simply reading the paper. Anyone having had at least SOME idea about economics knows the difference between total and marginal costs, or what a sunk cost is. Tol says explicitly that much of that warming is already built in and thusly corresponds to a sunk cost/benefit (hence, not policy relevant when it comes to internalizing costs). Also there is actually a whole section about marginal damage costs of emissions, which IS the policy relevant quantity - and they are clearly a cost, and not a benefit - which gets ignored by people actually talking about policy (or why there shoud not be any). Why the obsession with Figure 1?

    Where does the confusion of all those Ridleys come from? I had somewhat of a revelation reading through this (+comment section) by David Friedman:

    http://daviddfriedman.blogspot.fr/2014/03/dealing-with-climate-change-prevention.html

    I did not think about the possibility, but apparently there are trained economists out there who a) get confused between the marginal cost of emission and the marginal cost of warming (as if we had direct control over the latter), b) believe that SCC are somehow the marginal cost of warming and therefore a benefit, and c) think that SCC are somehow estimated by looking at the curvature of fits like in Figure 1.

    ReplyDelete
    Replies
    1. Your last paragraph points to some disturbing considerations, but I have a hard time arguing against it!

      Thanks for an astute comment.

      Delete
    2. Do I simply too much to summarise that that according to economists you should consider damages for the next 30 to 40 years as sunk costs and ignore them. And you should use a discount rate for long term damages and thus largely ignore damages after 40 years. There are days I am glad I am not an economist.

      Delete
    3. Well, I don't think that there's anything wrong with this approach in principle. We can't do anything about sunk costs/benefits and discounting is pretty much the only sensible way to weigh costs over time. That said:
      1) Losses over the next 40 years will definitely be incorporated into the welfare calculation even if they aren't, strictly speaking, policy relevant.
      2) It's not like welfare impacts simply disappear in the face of a (sensible) discount rate. They are diminished, not discarded.
      3) The effects of discounting are counterbalanced by the fact that future damages are so long lasting. i.e. Climate change is expected to lower the long-run growth rate more or less permanently.

      Delete
  2. It is worth remembering the following from Tol 2008, about "Missing effects":

    "These relatively small unknowns, and doubtless others not identified here,
    are worth some additional research, but they pale in comparison to the big
    unknowns: extreme climate scenarios, the very long-term, biodiversity loss, the
    possible effects of climate change on economic development, and even political
    violence"

    ReplyDelete
  3. Would it be an idea to show the importance of the assumption of a quadratic fit by also showing a linear fit?

    ReplyDelete
    Replies
    1. You could, but a quadratic curve makes sense insofar as we expect the rate of damages to be increasing in T. In contrast, a linear fit would imply that damages at high levels of warming aren't particularly bad.

      Delete
    2. Of course, you could fit a semi-parametric linear model that uses splines... For example, a discontinuity at 2.5 °C. However, the the point I was making in the first update of my post would have some bearing here as well; we are still hamstrung by a lack of data no matter what we do really.

      Delete