NCPA Idea House


Policy Issues

NCPA Publications

Both Sides

Commentaries

Audio/Visual

NATIONAL CENTER FOR POLICY ANALYSIS
Global Warming: Experts’ Opinions versus Scientific Forecasts
Scientific Forecasting versus Opinion

Scientific forecasting methods should be used to project climate change.  The methodologies used should be those shown empirically to be relevant to the particular types of problems involved in climate forecasting.  However, the evidence shows that the IPCC forecasts are instead based on opinions.

Many public-policy decisions are based on unaided expert judgments.  The experts may have access to empirical studies and other information, but they often make predictions, or judgmental forecasts, without the aid of scientific forecasting principles.  Research on persuasion has shown that people have substantial faith in the value of such forecasts, and this faith increases when experts agree with one another.  However, the opinions of experts are an invalid basis for public policy.

“The opinions of experts are wrong as often as the opinions of nonexperts.”

Judgmental Forecasts.  Comparative empirical studies have routinely concluded that judgmental forecasting by experts is the least accurate of the methods available to make forecasts.5 For example, Professor Phil Tetlock, of the University of California at Berkeley, conducted a major study in which he recruited 284 participants whose professions included, “commenting or offering advice on political and economic trends.”6 He asked these experts to forecast the probability that various events would or would not occur, picking areas (geographic and substantive) within and outside their areas of expertise.  By 2003, he had accumulated over 82,000 forecasts.  The experts barely outperformed nonexperts and neither group did well against simple forecasting rules that extrapolate from the past to predict the future.7

Examples of expert climate forecasts that turned out to be completely wrong are also easy to find.  [See the sidebar on “Climate Forecasts Based on Expert Opinion.”]

Climate Forecasts Based on Expert Opinion

Contradictory contemporary climate forecasts by experts are easy to find. Some have proved to be wildly inaccurate. For example, in a speech on Earth Day, April 22, 1970, University of California at Davis ecologist Kenneth Watt predicted, “If present trends continue, the world will be about four degrees colder in 1990, but eleven degrees colder in the year 2000. This is about twice what it would take to put us into an ice age.”

A few years later, in the mid-1970s, political debate raged about whether the global climate was changing. The United States’ National Defense University (NDU) addressed this issue in a study that provided a chart that showed the mean annual temperature rising from 1870 to early 1940 then dropping sharply up to 1970.1 The study concluded that while a slight increase in temperature might occur, uncertainty was so high that it was most likely that the experience of “the next twenty years will be similar to that of the past,” and the effects of any change would be negligible. This conclusion was based primarily on a survey that asked experts their opinion regarding future temperature changes and weighted the 19 replies. Clearly, this was a judgmental forecast by scientists, based on their informed opinion, not a scientific forecast. It is generally agreed that temperatures have risen since 1970, rather than following the declining 1940 to 1970 trend. However, the NDU study was influential. It was discussed in The Global 2000 Report to the President (Carter) and at the World Climate Conference in Geneva in 1979.

Experts’ forecasts of climate changes have long been newsworthy and a cause of worry for people. For instance, a search of headlines in the New York Times found the following:2

Sept. 18, 1924 MacMillan Reports Signs of New Ice Age

March 27, 1933 America in Longest Warm Spell Since 1776

May 21, 1974 Scientists Ponder Why World’s Climate is Changing:
                       A Major Cooling Widely Considered to be Inevitable

The forecasts behind these headlines were made with a high degree of confidence.3

1 National Defense University, Climate Change to the Year 2000 (Washington, D.C.: National Defense University, 1978).

2 R.W. Anderson and D. Gainor, “Fire and Ice: Journalists have warned of climate change for 100 years, but can’t decide weather we face an ice age or warming,” Business and Media Institute, May 17, 2006. Available at http://www.businessandmedia.org/specialreports/2006/fireandice/FireandIce.pdf. Access verified December 10, 2007.

3 An earlier review of empirical research on this problem led to the “Seer-sucker theory,” which can be stated as “No matter how much evidence exists that seers do not exist, seers will find suckers.” J. Scott Armstrong, “The Seer-sucker theory: The value of experts in forecasting,” Technology Review, Vol. 83, June-July 1980, pages 16-24. Available at http://129.3.20.41/eps/get/papers/0412/0412009.pdf. Access verified December 10, 2007.

Computer Modeling versus Scientific Forecasting.  Over the past few decades, the methodology used in climate forecasting has shifted so that expert opinions are informed by computer models.  Advocates of complex climate models claim that they are based on well-established laws of physics.  But there is clearly much more to the models than physical laws, otherwise the models would all produce the same output, which they do not, and there would be no need for confidence estimates for model forecasts, which there certainly is.  Climate models are, in effect, mathematical ways for experts to express their opinions.8

There is no empirical evidence that presenting opinions in mathematical terms rather than in words improves the accuracy of forecasts.  In the 1800s, Thomas Malthus forecast mass starvation.  Expressing his opinions in a mathematical model, he predicted that the food supply would increase arithmetically while the human population would grow at a geometric rate and go hungry.  Mathematical models have not become much more accurate since.

“Computer modeling does not improve the accuracy of opinion.”

Two international surveys of climate scientists from 27 countries, in 1996 and 2003, show increasing skepticism over the accuracy of climate models.9 Of more than 1,060 respondents, only 35 percent agreed with the statement, “Climate models can accurately predict future climates,” whereas 47 percent disagreed.  [See Figure I.]10 Climate Models Can Accurately Predict Future Climates

Problems with Climate Models.  Researchers who have examined long-term climate forecasts have concluded they are based on nothing more than scientists’ opinions expressed in complex mathematical terms, without valid evidence to support the chosen approach.11

For example, when computer simulations project future global mean temperatures with twice the current level of atmospheric CO2, they assume that the temperature forecast is as accurate as a computer simulation of present temperatures with current levels of CO2.12 Yet it has never been demonstrated that temperature forecasts are as accurate as simulations of current conditions based on actual temperature data.  Indeed, there are even serious questions surrounding model simulations of current temperature with current CO2 levels.  According to the models, the earth should be warmer than actual measurements show it to be, which is why modelers adjust their findings to fit the data.

“Climate models based on historical data don’t accurately predict current temperatures.”

The models do not represent the real world sufficiently well to be relied upon for forecasting.13 As physicist Freeman Dyson concluded, climate models “do a very good job of describing the fluid motions of the atmosphere and the oceans,” but “they do a very poor job of describing the clouds, the dust, the chemistry and the biology of fields and farms and forests.”14

The climate models’ simulations do not correspond to past or present temperatures, rainfall patterns, tropical cyclones or plant responses.  Professor Bob Carter, of the Marine Geophysical Laboratory at James Cook University in Australia, examined evidence on the predictive ability of the general circulation models (GCMs) used by the IPCC scientists.  He found that while the models included some basic principles of physics, scientists had to make a number of “educated guesses” because knowledge about the physical processes of the earth’s climate is incomplete.15 Thus, in practice:

  • The GCMs failed to predict recent global average temperatures as accurately as fitting a simple curve to the historical data and extending it into the future.
  • The models forecast greater warming at higher altitudes in the tropics, when the greatest warming has occurred at lower altitudes and at the poles.
  • Furthermore, individual models have produced widely different forecasts from the same initial conditions, and minor changes in their assumptions can produce forecasts of global cooling.16

When models predict global cooling, the forecasts are rejected by modelers as “outliers” or “obviously wrong.”  This suggests that when the models are averaged together to create consensus estimates of temperature change, the results are biased due to the omission of models that show cooling.17

Researchers have found serious deficiencies in the GCMs on which the IPCC based its previous Third Assessment Report.  For example, David Bellamy and Jack Barrett found: 18

  1. The models produced very different cloud distributions and none came close to the actual distribution of clouds, which is important because the type and distribution of clouds can either enhance or reduce the Earth’s temperature.  Some clouds tend to trap more of the sun’s radiant heat, while others reflect the sun’s rays away from the Earth’s surface, mitigating the effect of increased greenhouse gases.
  2. Assumptions about the amount of radiation from the Sun absorbed by the atmosphere and the Earth’s surface varied considerably from model to model, yielding widely varying temperature forecasts.  This is important because absorption of heat energy from sunlight is the primary mechanism of global warming.
  3. The models did not accurately represent the known effects of CO2, much less the uncertain possible feedbacks that reduce or enhance those effects, and as a result their climate change forecasts cannot be relied upon.

The review by Bellamy and Barrett concluded: “The climate system is a highly complex system and, to date, no computer models are sufficiently accurate for their [IPCC] predictions of future climate to be relied upon.”19 And since climate model forecasts for periods of up to five years have proven to be inaccurate, the review concluded there is little basis upon which to make accurate projections for 50 to 100 years.20

Referring to the GCMs used for the IPPC forecasts, a lead author of Chapter 3 of the Fourth Assessment Report wrote that “… the science is not done because we do not have reliable or regional predictions of climate.”21

“Climate models based on recent data can’t accurately predict temperatures five years in the future.”

Other agencies’ attempts to forecast for shorter periods and smaller geographical areas have also been unsuccessful.  For instance, annual forecasts by New Zealand’s National Institute of Water and Atmospheric Research (NIWA) are no more accurate than chance.22 NIWA’s low success rate is comparable to other forecasting groups worldwide, according to New Zealand climatologist Jim Renwick, a member of the IPCC Working Group I and a coauthor of the Fourth Assessment Report.  (Renwick also serves on the World Meteorological Organization Commission for Climatology Expert Team on Seasonal Forecasting.)  He concludes that current GCMs are unable to predict future global climate any better than chance.23

« Previous | Study Home | Next »

12770 Coit Rd., Suite 800 - Dallas, TX 75243-1739 Phone 972/386-6272 - Fax 972/386-0924

601 Pennsylvania Ave. NW, Suite 900, South Building - Washington, DC 20004 Phone 202/220-3082 - Fax 202/220-3096

Copyright © 2004 National Center for Policy Analysis All rights reserved - Privacy Policy