26 March 2007
Eric Rasmusen
Erasmuse@indiana.edu

A Thinking Test

This test illustrates some common flaws in the way people think. Most of the questions are adapted from notes of Professor Michael Metzger, of Indiana University's Dept. of Business Law. I have modified them quite a bit. Half the class gets AA and half gets BB, and we compare the answers. Some questions are in common. This is the master copy, with all the questions. I have put in the percentages and MEDIANs from Fall 1998, G100. Ask the class why it is better to use Medians than Averages here.

AA 1. Here are some reasons why a car might not start in the morning. For each of them, assign percentage probabilities to the best of your knowledge:

(a) Insufficient battery charge: ( 60 % )
(b) Defective fuel system:( 10 % )
(c) Engine problems: ( 15 % )
(d) All other problems: ( 10 % )

BB 1. Here are some reasons why a car might not start in the morning. For each of them, assign percentage probabilities to the best of your knowledge:

(a) Insufficient battery charge: ( 20 % )
(b) Defective fuel system:( 12 % )
(c) Engine problems: ( 15 % )
(d) Defective starter: ( % ) 55 percent for the next four.
(e) Vandalism:( % )
(f) Electrical problems: ( % )
(g) All other problems: ( % )

(Question 1 illustrates "Agenda Control". AA(d) and BB(d-g) should add up to the same percentage. When we add more possibilities to the list, that affects the probabilities of earlier possibilities, even though it shouldn't, logically. Note that the answers are medians, so they don't add up exactly to 100%.)

AA 2. A newly hired engineer for a computer firm in the Osaka area has four years of experience and good all-round qualifications. When asked to estimate the starting salary for this person, a freshman in high school said (admitting that he knew nothing about the industry) $23,000, translating yen into dollars. What is your guess?

($ 33 )

BB 2. A newly hired engineer for a computer firm in the Osaka area has four years of experience and good all-round qualifications. When asked to estimate the starting salary for this person, a freshman in high school said (admitting that he knew nothing about the industry) $82,000, translating yen into dollars. What is your guess?

($ 53 )

(Question 2 illustrates "Anchoring" by irrelevant information. The freshman's information is known to be useless, yet we use it.)

AA 3. Imagine that the U.S. is preparing for the outbreak of an unusual Asian disease, which is expected to kill 600 people. Two alternative programs to combat the disease have been proposed. Assume that the exact scientific estimates of the consequences of the programs are as follows: If program V is adopted, 200 people will be saved. If program W is adopted, there is a one-third probability that 600 people will be saved and a two-thirds probability that no people will be saved.

Which of the two programs would you favor?

Program V
Program W

72%
28% (sample of doctors, not my students)

If Program D is adopted, there is a one-third probability that nobody will die and a two-thirds probability that 600 people will die. (78%) BB 3. Imagine that the U.S. is preparing for the outbreak of an unusual Asian disease, which is expected to kill 600 people. Two alternative programs to combat the disease have been proposed. Assume that the exact scientific estimates of the consequences of the programs are as follows: If program X is adopted, 400 people will die. If program Y is adopted, there is a one-third probability that nobody will die and a two-thirds probability that 600 people will die.

Which of the two programs would you favor?

Program X
Program Y

22%
78% (sample of doctors, not my students)

(Notice that the sure programs, X and V, lead to exactly the same number of survivors. The risky programs, Y and W, are also the same as each other. Kahneman & Tversky (1984) found that in the positively framed version AA/VW, 72% of doctors chose program V, the safe- and-sure program to save 200 people, and 28% chose program W, the risky program. A different sample of doctors was given the negatively framed version BB/XY. When framed negatively, 22% of the physicians voted for the safe-and-sure program X and 72% of them opted for the risky program Y. Different framing made the risky program more attractive.

Why did framing matter so much? Because of a second phenomenon: "Loss Aversion". People are willing to take a risk to avoid loss completely, even if they are generally risk averse. Conventional risk aversion cannot explain what is happening here, which is that people are willing to take on the possibility of a big loss in order to avoid the possibility of a small loss. It is as if there is a fixed utility cost to losing anything.

I took the numbers from "Classic Decision Puzzlers," http://www.rci.rutgers.edu/~gbc/puzz.txt, which has more questions like the ones in this test.)

AABB 4. Your company has factories in Altoona and Beloit. Your capital budget this year allows you to invest in a filtration system in just one of these two cities. You would like to reduce cancer incidence among your workers, not because you fear legal liability (it is too hard to prove) but because you care about your workers (and you want to reduce health insurance costs). Circle your choice.

Altoona. There's a 20 percent chance that the chemicals in this plant might be causing 10 cancer cases per year among your workers. The filtration system would reduce this to a 5 percent chance.

Beloit. There's a 10 percent chance that the chemicals in this plant might be causing 10 cancer cases per year among your workers. The filtration system would entirely eliminate this risk.

28 percent chose Altoona.
72 percent chose Beloit.

(Question 4 is not exactly about a fallacy, but a peculiarity. A reduction of 10% in Beloit is preferred to 15% in Altoona. That may be rational, if some fixed cost can thus be avoided. In class, change the 20 percent to 50 percent and see if students then agree that Altoona should get the filtration system.)

AA 5. As a hurricane approaches Florida, there is a shortage of gasoline- powered electrical generators. Smith's Hardware had been selling them at list price before, but now Smith sells them at $200 above list price. Is this ethical?

YES
NO

BB 5. As a hurricane approaches Florida, there is a shortage of gasoline- powered electrical generators. Smith's Hardware had been selling them at $200 below list price before, but now Smith sells them at list price. Is this ethical?

YES
NO

(Question 5 illustrates the importance of "Framing"--- the way in which a question is put. In 1998, this question didn't work well, so I modified it to its present form. Both have a $200 price increase; the difference is in whether the price goes above list or not. )

AA 6. A public opinion poll asks you the question, "Are you happy paying an extra $50 per year in higher prices to subsidize the dairy industry?"

YES
NO

BB 6. A public opinion poll asks you the question, "Do you agree that dairy farmers deserve at least the level of protection against unfair competition that they have been getting for the past thirty years?"

YES
NO

(Question 6 illustrates both "Framing"--- the way in which a question is put-- and how once established, policies start to seem like property rights. )

AABB 7. How would you evaluate your safety and skill as a driver?

BOTTOM QUARTER OF THE POPULATION
25th-50th PERCENTILE OF THE POPULATION
50-75th PERCENTILE OF THE POPULATION
75th-100 PERCENTILE OF THE POPULATION

0, 16, 56, 28.

(A standard finding. "Preston and Harris [1965] compared 50 drivers whose driving involved them in crashes serious enough to require hospitalization with 50 crash-free drivers matched in relevant variables. When asked about how skillful they were, the two groups gave similar results..."http: //www.scienceservingsociety.com/tsd/CH12.htm. Note that it is true that over 50% of drivers are better than *average*, if not better than *median*.)

AA 8. Your company had to decide whether to market one of two new potential products. The available marketing research data, which was generated at a university and is freely available to the public, indicated that Product A had a 50 percent chance of succeeding, while Product B had a 60 percent chance. In both cases, if the product had succeeded, the company would earn $7 million in profits, but if it failed, the company would merely break even.

Your company's CEO chose to market Product B, and it fails. Your main competitor chose A, and it succeeded. On a scale from 1 (fire him) to 7 (give him a bonus), what should the Board of Directors do about the CEO?

  1   2   3   4   5   6  7
Median: 4.

BB 8. Joe had to decide whether to flip one of two coins, each of which would yield him $7 million if it comes up Heads, and $0 if it comes up Tails. Coin A has a 50 percent chance of Heads, while Coin B has a 60 percent chance. Joe chose B, but it came up Tails. Someone else tossed A, and it came up Heads. On a scale from 1 (What an idiot!) to 7 (clearly did the right thing), what do you think of Joe?

  1   2   3   4   5   6  7
Median: 6.5.

(Question 8 is about how we are critical of a bad decision even if we would call it a good decision based on the evidence available when it was made: "Hindsight Bias".)

AABB 9. A fair coin will be flipped four times. You can take one (and only one) of the following three bets on the sequence of heads and tails, putting up 1 dollar of your money and winning the amount indicated if your sequence turns up when the coin is actually tossed.

(a) 1. Heads. 2. Heads. 3. Heads. 4. Heads. You get $.49 if you win.
(b) 1. Heads. 2. Heads. 3. Heads. 4. Tails. You get $.48 if you win.
(c) 1. Heads. 2. Tails. 3. Heads. 4. Tails. You get $.47 if you win.
(d) You may refuse all three bets and keep your dollar.

(All 3 sequences have equal probability, but we think of some sequences are looking more random than others. It is a human instinct to look for patterns and try to assign causes. I did not use this back in 1998.)

NOTE USED IN 2006 : AABB 10. For each of the following questions, provide low and high estimates such that you are 80 percent certain that the correct answer falls between the limits. You should aim to have 8 hits and 2 misses. Getting the brackets right is what matters, not getting the right answers. Note that you should try to get an 80 percent bracket for each question, not for all 10 together (in which case you could use [1, 10 trillion] for the first 8, and [1,2] for the last two to get 8 out of 10). A. How many patents did the U.S. Patent Office issue in 1990? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 96, 727 B. How many of Fortune's 1990 Global 500, the world's biggest industrial corporations, were Japanese? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 111 C. In 1989, how many passenger arrivals and departures were there in Chicago's O'Hare Airport? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 59, 130,007 D. What was the total audited circulation of the Wall Street Journal, worldwide, during the first half of 1990? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 2, 076,713 E. In 1987, how many master's degrees in management or business were awarded in the United States? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 67, 496 F. What was the population of the United States in 1992? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 255 million G. In 1992, how many immigrants were legally admitted into the United States? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 974, 000. H.In 1993, what was the median price of a new one-family house in the U.S.? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 126, 000. I. What percentage of GDP were exports in 1994? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 12 percent J. How many abortions were performed in 1992? LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 1.6 million My source for items F through J is the Statistical Abstract of the United States, 1994, 114th edition, U.S. Dept. of Commerce, pp. 15 (population), 12 (immigration), 732 (houses), 446 (exports), and 85 (abortion). Median: 2. Overconfidence, vanity, reluctance to show uncertainty. For ease of gradingg, alternate answers in the millions with percentages, etc.