26 March 2007
Eric Rasmusen
Erasmuse@indiana.edu
A Thinking Test
This test illustrates some common flaws in the way people think. Most
of the questions are adapted from notes of Professor Michael Metzger,
of Indiana University's Dept. of Business Law. I have modified them
quite a bit.
Half the class gets AA and half gets BB, and we compare the answers.
Some questions are in common.
This is the master copy, with all the questions. I have put in the percentages
and MEDIANs from Fall 1998, G100. Ask
the class why it is better to use Medians than Averages here.
AA 1. Here are some reasons why a car might not start in the morning.
For each of
them, assign percentage probabilities to the best of your knowledge:
(a) Insufficient battery charge: ( 60 % )
(b) Defective fuel system:( 10 % )
(c) Engine problems: ( 15 % )
(d) All other problems: ( 10 % )
BB 1. Here are some reasons why a car might not start in the
morning. For each
of them, assign percentage probabilities to the best of your
knowledge:
(a) Insufficient battery charge: ( 20 % )
(b) Defective fuel system:( 12 % )
(c) Engine problems: ( 15 % )
(d) Defective starter: ( % ) 55 percent for the next four.
(e) Vandalism:( % )
(f) Electrical problems: ( % )
(g) All other problems: ( % )
(Question 1 illustrates "Agenda Control". AA(d) and BB(d-g) should
add up to the same percentage. When we add more possibilities to the
list, that affects the probabilities of
earlier possibilities, even though it shouldn't, logically. Note that the
answers are medians, so they don't add up exactly to 100%.)
AA 2. A newly hired engineer for a computer firm in the Osaka area
has four
years of experience and good all-round qualifications. When asked to
estimate
the starting salary for this person, a freshman in high school said
(admitting that he knew nothing about the industry) $23,000,
translating yen
into dollars. What is your guess?
($ 33 )
BB 2. A newly hired engineer for a computer firm in the Osaka area
has four
years of experience and good all-round qualifications. When asked to
estimate
the starting salary for this person, a freshman in high school said
(admitting that he knew nothing about the industry) $82,000,
translating yen
into dollars. What is your guess?
($ 53 )
(Question 2 illustrates "Anchoring" by irrelevant information. The
freshman's information is known to be useless, yet we use it.)
AA 3. Imagine that the U.S. is preparing for the outbreak of an
unusual Asian disease, which is expected to kill 600 people. Two
alternative programs to combat the disease have been proposed. Assume
that the exact scientific estimates of the consequences of the
programs are as follows: If program V is adopted, 200 people will be
saved. If program W is adopted, there is a one-third probability that
600 people will be saved and a two-thirds probability that no people
will be saved.
Which of the two programs would you favor?
Program V
Program W
72%
28% (sample of doctors, not my students)
If Program D is adopted, there is a one-third probability
that nobody will die and a two-thirds probability that 600
people will die. (78%)
BB 3. Imagine that the U.S. is preparing for the outbreak of an
unusual Asian disease, which is expected to kill 600 people. Two
alternative programs to combat the disease have been proposed. Assume
that the exact scientific estimates of the consequences of the
programs are as follows: If program X is adopted, 400 people will die.
If program Y is adopted, there is a one-third probability
that nobody will die and a two-thirds probability that 600
people will die.
Which of the two programs would you favor?
Program X
Program Y
22%
78% (sample of doctors, not my students)
(Notice that the sure programs, X and V, lead to exactly the same
number of survivors. The risky programs, Y and W, are also the same as
each other. Kahneman & Tversky (1984) found that in the positively
framed version AA/VW, 72% of doctors chose program V, the safe-
and-sure program to save 200 people, and 28% chose program W, the
risky program. A different sample of doctors was given the negatively
framed version BB/XY. When framed negatively, 22% of the physicians
voted for the safe-and-sure program X and 72% of them opted for the
risky program Y. Different framing made the risky program more
attractive.
Why did framing matter so much? Because of a second phenomenon: "Loss
Aversion". People are willing to take a risk to avoid loss completely,
even if they are generally risk averse. Conventional risk aversion
cannot explain what is happening here, which is that people are
willing to take on the possibility of a big loss in order to avoid
the possibility of a small loss. It is as if there is a fixed utility
cost to losing anything.
I took the numbers from "Classic Decision Puzzlers,"
http://www.rci.rutgers.edu/~gbc/puzz.txt, which has more questions
like the ones in this test.)
AABB 4. Your company has factories in Altoona and Beloit. Your
capital budget
this year allows you to invest in a filtration system in just one
of these
two cities. You would like to reduce cancer incidence among your
workers, not
because you fear legal liability (it is too hard to prove) but because
you care
about your workers (and you want to reduce health insurance costs).
Circle
your choice.
Altoona. There's a 20 percent chance that the chemicals in this
plant might
be causing 10 cancer cases per year among your workers. The filtration
system
would reduce this to a 5 percent chance.
Beloit. There's a 10 percent chance that the chemicals in this
plant might be
causing 10 cancer cases per year among your workers. The filtration
system would
entirely eliminate this risk.
28 percent chose Altoona.
72 percent chose Beloit.
(Question 4 is not exactly about a fallacy, but a peculiarity. A
reduction of 10% in Beloit is preferred to 15% in Altoona. That may
be rational, if some fixed cost can thus be avoided. In class, change
the 20 percent to 50 percent and see if students then agree
that Altoona should get the filtration system.)
AA 5. As a hurricane approaches Florida, there is a shortage of
gasoline-
powered electrical generators. Smith's Hardware had been selling
them at list
price before, but now Smith sells them at $200 above list price. Is
this
ethical?
YES
NO
BB 5. As a hurricane approaches Florida, there is a shortage of
gasoline-
powered electrical generators. Smith's Hardware had been selling
them at
$200 below list price before, but now Smith sells them at list
price. Is
this ethical?
YES
NO
(Question 5 illustrates the importance of "Framing"--- the way in
which a question is put. In 1998, this question didn't work well, so I
modified it to its present form.
Both have a $200 price increase; the difference is in whether the
price goes
above list or not. )
AA 6. A public opinion poll asks you the question, "Are you happy
paying an
extra $50 per year in higher prices to subsidize the dairy industry?"
YES
NO
BB 6. A public opinion poll asks you the question, "Do you agree
that dairy
farmers deserve at least the level of protection against unfair
competition
that they have been getting for the past thirty years?"
YES
NO
(Question 6 illustrates both "Framing"--- the way in which a
question is put-- and how once established, policies start to seem
like property rights. )
AABB 7. How would you evaluate your safety and skill as a driver?
BOTTOM QUARTER OF THE POPULATION
25th-50th PERCENTILE OF THE POPULATION
50-75th PERCENTILE OF THE POPULATION
75th-100 PERCENTILE OF THE POPULATION
0, 16, 56, 28.
(A standard finding. "Preston and Harris [1965] compared 50 drivers
whose driving involved them in crashes serious enough to require
hospitalization with 50 crash-free drivers matched in relevant
variables. When asked about how skillful they were, the two groups
gave similar results..."http:
//www.scienceservingsociety.com/tsd/CH12.htm. Note that it is true
that over 50% of drivers are better than *average*, if not better than
*median*.)
AA 8. Your company had to decide whether to market one of two new
potential
products. The available marketing research data, which was generated
at a
university and is freely available to the public, indicated that
Product A had
a 50 percent chance of succeeding, while Product B had a 60 percent
chance. In
both cases, if the product had succeeded, the company would earn $7
million
in profits, but if it failed, the company would merely break even.
Your company's CEO chose to market Product B, and it fails. Your
main
competitor chose A, and it succeeded. On a scale from 1 (fire him)
to 7 (give
him a bonus), what should the Board of Directors do about the CEO?
1 2 3 4 5 6 7
Median: 4.
BB 8. Joe had to decide whether to flip one of two coins, each of
which would
yield him $7 million if it comes up Heads, and $0 if it comes up
Tails. Coin A
has a 50 percent chance of Heads, while Coin B has a 60 percent
chance. Joe
chose B, but it came up Tails. Someone else tossed A, and it came up
Heads. On a
scale from 1 (What an idiot!) to 7 (clearly did the right thing),
what do you
think of Joe?
1 2 3 4 5 6 7
Median: 6.5.
(Question 8 is about how we are critical of a bad decision even if we
would call it a good decision based on the evidence available when it
was made: "Hindsight Bias".)
AABB 9. A fair coin will be flipped four times. You can take one (and
only one) of
the following three bets on the sequence of heads and tails, putting
up 1 dollar
of your money and winning the amount indicated if your sequence turns
up when the coin is actually tossed.
(a) 1. Heads. 2. Heads. 3. Heads. 4. Heads. You get $.49 if you win.
(b) 1. Heads. 2. Heads. 3. Heads. 4. Tails. You get $.48 if you win.
(c) 1. Heads. 2. Tails. 3. Heads. 4. Tails. You get $.47 if you win.
(d) You may refuse all three bets and keep your dollar.
(All 3 sequences have equal probability, but we think of some
sequences are looking more random than others. It is a human instinct
to look for patterns and try to assign causes. I did not use this back
in 1998.)
NOTE USED IN 2006 :
AABB 10. For each of the following questions, provide low and
high
estimates such that you are 80 percent certain that the correct answer
falls
between the limits. You should aim to have 8 hits and 2 misses.
Getting the
brackets right is what matters, not getting the right answers.
Note that you
should try to get an 80 percent bracket for each question, not for all
10
together (in which case you could use [1, 10 trillion] for the first
8, and
[1,2] for the last two to get 8 out of 10).
A. How many patents did the U.S. Patent Office issue in 1990?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 96,
727
B. How many of Fortune's 1990 Global 500, the world's biggest
industrial
corporations, were Japanese?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 111
C. In 1989, how many passenger arrivals and departures were there in
Chicago's
O'Hare Airport?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 59,
130,007
D. What was the total audited circulation of the Wall Street Journal,
worldwide,
during the first half of 1990?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 2,
076,713
E. In 1987, how many master's degrees in management or business were
awarded
in the United States?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 67,
496
F. What was the population of the United States in 1992?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 255
million
G. In 1992, how many immigrants were legally admitted into the United
States?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 974,
000.
H.In 1993, what was the median price of a new one-family house in the
U.S.?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 126,
000.
I. What percentage of GDP were exports in 1994?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 12
percent
J. How many abortions were performed in 1992?
LOW ESTIMATE: HIGH ESTIMATE: BEST GUESS: 1.6
million
My source for items F through J is the Statistical Abstract of the
United
States, 1994, 114th edition, U.S. Dept. of Commerce, pp. 15
(population), 12
(immigration), 732 (houses), 446 (exports), and 85 (abortion).
Median: 2.
Overconfidence, vanity, reluctance to show uncertainty.
For ease of gradingg, alternate answers in the millions with
percentages, etc.