
13.5 Testing for Significance 573
Exercises
Methods
19. In exercise 1, the following estimated regression equation based on 10 observations was
presented.
Here
SST 6724.125, SSR 6216.375, .0813, and .0567.
a. Compute
MSR and MSE.
b. Compute F and perform the appropriate F test. Use α .05.
c. Perform a t test for the significance of β
1
. Use α .05.
d. Perform a t test for the significance of β
2
. Use α .05.
s
b
2
s
b
1
y
ˆ
29.1270 .5906x
1
.4980x
2
test
SELF
not related to miles traveled? Not necessarily. What it probably means is that with x
2
already
in the model, x
1
does not make a significant contribution to determining the value of y. This
interpretation makes sense in our example; if we know the amount of gasoline consumed,
we do not gain much additional information useful in predicting y by knowing the miles
traveled. Similarly, a t test might lead us to conclude β
2
0 on the grounds that, with x
1
in
the model, knowledge of the amount of gasoline consumed does not add much.
To summarize, in t tests for the significance of individual parameters, the difficulty
caused by multicollinearity is that it is possible to conclude that none of the individual pa-
rameters are significantly different from zero when an F test on the overall multiple re-
gression equation indicates a significant relationship. This problem is avoided when there
is little correlation among the independent variables.
Statisticians have developed several tests for determining whether multicollinearity is
high enough to cause problems. According to the rule of thumb test, multicollinearity is a
potential problem if the absolute value of the sample correlation coefficient exceeds .7 for
any two of the independent variables. The other types of tests are more advanced and be-
yond the scope of this text.
If possible, every attempt should be made to avoid including independent variables that
are highly correlated. In practice, however, strict adherence to this policy is rarely possible.
When decision makers have reason to believe substantial multicollinearity is present, they
must realize that separating the effects of the individual independent variables on the de-
pendent variable is difficult.
A sample correlation
coefficient greater than .7
or less than .7 for two
independent variables is a
rule of thumb warning of
potential problems with
multicollinearity.
When the independent
variables are highly
correlated, it is not possible
to determine the separate
effect of any particular
independent variable on the
dependent variable.
NOTES AND COMMENTS
Ordinarily, multicollinearity does not affect the
way in which we perform our regression analysis or
interpret the output from a study. However, when
multicollinearity is severe—that is, when two or
more of the independent variables are highly corre-
lated with one another—we can have difficulty in-
terpreting the results of t tests on the individual
parameters. In addition to the type of problem il-
lustrated in this section, severe cases of multi-
collinearity have been shown to result in least
squares estimates that have the wrong sign. That is,
in simulated studies where researchers created the
underlying regression model and then applied the
least squares technique to develop estimates of β
0
,
β
1
, β
2
, and so on, it has been shown that under con-
ditions of high multicollinearity the least squares
estimates can have a sign opposite that of the para-
meter being estimated. For example, 
2
might ac-
tually be 10 and b
1
, its estimate, might turn out to
be 2. Thus, little faith can be placed in the indi-
vidual coefficients if multicollinearity is present to
a high degree.
CH013.qxd 8/16/10 7:00 PM Page 573
Copyright 2010 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part. Due to electronic rights, some third party content may be suppressed from the eBook and/or eChapter(s).
Editorial review has deemed that any suppressed content does not materially affect the overall learning experience. Cengage Learning reserves the right to remove additional content at any time if subsequent rights restrictions require it.