 Springer Texts in Business and Economics

# Residual Analysis

A plot of the residuals of the regression is very important. The residuals are consistent estimates of the true disturbances. But unlike the ui’s, these ei’s are not independent. In fact, the OLS normal equations (3.2)and (3.3) give us two relationships between these residuals. Therefore, knowing (n — 2) of these residuals the remaining two residuals can be deduced. If we had the true ui’s, and we plotted them, they should look like a random scatter around the horizontal axis with no specific pattern to them. A plot of the ei s that shows a certain pattern like a set of positive residuals followed by a set of negative residuals as shown in Figure 3.6(a) may be indicative of a violation of one of the 5 assumptions imposed on the model, or simply indicating a wrong functional form. For example, if assumption 3 is violated, so that the щ’s are say positively correlated, then it is likely to have a positive residual followed by a positive one, and a negative residual followed by a negative one, as observed in Figure 3.6(b). Alternatively, if we fit a linear regression line to a true quadratic relation between Y and X, then a scatter of residuals like that in Figure 3.6(c) will be generated. We will study how to deal with this violation and how to test for it in Chapter 5.    Large residuals are indicative of bad predictions in the sample. A large residual could be a typo, where the researcher entered this observation wrongly. Alternatively, it could be an influential observation, or an outlier which behaves differently from the other data points in the sample and therefore, is further away from the estimated regression line than the other data points. The fact that OLS minimizes the sum of squares of these residuals means that a large weight is put on this observation and hence it is influential. In other words, removing this observation from the sample may change the estimates and the regression line significantly. For more on the study of influential observations, see Belsely, Kuh and Welsch (1980). We will focus on this issue in Chapter 8 of this book.

Figure 3.6 Positively Correlated Residuals     -

Figure 3.7 Residual Variation Growing with X

One can also plot the residuals versus the X^s. If a pattern like Figure 3.7 emerges, this could be indicative of a violation of assumption 2 because the variation of the residuals is growing with Xi when it should be constant for all observations. Alternatively, it could imply a relationship between the Xi’s and the true disturbances which is a violation of assumption 4.

In summary, one should always plot the residuals to check the data, identify influential obser­vations, and check violations of the 5 assumptions underlying the regression model. In the next few chapters, we will study various tests of the violation of the classical assumptions. Most of these tests are based on the residuals of the model. These tests along with residual plots should help the researcher gauge the adequacy of his or her model.

Table 3.1 Simple Regression Computations

 OBS Consumption Vi Income Xi Vi=Yi-Y xi Xi X xiyi 2 xl Y ei 1 4.6 5 -1.9 -2.5 4.75 6.25 4.476190 0.123810 2 3.6 4 -2.9 -3.5 10.15 12.25 3.666667 -0.066667 3 4.6 6 -1.9 -1.5 2.85 2.25 5.285714 -0.685714 4 6.6 8 0.1 0.5 0.05 0.25 6.904762 -0.304762 5 7.6 8 1.1 0.5 0.55 0.25 6.904762 0.695238 6 5.6 7 -0.9 -0.5 0.45 0.25 6.095238 -0.495238 7 5.6 6 -0.9 -1.5 1.35 2.25 5.285714 0.314286 8 8.6 9 2.1 1.5 3.15 2.25 7.714286 0.885714 9 8.6 10 2.1 2.5 5.25 6.25 8.523810 0.076190 10 9.6 12 3.1 4.5 13.95 20.25 10.142857 -0.542857 SUM 6.5 75 0 0 42.5 52.5 65 0 MEAN 6.5 7.5 6.5

Добавить комментарий

## Springer Texts in Business and Economics

### The General Linear Model: The Basics

7.1 Invariance of the fitted values and residuals to non-singular transformations of the independent variables. The regression model in (7.1) can be written as y = XCC-1" + u where …

### Regression Diagnostics and Specification Tests

8.1 Since H = PX is idempotent, it is positive semi-definite with b0H b > 0 for any arbitrary vector b. Specifically, for b0 = (1,0,.., 0/ we get hn …

### Generalized Least Squares

9.1 GLS Is More Efficient than OLS. a. Equation (7.5) of Chap. 7 gives "ois = " + (X'X)-1X'u so that E("ois) = " as long as X and u …

## Как с нами связаться:

Украина:
г.Александрия
тел./факс +38 05235  77193 Бухгалтерия
+38 050 512 11 94 — гл. инженер-менеджер (продажи всего оборудования)

+38 050 457 13 30 — Рашид - продажи новинок
e-mail: msd@msd.com.ua
Схема проезда к производственному офису:
Схема проезда к МСД

Партнеры МСД

## Контакты для заказов шлакоблочного оборудования:

+38 096 992 9559 Инна (вайбер, вацап, телеграм)
Эл. почта: inna@msd.com.ua