A COMPANION TO Theoretical Econometrics

Collinearity in maximum likelihood estimation

Collinearity in the context of maximum likelihood estimation is similarly diag­nosed. Instead of minimizing the sum of squared errors we maximize the loglikelihood function. Standard gradient methods for numerical maximization use first and/or second derivatives. As in the Gauss-Newton algorithm for nonlinear least squares, these methods involve an inversion: the Hessian for the Newton-Raphson, the Information matrix for the method of scoring, and the cross-product matrix of first derivatives for the method of Berndt, Hall, Hall, and Hausman. In these algorithms if the matrix to be inverted becomes singular, or nearly so, estimation fails. In each case we can apply the BKW diagnostics to the matrix we are inverting at each step of the nonlinear optimization, and to the estimate of the asymptotic covariance matrix. The same difficulties arise in dia­gnosing collinearity here as in nonlinear least squares, only it is worse, because while the condition numbers provide a measure of how ill-conditioned the matrix is, the rows of Table 12.1 no longer provide any information about which variables are involved in collinear relations. Similar remarks hold for collinearity diagnosis in generalized least squares and simultaneous equations models.

Some common maximum likelihood estimators, among others, probit, logit, tobit, Poisson regression, and multiplicative heteroskedasticity, have information matrices of a common form,

t(p) = X'WX, (12.25)

where W is a T x T diagonal weight matrix that often is a function of the un­known parameters, p, and the independent variables.

The class of generalized linear models (McCullagh and Nelder, 1989) contains many of these estimators as special cases, and have information matrices in the form of equation (12.25), thus collinearity diagnostics for these models are rele­vant. Weissfeld and Sereika (1991) explore the detection of collinearity in the class of generalized linear models (GLM). Segerstedt and Nyquist (1992) observe that ill-conditioning in these models can be due to collinearity of the variables, X, the influence of the weights, W, or both. Weissfeld and Sereika suggest apply­ing the BKW diagnostics to the scaled information matrix. Lee and Weissfeld

(1996) do the same for the Cox regression model. Once again, while the variance decompositions can be computed in these instances, their interpretation is not straightforward, since collinearity can be due to the weights, W.

Lesaffre and Marx (1993) also investigate the problem of ill-conditioning in GLM and take a slightly different approach. Following Mackinnon and Puterman

(1989) , they suggest that only the columns of X be standardized to unit length, forming X1. Then, conditioning diagnostics are computed on X1MXV where M is the estimated weight matrix based on the rescaled data. The square root of the ratio of the largest to smallest eigenvalue describes the worst relative preci­sion with which linear combinations of the parameters can be estimated. Thus, this scaling gives a structural interpretation to the conditioning diagnostic. One problem with this scaling is that X1MX1 could be ill-conditioned because of the effects of M.

Добавить комментарий

A COMPANION TO Theoretical Econometrics

Normality tests

Let us now consider the fundamental problem of testing disturbance normality in the context of the linear regression model: Y = Xp + u, (23.12) where Y = (y1, ..., …

Univariate Forecasts

Univariate forecasts are made solely using past observations on the series being forecast. Even if economic theory suggests additional variables that should be useful in forecasting a particular variable, univariate …

Further Research on Cointegration

Although the discussion in the previous sections has been confined to the pos­sibility of cointegration arising from linear combinations of I(1) variables, the literature is currently proceeding in several interesting …

Как с нами связаться:

Украина:
г.Александрия
тел./факс +38 05235  77193 Бухгалтерия

+38 050 457 13 30 — Рашид - продажи новинок
e-mail: msd@msd.com.ua
Схема проезда к производственному офису:
Схема проезда к МСД

Партнеры МСД

Контакты для заказов оборудования:

Внимание! На этом сайте большинство материалов - техническая литература в помощь предпринимателю. Так же большинство производственного оборудования сегодня не актуально. Уточнить можно по почте: Эл. почта: msd@msd.com.ua

+38 050 512 1194 Александр
- телефон для консультаций и заказов спец.оборудования, дробилок, уловителей, дражираторов, гереторных насосов и инженерных решений.