Is the difference between an OLS regression and a GLS regression qualitative or quantitative?

1 Answer
Feb 14, 2016

It is quantitative

Explanation:

Ordinary least squares is a technique for estimating unknown parameters in a linear regression model. OLS yield the maximum likelihood in a vector #β#, assuming the parameters have equal variance and are uncorrelated, in a noise ε - homoscedastic.

#vec(y)=Xvec(β)+vec(ε)#

Generalized least squares allows this approach to be generalized to give the maximum likelihood estimate #β# when the noise is of unequal variance (heteroscedasticity). Typically this leads to mathematical treatment that presents the two as follows:
OLS: #vecY=Xbeta+ε " where " ε~N(0,σ²I)#
GLS: #vecY=Xbeta+η " where " η~N(0,σ²Cov)#
Note the formulation for the two approaches results in real structural and quantitative difference. Notice the two are governed by two different Gauss distribution the
#N(0, sigma^2M); M = I " or " M=Cov# part
Where: #I = # "Identity Matrix and " #Cov =# "Covariance Matrix

Cheers!