OLS as Orthogonal Projection
Published:
The note treats OLS as pure linear algebra — no randomness anywhere — deriving the closed form from the first-order condition, pinning existence and uniqueness on linear independence of the regressor columns, and then reading off three fitting properties that follow from residual orthogonality alone.