Linear regression models the relationship between a dependent and independent variable (s). A linear regression essentially estimates a line of best fit among all variables in the model.

We introduce a fast stepwise regression method, called the orthogonal greedy algorithm (OGA), that selects input variables to enter a p-dimensional linear regression model (with p ≫ n, the sample size ...