Wednesday, December 29, 2021

Standardization

 The attached study answers three questions: 

  1. Does it make a difference whether you standardize your variables before running your regression model or standardize the regression coefficients after you run your model? 
  2. Does the scale of the respective original non-standardized variables affect the resulting standardized coefficients? 
  3. Does using non-standardized variables vs. standardized variables have an impact when conducting regularization? 

The study uncovers the following answers to those three questions:

  1. It makes no difference whether you standardize your variables first or instead standardize your regression coefficients afterwards. 
  2. The scale of the original non-standardized variables does not make any difference.
  3. Using non-standardized variables when conducting regularization (Ridge Regression, LASSO) does not work at all.  In such a situation (regularization) you have to use standardized variables. 

To check out the complete study (very short just 7 slides) go to the following link.  

Standardization study at Slideshare.net

No comments:

Post a Comment

Compact Letter Display (CLD) to improve transparency of multiple hypothesis testing

Multiple hypothesis testing is most commonly undertaken using ANOVA.  But, ANOVA is an incomplete test because it only tells you ...