Multicollinearity (in Regression Analysis)

แชร์
ฝัง
  • เผยแพร่เมื่อ 15 ก.ย. 2024
  • In a regression analysis, multicollinearity occurs when two or more predictor variables (independent variables) show a high correlation. This leads to the fact that the regression coefficients are unstable and can no longer be interpreted.
    To avoid multicollinearity, there must be no linear dependence between the predictors; this is the case, for example, when one variable is the multiple of another variable. In this case, since the variables are perfectly correlated, one variable explains 100% of the other variable and there is no added value in taking both variables in a regression model. If there is no correlation between the independent variables, then there is no multicollinearity.
    In reality, a perfect linear correlation hardly ever occurs, which is why we speak of multicollinearity when individual variables are highly correlated with each other, in which case the effect of individual variables cannot be clearly separated from each other.
    It should be noted that the regression coefficients can no longer be interpreted in a meaningful way, but the prediction with the regression model is possible.
    Multicollinearity test
    To find out whether multicollinearity is present, the tolerance of the individual predictors is considered. Another measure of multicollinearity is the VIF (Variance Inflation Factor).
    datatab.net/tu...
    Online Statistics Calculator:
    datatab.net/st...
    Regression Analysis: An introduction to Linear and Logistic Regression
    • Regression Analysis: A...
    Simple and Multiple Linear Regression
    • Simple and Multiple Li...
    Assumptions of Linear Regression
    • Assumptions of Linear ...
    Logistic Regression: An Introduction
    • Logistic Regression: A...
    Dummy Variables in Multiple Regression
    • Dummy Variables in Mul...
    Regression with categorical independent variables
    • Regression with catego...
    Multicollinearity
    • Multicollinearity (in ...
    Causality, Correlation and Regression
    • Causality, Correlation...

ความคิดเห็น • 32

  • @jackg8217
    @jackg8217 14 วันที่ผ่านมา

    Thank you for taking the time to do these videos, they have been a huge help with my studies

  • @globalmotivation777
    @globalmotivation777 2 ปีที่แล้ว +5

    Thank you for this wonderful lecture 👍🤝

    • @datatab
      @datatab  2 ปีที่แล้ว

      Thanks for your nice Feedback!

  • @perfectmoments3876
    @perfectmoments3876 ปีที่แล้ว +3

    Hi, how do you come up with the critical value of 0.1 respectively 10? Is there a source for that?

  • @RichardGoza
    @RichardGoza 9 หลายเดือนก่อน

    I am under the Linear regression tab and i do not see the subtab check condition. All i see under Linear Regression is Test assumptions, Effect size and Summary in words. Please help!!! I have a subscription on your website.

  • @paparokauli
    @paparokauli 11 หลายเดือนก่อน +2

    God bless you woman!

  • @MonsieurSchue
    @MonsieurSchue ปีที่แล้ว +2

    So apparently the service is no longer free.:(

  • @juanwang3705
    @juanwang3705 2 ปีที่แล้ว +2

    hi, this video is really helpful. You mentioned in the next video, you will tell how to test the multicollinearity of dummy variables. but I can't find that video. could you send me a link?

    • @datatab
      @datatab  2 ปีที่แล้ว +1

      Oh sorry, we have just a video on dummy variables! But for dummy variables it is the same, so you test it in the same way. th-cam.com/video/bnjPzHQ04Ac/w-d-xo.html

    • @juanwang3705
      @juanwang3705 2 ปีที่แล้ว

      @@datatab ok! Thanks.

  • @jasbirmanhas3355
    @jasbirmanhas3355 3 ปีที่แล้ว +2

    Can you make video on coefficient of determination

    • @datatab
      @datatab  3 ปีที่แล้ว

      Thanks for your message! Yes sure! I can try!

  • @hasanatayoub6512
    @hasanatayoub6512 ปีที่แล้ว +1

    Can you teach multicolineality by using this series😢
    .what is nature of mulicoliniality
    .is multicoliniality really problem?
    .what are its practical consequence?
    .how do one detectit?
    .what remedial measure?

    • @mikefieselman
      @mikefieselman ปีที่แล้ว

      The nature of multcolinarity is the similarity on impact one independant variable has with another independant variable.
      it is really a problem because we're looking for a model that best fits, and why have a model that shows 4 independant variables's influence on a dependant variable, when 3 gives same result. Ask yourself is 3 better than 4? yes it is
      Practical consequence is that you are not recieving the best model to explain the impact on variables to the independant variable.
      you detect it with VIF formula which is (1-(1-R^2) where r^2 is correlation squared or you can get R^2 through running a regression analysis on excel
      remedial measure... you remove one of the dependant variables that shows multicollinarity either from a correlation matrix chart or VIF diagnosis, or looking at the P-value regardless of multicollinarity.
      You're welcome :)

    • @mikefieselman
      @mikefieselman ปีที่แล้ว

      You can also detect multicollinarit by performing regression model with only the dependant variables, where you have 1 of the dependant variables as y and the rest as x.

    • @mikefieselman
      @mikefieselman ปีที่แล้ว

      this is called auxillary regression

  • @kennyjohndelacruz3435
    @kennyjohndelacruz3435 3 ปีที่แล้ว +2

    Can you make a video about two tailed test for next pls.

    • @datatab
      @datatab  3 ปีที่แล้ว

      two tailed t-Test? or in general two tailed?

  • @alialshebami8408
    @alialshebami8408 2 ปีที่แล้ว

    please provide us a separate video that differentiates between the influence and the prediction? How can I know whether my research is a prediction or influence base? It is confusing.

    • @leykimayri
      @leykimayri ปีที่แล้ว

      From your research question? Do you want to predict a variable using one(s) other(s) or do you want to see how much influence one(s) variable(s) has/have on another?

    • @alialshebami8408
      @alialshebami8408 ปีที่แล้ว

      @@leykimayri Hi, thanks for your reply; it is still not clear how to differentiate between them in research? how do I know my research is prediction or influence?

    • @leykimayri
      @leykimayri ปีที่แล้ว

      @@alialshebami8408 What do you mean how do you know if your research is prediction or influence? YOU define what research you want to do. You pose your research questions IN ADVANCE and based on those you then design your research (meaning the questions you will ask, who you will ask, for how long your research will be, what kind of questions they will be, how many people, etc etc). Then you analyse your results and based on that analysis you interpret the results and come to conclusions.

  • @scottmacnevin3555
    @scottmacnevin3555 2 ปีที่แล้ว +1

    Superb, thank you

    • @datatab
      @datatab  2 ปีที่แล้ว

      Many thanks for your Feedback! Regards Hannah

  • @mahammadodj
    @mahammadodj ปีที่แล้ว +1

    Thank you so much!

    • @datatab
      @datatab  ปีที่แล้ว

      Glad it helped!

  • @wanjadouglas3058
    @wanjadouglas3058 2 ปีที่แล้ว +1

    Good job

    • @datatab
      @datatab  2 ปีที่แล้ว

      Thanks : )

  • @jasbirmanhas3355
    @jasbirmanhas3355 3 ปีที่แล้ว +1

    Kindly send video on correlation

    • @datatab
      @datatab  3 ปีที่แล้ว

      Hello Jasbir, just search at youtube "correlation DATAtab" we have greate Videos about correlation!

  • @Romeo-sf7tw
    @Romeo-sf7tw 2 ปีที่แล้ว +2

    Genius!

    • @datatab
      @datatab  2 ปีที่แล้ว

      Many thanks! Regards Hannah