Markov Chain Stationary Distribution : Data Science Concepts

แชร์
ฝัง
  • เผยแพร่เมื่อ 7 มิ.ย. 2024
  • What does it mean for a Markov Chain to have a steady state?
    Markov Chain Intro Video : • Markov Chains : Data S...

ความคิดเห็น • 90

  • @brycedavis5674
    @brycedavis5674 3 ปีที่แล้ว +100

    Your channel is criminally underviewed. You are a really talented lecturer. I took a whole bayesian stats course and you revealed things already I didnt learn in 5 months of time.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +16

      Wow thanks for the kind words!

    • @danielwiczew
      @danielwiczew 3 ปีที่แล้ว +5

      @@ritvikmath Hope you will boom at some point. Generally a canal's popularity curve is sigmoid and there's inflection point at some point.

    • @zhixiangwang7165
      @zhixiangwang7165 2 ปีที่แล้ว +1

      @@ritvikmath really great lecture!! better than all the courses I have learned

  • @luisfernando262
    @luisfernando262 2 ปีที่แล้ว +17

    This is how teaching should be done. It was incredibly effortless to understand when you switch between intuition and rigor. Thank you so much

  • @AA-tm3ew
    @AA-tm3ew 2 ปีที่แล้ว +14

    bro, you are the absolute best in explaining complicated concepts in such an intuitive manner. You should seriously consider becoming a teacher since you are so talented in explaining

  • @yuhangqian642
    @yuhangqian642 2 ปีที่แล้ว +1

    I really enjoy that you explain these concepts so simply! Thanks!

  • @pedromanuelmartinmesa6098
    @pedromanuelmartinmesa6098 3 ปีที่แล้ว +1

    I have never seen any explanation about markov chain so clear!

  • @lakshityagi684
    @lakshityagi684 2 ปีที่แล้ว

    Your videos are quite good at explaining machine learning concepts with all the maths in the background. Thanks a lot!

  • @andreveiga1
    @andreveiga1 2 ปีที่แล้ว

    Really appreciate how you keep bringing it back to intuition but also do the math. well done dude!

  • @gravataprata1718
    @gravataprata1718 2 ปีที่แล้ว

    It finally clicked! I was very confused about multiplying a distribution by the transition matrix exactly as you were. But not anymore thanks to you. So, a HUGE thx!!

  • @user-or7ji5hv8y
    @user-or7ji5hv8y 3 ปีที่แล้ว

    That subtle point is something that I had the misconception of before. Thanks for pointing it out and clarifying.

  • @cosmicflow42
    @cosmicflow42 3 ปีที่แล้ว +3

    Thanks a lot. Very intuitive! Taking the time to clarify steps you initially had trouble on makes it much easier for me to understand the thought process behind the concept.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Glad it was helpful!

  • @pedramtavadze5467
    @pedramtavadze5467 3 ปีที่แล้ว +1

    Love your videos, thanks for making them. I just wonder who gave a dislike to this amazing video.

  • @cynthpielin7334
    @cynthpielin7334 3 ปีที่แล้ว +1

    I'm an undergrad doing stats and learning Markov chain right now. I really like the intuitive explanation of the stationary distribution can be a probability distribution, rather than a fixed state at the beginning of the video. That idea has confused me for 3 months! Really appreciate your video :D

  • @shivamchoudhary1681
    @shivamchoudhary1681 10 หลายเดือนก่อน

    One of the best lectures on Markov chains

  • @adamtheanalyst
    @adamtheanalyst 2 ปีที่แล้ว +1

    A very underrated video.
    I loved the explanation of what 🥧*A=🥧 truly means. This was the first video I've seen it explained.
    A lot of other videos show the computation (which is trivial) and avoid the meaning behind it.

  • @ChocolateMilkCultLeader
    @ChocolateMilkCultLeader 2 ปีที่แล้ว

    your way of explaining things is amazing. I've actually been studying some of the way you struture your explanations to improve my videos

  • @Eli-rg1vd
    @Eli-rg1vd ปีที่แล้ว

    This is such an awesome channel!

  • @cocod7756
    @cocod7756 3 ปีที่แล้ว +1

    The best video so far I’ve watched regarding the topic! Thank you! And keep updating more content pls

  • @elegentt2900
    @elegentt2900 2 ปีที่แล้ว

    Awesome explanation! Thanks for all the posts ritvik😊

  • @daisylin4746
    @daisylin4746 3 ปีที่แล้ว +2

    love your explanations! really cleared up some of my confusions. please make more videos like this!

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Thank you! Will do!

  • @treelight1707
    @treelight1707 3 ปีที่แล้ว +4

    Great Explanation. Looking forward for the coding. And the rest of the playlist. And as always, thanks.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Awesome, thank you!

  • @sofieooms8990
    @sofieooms8990 2 ปีที่แล้ว

    This is explained amazingly, thank you!

  • @tson6552
    @tson6552 2 ปีที่แล้ว

    This is so so well explained omg

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w 2 ปีที่แล้ว

    Glad you clarified that point. I definitely had the wrong notion that stationarity meant eventually getting there.

  • @komuna5984
    @komuna5984 2 ปีที่แล้ว

    Thanks a lot for your awesome explanation! ❤

  • @luedman13579
    @luedman13579 2 ปีที่แล้ว

    great video! good mix between intuition and math

  • @softerseltzer
    @softerseltzer 3 ปีที่แล้ว +1

    Very clear and intuitive, I definitely learned something.

  • @nuti09to
    @nuti09to 2 ปีที่แล้ว

    Great explanation indeed! Thanks bro.

  • @Alexander-pk1tu
    @Alexander-pk1tu 2 ปีที่แล้ว

    Very good job man. Thank you a lot!!

  • @sigmundurhelgason3230
    @sigmundurhelgason3230 3 ปีที่แล้ว

    This is amazing content. Keep it going!

  • @MrNitKap
    @MrNitKap 3 ปีที่แล้ว

    Good job 👍... learnt some vital concepts

  • @pietromontresori4700
    @pietromontresori4700 8 หลายเดือนก่อน

    ritvik you are one of the wonders of the world

  • @AshutoshRaj
    @AshutoshRaj 2 ปีที่แล้ว

    Bhai, you are just awesome!

  • @danghuusontung
    @danghuusontung 2 ปีที่แล้ว

    masterpiece! you made me feel that education is kind of art! :D

  • @sethharrrison
    @sethharrrison ปีที่แล้ว

    This is excellent, thank you very much!

  • @erikkarlsson6839
    @erikkarlsson6839 3 ปีที่แล้ว +1

    You are such an awesome teacher. Thanks for this video =)

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Glad it was helpful!

  • @interfaze9930
    @interfaze9930 2 ปีที่แล้ว

    Amazing video! Especially the part about how to get the steady state by using the Eigenvector equation was eye opening for me.
    One question: I am starting out on markov-chains and I would like to know how I can generate the trasition matrix in the first place. Let's say I have a dataset with some timeseries. How do I start clustering the states? Do you have a video on that?

  • @joelrubinson9973
    @joelrubinson9973 2 ปีที่แล้ว +1

    I use the eigenvector trick to find stationary distributions regularly for marketing applications, such as finding the steady state distribution of market shares

    • @ritvikmath
      @ritvikmath  2 ปีที่แล้ว

      Super cool application!

    • @joelrubinson9973
      @joelrubinson9973 2 ปีที่แล้ว

      @@ritvikmath I also use it for digital journey analysis to project add to cart events as a state with other states such as branded search, generic search, competitive brand search, viewing product pages inside of amazon for your brand, competitors, etc. I use add to cart ad the conversion metric because purchase would be an absorbing state. works great!

  • @lashlarue7924
    @lashlarue7924 ปีที่แล้ว

    You and Josh Starmer really should get together and do some content together! I have learned more from the two of you than I learned in college!

  • @bhaveshsingh0124
    @bhaveshsingh0124 2 ปีที่แล้ว +1

    Loved it!

  • @hpp496videos
    @hpp496videos 3 ปีที่แล้ว +1

    I was kinda hoping for you to explain what would hypothetically happen in your magically corrected scenario, although I believe it would not be possible. Great work and great material!

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Indeed, before the fix we had a defective Markov Chain, good eye!

  • @janaelmourad9681
    @janaelmourad9681 2 ปีที่แล้ว

    saved my day ! thank u

  • @arvindputhucode1108
    @arvindputhucode1108 3 ปีที่แล้ว

    amazing so clear

  • @Jameshazfisher
    @Jameshazfisher ปีที่แล้ว

    My visualization of the chain being "at a distribution" is to imagine, say, 1000 particles in the system. Each one moves around according to the transition probabilities. A "steady state" is where the particles leaving a node are exactly replaced by new particles entering the node.

  • @milhousewong3423
    @milhousewong3423 3 ปีที่แล้ว

    That‘s amazing!!! Thanks!

  • @abdulelahaljeffery6234
    @abdulelahaljeffery6234 2 ปีที่แล้ว

    definitely downloading this one ..
    Nope, I don't trust youtube to keep this gem alive for too long.

  • @Pruthvikajaykumar
    @Pruthvikajaykumar 2 ปีที่แล้ว

    MAN THANK YOU SO MUCH!. This will save my ass

  • @kristianwichmann9996
    @kristianwichmann9996 3 ปีที่แล้ว +1

    Very clear explanation

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว

      Glad you think so!

  • @tannys
    @tannys 3 ปีที่แล้ว +1

    super video. request you to add more on other properties (reducibility, reversibility, time homogeniety, periodicity, ergodicity , mixing times & why these are necessary)

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +1

      Great suggestion!

  • @polybius3378
    @polybius3378 ปีที่แล้ว

    Great video.

    • @ritvikmath
      @ritvikmath  ปีที่แล้ว

      Glad you enjoyed it

  • @wenfanghu3724
    @wenfanghu3724 ปีที่แล้ว

    Great explanation as always! One question I have is, since this is a stationary state, shouldn't we consider both the channels going out and the channels coming in? Such as for B, shouldn't we write an equation like: pi_C * 0.5 + pi_E * 0.1 - pi_B * 1 = pi_B ? Why didn't we count the channels going out?

  • @jollyrogererVF84
    @jollyrogererVF84 9 หลายเดือนก่อน

    Another great video 👍
    You have a good teaching style, clearly born from others poor styles you have experienced 😂

  • @rbpict5282
    @rbpict5282 3 ปีที่แล้ว +4

    It took me 9 videos to learn that you have an intro pen flip

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +1

      Haha, no shame. It is quite subtle.

    • @gigz54
      @gigz54 3 ปีที่แล้ว +1

      There is also a *snap* *point* "see ya next time" sign off

  • @user-ld6jv5yn8v
    @user-ld6jv5yn8v 5 หลายเดือนก่อน

    THANK YOU

  • @youssefjaber9886
    @youssefjaber9886 3 ปีที่แล้ว +1

    Hello man, thank u so much for this helpful videos. Im a huge fan of you and I want to askin u about a problematiq that i think of it, is about using neural network on forecasting time series and how about the resulats ? Is it better than the ARIMA models ??

  • @honeyBadger582
    @honeyBadger582 3 ปีที่แล้ว +2

    Sick shirt!

  • @mohamedr3w
    @mohamedr3w ปีที่แล้ว

    thanks!

  • @buarikazeem4156
    @buarikazeem4156 2 ปีที่แล้ว

    Nice video, i have two questions
    1. How did we come about 1/5, 2/5 and 2/5, i know of the first and last zero.
    2. In a case where we are told to calculate the probability of ending in the third state after 4steps, if we start from state 1..how do i do this?

  • @jaredbutler1478
    @jaredbutler1478 2 ปีที่แล้ว

    So the steady state is like the probability of being at a certain node as time t goes to infinity? Like a limit??

  • @jasonsmith8548
    @jasonsmith8548 3 ปีที่แล้ว +5

    Hey, would you consider this topic advanced and if yes, what textbook would you recommend for learning advanced topics?

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +1

      I wouldn't consider this an "advanced" topic in the context of Markov Chains. Anytime you talk about Markov Chains, the question of steady state is a natural one.

  • @COCACOLASJCN
    @COCACOLASJCN 2 ปีที่แล้ว

    Nice video. Here it seems that the example in the video does not meet the Detailed balance equation (e.g., P(B)*T(C|B) != P(C)*T(B|C)). Is it safe to say that Detailed balance is sufficient but unnecessary for Stationary Distribution?

  • @adamtheanalyst
    @adamtheanalyst 2 ปีที่แล้ว

    Question: suppose we wanted to calculate P(A) for some reason.
    It's certainly not the case that P(A)=0, since we of course could start at state A. So how would we go about calculating this?
    I know that normally we compute stationary values, but in this case it would be 0.
    Looking forward to hearing responses.

    • @adamtheanalyst
      @adamtheanalyst 2 ปีที่แล้ว

      Or is it not possible to calculate P(A) unless the Markov Chain is an irreducible recurrent chain?

  • @user-or7ji5hv8y
    @user-or7ji5hv8y 3 ปีที่แล้ว

    Like two conditional steady states with the last example.

  • @cleansquirrel2084
    @cleansquirrel2084 3 ปีที่แล้ว +1

    Nice. But I still like it when you explain with a real world example.

    • @ritvikmath
      @ritvikmath  3 ปีที่แล้ว +2

      Thanks! And noted :)

  • @user-or7ji5hv8y
    @user-or7ji5hv8y 3 ปีที่แล้ว

    Can you provide a real world example where we have finite discrete number of states such that this would be useful?

    • @pedromanuelmartinmesa6098
      @pedromanuelmartinmesa6098 3 ปีที่แล้ว

      in the first video about markov he has one of weather (sunny vs cloudy). Simpler but 'similar to real world case' th-cam.com/video/prZMpThbU3E/w-d-xo.html

  • @sadashivmathad6901
    @sadashivmathad6901 5 หลายเดือนก่อน

    Ritvikmath : Lingayat Jangam?

  • @lalitsinghpoo
    @lalitsinghpoo ปีที่แล้ว

    It is understood that the probability of being in state A is zero in the next time step but how come intuitively the probability of being in state E can be zero? After all the probability of self-transition is 0.9!

  • @96cabero
    @96cabero 3 ปีที่แล้ว +1

    I'll be damned if this isn't a good explanation