I think eq. on 3:06 is wrong. seems that u assume state S, when taking action a, has a probability to go to different other states S'. However, it is the action a that is stochastic, but not the transition from S to S' when taking action a.
Hey Colin, regarding P(s,a,s'), does the name of the problem change when we know these probabilities ( as in the video) vs. the case in which we have no idea about the transition probabilities?
I am trying to understand this stuff nowadays, this video is super helpfull, however i need some clarification on this one en.wikipedia.org/wiki/List_of_mathematical_symbols says that ∑ is sum, not sigma. the symbol for sigma is σ here. Is there a mistake made or is the wiki incomplete?
∑ is upper case sigma, σ is lower case sigma. Upper case sigma ∑ is used in mathematics as symbol for sum over some set or range of values. Wiki just doesn't mention that the sum symbol is called sigma.
I got quickly hooked by the first video on bellman equation as it was simple, intelligent and lucid and immediately watched this one. Alas, quickly lost interest on this one as it starts with some lame gimmicks and I am no longer sure what to expect. You could have followed the simple style of the first one and got another million views..Will look for other material. Thanks
One of the most underated video on MDP I have seen
Best intro ever for an ML video!
The most vivid explanation of Bellman equation I have watched!
fantastic
had fun and laughed while learning
My Prof explained that to us but guess why I'm here today? :) Thank you. Now I got it!
You are a Deep learning reinforcement Wizard! Thank you for the dope videos!
You really should go for teaching career. I didn't understood bellman equation from a paid course and you made very simple to me
"The past doesn't matter baby!"
100/100 the way you explaining , thank you sir.
Dude you are very good at explaining. 👍
dude thank you your videos are awesome
No BS explanation, good work
Make more man! :D this is great
you're a crack, i love it! cool video!!!
super informative and hilarious!
The past doesn’t matter baby!!!!!
The most cinematic ML video I have ever seen!! 😂
I think eq. on 3:06 is wrong. seems that u assume state S, when taking action a, has a probability to go to different other states S'. However, it is the action a that is stochastic, but not the transition from S to S' when taking action a.
great help man!
this is so funny!! i loved it
Loved that intro lol
subscribed :)
Thank you sir
Hey Colin, regarding P(s,a,s'), does the name of the problem change when we know these probabilities ( as in the video) vs. the case in which we have no idea about the transition probabilities?
the past doesn't matter baby!
You're so funny! 🤓
That was great sir 😂😂😂
I am trying to understand this stuff nowadays, this video is super helpfull, however i need some clarification on this one en.wikipedia.org/wiki/List_of_mathematical_symbols says that ∑ is sum, not sigma. the symbol for sigma is σ here. Is there a mistake made or is the wiki incomplete?
∑ is upper case sigma, σ is lower case sigma. Upper case sigma ∑ is used in mathematics as symbol for sum over some set or range of values. Wiki just doesn't mention that the sum symbol is called sigma.
@@Pengi31 Thanks buddy, helps a lot :)
Lmao markov meditation process
thought I was watching rick n morty
I got quickly hooked by the first video on bellman equation as it was simple, intelligent and lucid and immediately watched this one. Alas, quickly lost interest on this one as it starts with some lame gimmicks and I am no longer sure what to expect. You could have followed the simple style of the first one and got another million views..Will look for other material. Thanks