I don't fully understand the explanations for contextual bandits around 11 mins. Why do we say that an arm is a model? Don't you use a model to pick which arm you're going for?
Yes, but not neccesarily. Meaning each arm could have a model / alternatively a different price (think of "binning" for example, i.e. prices between 0-1 --> arm#1, prices between 1-2 ---> arm #2, ...).
@@danielhen8851 it is unclear from the video how the "simulate" function was built, and how is the "multiple_update" function used within the code. could you please clarify?
I don't fully understand the explanations for contextual bandits around 11 mins. Why do we say that an arm is a model?
Don't you use a model to pick which arm you're going for?
Yes, but not neccesarily. Meaning each arm could have a model / alternatively a different price (think of "binning" for example, i.e. prices between 0-1 --> arm#1, prices between 1-2 ---> arm #2, ...).
@@danielhen8851 it is unclear from the video how the "simulate" function was built, and how is the "multiple_update" function used within the code. could you please clarify?
Thank you for the great lecture.
Could I get your meetup_notebook.ipynb code? I am wondering about the simulation process details.
yes please, it would help a lot if you could update the notebook to github