Mini Batch Gradient Descent | Deep Learning | with Stochastic Gradient Descent

แชร์
ฝัง
  • เผยแพร่เมื่อ 29 ธ.ค. 2024

ความคิดเห็น •

  • @MachineLearningWithJay
    @MachineLearningWithJay  3 ปีที่แล้ว +1

    If you found this video helpful, then hit the *_like_* button👍, and don't forget to *_subscribe_* ▶ to my channel as I upload a new Machine Learning Tutorial every week.

  • @sumitsp01
    @sumitsp01 2 ปีที่แล้ว +2

    This is by far the best video on introduction to optimizers.
    Very precise, articulated and clears all the doubts.
    Thanks a lot brother !

  • @arvinflores5316
    @arvinflores5316 3 ปีที่แล้ว +2

    Oh wow. When I was start learning ML, last year, your linear regression was one of the vids I first watched. Now, I'm a data scientist, you're still uploading high quality vids. Thank you! Hopefully we could get to see LSTMs and Transformers in the future. :P good day.

    • @MachineLearningWithJay
      @MachineLearningWithJay  3 ปีที่แล้ว

      Wow... Really good to know this. Thank you for sharing your story! And Yes I will be uploading videos on LSTM.

    • @arvinflores5316
      @arvinflores5316 3 ปีที่แล้ว +1

      @@MachineLearningWithJay Wow nice! Can I make a suggestion? Maybe in the future you can include weight initialization like Xavier and He Norm. Those topics tend to be ignored because the computer is basically covering those, (I'm guilty of that :P) without knowing the reason behind it, e.g the disadvantages of weight initialization with 0 value.

    • @MachineLearningWithJay
      @MachineLearningWithJay  3 ปีที่แล้ว

      @@arvinflores5316 Thank you for giving this suggestion. I will definitely consider making videos on these topics.

  • @alexkonopatski429
    @alexkonopatski429 2 ปีที่แล้ว +1

    good video! but I have only one question: where does the noise come from, that you mentioned at 5:11?

  • @devanshsanghavi
    @devanshsanghavi 2 ปีที่แล้ว +2

    Brilliant explanation... Keep it up!

  • @dr.ranjinips3103
    @dr.ranjinips3103 8 หลายเดือนก่อน

    Very nice Explanation. Super

  • @afn8370
    @afn8370 7 หลายเดือนก่อน

    very good explanation. u need more views

  • @choice_of_royals5268
    @choice_of_royals5268 2 ปีที่แล้ว

    amzing, deeply explained. thanks

  • @chenmoasis
    @chenmoasis ปีที่แล้ว

    Amazing helpful video!

  • @AbhinavSingh-oq7dk
    @AbhinavSingh-oq7dk 2 ปีที่แล้ว +1

    So from what I understand,
    in Mini Batch Gradient Descent, model will train 1st mini batch, update the weights and then those updated weights will be used to train the 2nd mini batch, update and then the 3rd mini batch,..., till the last mini batch (1 epoch), then the last mini batch updated weight will be again used on 1st mini batch during 2nd epoch and so on?
    Do correct if wrong.

    • @MachineLearningWithJay
      @MachineLearningWithJay  2 ปีที่แล้ว +1

      You are correct on your understanding Abhinav. I would just like to correct the words. You can say that the updated weights after training on any mini-batch is used to propoagate forward, and then they are updated again in backward propagation. Eg, randomly initialise weights at the beginning. Propagate forward (perform forward propagation) using 1st mini batch, then perform backward propagation, then update weights. Use those updated weights to perform forward propagation using 2nd minibatch, then backward propagation, update weights again and so on.

    • @AbhinavSingh-oq7dk
      @AbhinavSingh-oq7dk 2 ปีที่แล้ว +1

      @@MachineLearningWithJay Thanks :)

  • @hardikdas2378
    @hardikdas2378 3 ปีที่แล้ว +1

    very informative and precise.

  • @GK-jw8bn
    @GK-jw8bn 3 ปีที่แล้ว +1

    very good explanation! well done!

  • @harpbeat500
    @harpbeat500 2 หลายเดือนก่อน +1

    great video

  • @malikhamza9286
    @malikhamza9286 3 ปีที่แล้ว +1

    Amazing dude. Keep it up.

  • @amirrezamousavi5139
    @amirrezamousavi5139 2 ปีที่แล้ว +1

    Great job

  • @jordiwang
    @jordiwang ปีที่แล้ว

    you got a new sub bro, good video

  • @SaschaRobitzki
    @SaschaRobitzki 2 ปีที่แล้ว

    Great job!

  • @EEDNAGELIVINAYAKSHRINIWAS
    @EEDNAGELIVINAYAKSHRINIWAS 3 ปีที่แล้ว +2

    Your videos are helpful, Can you suggest a good book on same...

    • @MachineLearningWithJay
      @MachineLearningWithJay  3 ปีที่แล้ว

      Hi... I don’t refer any book so can’t suggest you any. Although you can search for good books on ML online. I once found an article which showed top 10 books for learning ML.

    • @EEDNAGELIVINAYAKSHRINIWAS
      @EEDNAGELIVINAYAKSHRINIWAS 3 ปีที่แล้ว

      @@MachineLearningWithJay Ok ! Thanks!...But have topics like batch normalisation and standard network like LeNet, AlexNet, AGG, GoogleNet in detail

    • @MachineLearningWithJay
      @MachineLearningWithJay  3 ปีที่แล้ว

      @@EEDNAGELIVINAYAKSHRINIWAS Have you read the original research papers for these? I think you can learn about these in their research papers only.

    • @EEDNAGELIVINAYAKSHRINIWAS
      @EEDNAGELIVINAYAKSHRINIWAS 3 ปีที่แล้ว

      @@MachineLearningWithJay Ok..can you mail me on my id lets discuss separately on some projects

    • @MachineLearningWithJay
      @MachineLearningWithJay  3 ปีที่แล้ว

      Hi Vinayak, you can mail me on codeboosterjp@gmail.com with your query. I will see what i can do to help.

  • @hosseinkarimi3381
    @hosseinkarimi3381 2 ปีที่แล้ว

    Thank you so much for your videos.

  • @sharangkulkarni1759
    @sharangkulkarni1759 2 ปีที่แล้ว +1

    ty

  • @azadehazhdari931
    @azadehazhdari931 ปีที่แล้ว

    👌

  • @mugomuiruri2313
    @mugomuiruri2313 ปีที่แล้ว

    good boy