Vector and matrix derivatives

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ต.ค. 2024
  • Full video list and slides: www.kamperh.co...
    Errata:
    6:10 - The Jacobian is actually something different (the partial derivatives of a vector function).

ความคิดเห็น • 38

  • @Le_Parrikar
    @Le_Parrikar 4 หลายเดือนก่อน +2

    Great video. That meow from the cat though

  • @awenzhi
    @awenzhi 15 วันที่ผ่านมา

    I'm confused about the deriative of a vector function at 5:40, i think the gradient of a function f:Rn→Rm should be a matrix of size m×n. not sure about it

  • @equationalmc9862
    @equationalmc9862 5 หลายเดือนก่อน

    I am learning and completely fascinated.. but the cat interrupting was hilarious as well.

  • @EzraSchroeder
    @EzraSchroeder 5 หลายเดือนก่อน +2

    4:49 if anyone asks what you're doing: watching cat videos on the Internet

    • @kamperh
      @kamperh  5 หลายเดือนก่อน

      🤣

  • @noaMurcianOfficial
    @noaMurcianOfficial 5 หลายเดือนก่อน

    Great video! thank you so much!
    Can you put the links in the description?

  • @dream_code9983
    @dream_code9983 2 ปีที่แล้ว +2

    انا جيت عشان باشمهندس حماد
    منزل بوست عنك اسطااااااااا

  • @krullebolalex
    @krullebolalex ปีที่แล้ว +1

    Great video! Been writing equations into componentwise notation without really knowing why. Now i do! Thanks a bundle

  • @himm2003
    @himm2003 ปีที่แล้ว +2

    Thank you for the video !!! Also which book would you recommend to learn vector/matrix calculus or multivariate analysis intuitively?

    • @kamperh
      @kamperh  ปีที่แล้ว +3

      For a long time the books in this area was very poor, but I love the newer Mathematics for Machine Learning book: mml-book.github.io/book/mml-book.pdf

    • @himm2003
      @himm2003 ปีที่แล้ว

      @@kamperh Great, thanks! Do you also suggest any book for pure vector calc/multivariate analysis? A book that completely teaches the concepts and maybe with proofs.

  • @binaryhaze-fm6lk
    @binaryhaze-fm6lk 8 หลายเดือนก่อน

    nice video for sure. but for a principle seeker , it was pretty weird to find a suddenly appeared formula like,partial derivative of x trans mutiply Ax to the vector x is (A trans + A)x

    • @kamperh
      @kamperh  8 หลายเดือนก่อน

      It's a really nice excercise to try and prove some these identies like the one you mention! That would be a great way to lay down the principles.

    • @binaryhaze-fm6lk
      @binaryhaze-fm6lk 8 หลายเดือนก่อน

      @@kamperh I‘ve proved it successfully! Indeed that was a nice experience, thanks for your precious advice

  • @viswanathvuppala4526
    @viswanathvuppala4526 หลายเดือนก่อน

    You look like Benedict Cumberbatch

    • @kamperh
      @kamperh  หลายเดือนก่อน +1

      The nicest thing that anyone has ever said!

  • @pedrorojas6297
    @pedrorojas6297 2 ปีที่แล้ว +1

    Thanks for this video. Kind regards!

  • @jacobburesh8522
    @jacobburesh8522 7 หลายเดือนก่อน

    Thank you so much for this explanation!!! This helped me tremendously.

  • @yuhanghan9220
    @yuhanghan9220 2 ปีที่แล้ว +1

    Thanks for your video, really helpful!

  • @markovwallenstein9357
    @markovwallenstein9357 2 ปีที่แล้ว +1

    6:10 this is not a jacobian matrix, whose function is a vector function: R_m to R_n instead

    • @kamperh
      @kamperh  2 ปีที่แล้ว

      Thanks for pointing this out: you are absolutely right! I've added it to the errata.

  • @ananth2006
    @ananth2006 10 หลายเดือนก่อน

    I’m so happy I found your channel! Beautiful diagrams and explanations, subscribed!

  • @গোলামমোস্তফা-শ৮থ

    Sir, After partial derivatives with respect to x1 and x2 we get two functions which represent the slope.
    My question is, are that functions represent the slope of a plane or anything?

  • @kavourakos
    @kavourakos ปีที่แล้ว +1

    wow im looking 6 months for a simple explanation like this

  • @jamesgreenwood6997
    @jamesgreenwood6997 2 ปีที่แล้ว +1

    At 4:41, each entry in that column of partial f with respect to the x's should read partial of f transposed with respect to the x's since you have defined the vector function f as a column matrix. The way you have it written would be an (NM)x1 column matrix.

    • @kamperh
      @kamperh  2 ปีที่แล้ว +3

      Hey @James Greenwood. Appreciate you watching and giving feedback! I think it depends on how you define the partial derivatives of a vector-by-scalar (which is different from the partial derivatives of a scalar-by-vector defined at the top of the slide). You will see on Wikipedia that vector-by-scalar is the transpose of scalar-by-vector, which means that in this case vector-by-scalar would be a row vector and you don't need a transpose. Have a look here: en.wikipedia.org/wiki/Matrix_calculus#Derivatives_with_vectors. Just note that they use numerator layout while in the slides I use denominator layout.

    • @jamesgreenwood6997
      @jamesgreenwood6997 2 ปีที่แล้ว +1

      @@kamperh Thank you for your reply. This makes sense now.

    • @sandorszabo2470
      @sandorszabo2470 ปีที่แล้ว

      @@kamperh Hi, it's a great video. I would like to suggest Ch 9 in Rudin, Principles of Mathematical Analysis, about differentiation. "At the beginnings" scholars decided about the vectors, a vector is a column vector (could have been row, but not). So to avoid the confusion and maybe wrong theorems, proofs, it would be useful to adopt this terminology.

  • @gvcallen
    @gvcallen ปีที่แล้ว

    Goat

  • @zuhairabuhanna8912
    @zuhairabuhanna8912 ปีที่แล้ว

    Source ?

  • @AJ-et3vf
    @AJ-et3vf ปีที่แล้ว

    Great video. Thank you

  • @GioGio-zt6el
    @GioGio-zt6el 2 ปีที่แล้ว +1

    you are a great guy

    • @kamperh
      @kamperh  2 ปีที่แล้ว

      Thanks Gio Gio! :D

  • @mustafizurrahman5699
    @mustafizurrahman5699 7 หลายเดือนก่อน

    U r simply lethal in elucidating such convoluted topic

  • @estebantapia1225
    @estebantapia1225 2 ปีที่แล้ว

    Nice and easy to follow, thankss

  • @scottzeta3067
    @scottzeta3067 2 ปีที่แล้ว

    I more like to see some example question but not horrible greek letter formula