Neural Network 3D Simulation

แชร์
ฝัง

ความคิดเห็น • 858

  • @anujshah645
    @anujshah645 7 ปีที่แล้ว +2117

    this is the coolest visualization of neural nets , i have ever seen. awesome

    • @DenisDmitrievDeepRobotics
      @DenisDmitrievDeepRobotics  7 ปีที่แล้ว +85

      thanks

    • @geotale95
      @geotale95 4 ปีที่แล้ว +23

      On an unrelated note, how do I give a comment -1 likes? Asking for a friend.

    • @gojust9818
      @gojust9818 4 ปีที่แล้ว

      I agree

    • @joshuarohantitchener7395
      @joshuarohantitchener7395 4 ปีที่แล้ว

      @@DenisDmitrievDeepRobotics th-cam.com/video/0U_FBHKYqRk/w-d-xo.html

    • @macdeep8523
      @macdeep8523 4 ปีที่แล้ว +1

      I only love neural nets

  • @raskr8137
    @raskr8137 4 ปีที่แล้ว +200

    "do you ever look at someone and wonder what is going on inside their head?"

    • @tesseracta4728
      @tesseracta4728 4 ปีที่แล้ว +8

      @David Parry there's something going on inside of the head of a stereotypical stereotyper... unfortunately, you rarely get to see their regression model. oh well. who am I to judge?

    • @edibleturd
      @edibleturd 4 ปีที่แล้ว +2

      ​@David Parry we may not have anything going on up there, but at least we're finally as smart as you.

    • @spiderjerusalem
      @spiderjerusalem 4 ปีที่แล้ว

      Beautiful comment

    • @kinseysharon2672
      @kinseysharon2672 4 ปีที่แล้ว +1

      Inside out? Where did I see this dialogue??

    • @HueHanaejistla
      @HueHanaejistla 3 ปีที่แล้ว +1

      @@kinseysharon2672 inside out yes

  • @ikramramli6410
    @ikramramli6410 5 ปีที่แล้ว +196

    that's the sound of my GTX 1050 screaming in pain..

    • @fruitcake7789
      @fruitcake7789 4 ปีที่แล้ว +5

      @@w花b It's not.

    • @memespeech
      @memespeech 4 ปีที่แล้ว +3

      @@w花b it's 50% slower

    • @dronevideos4341
      @dronevideos4341 4 ปีที่แล้ว

      タメル Who exactly... said that?

    • @hmm7458
      @hmm7458 4 ปีที่แล้ว

      @@w花b lol

  • @TCFKAS
    @TCFKAS 6 ปีที่แล้ว +36

    This is such a cool project to have realized. Mind blowing. I would be interested in seeing a 'making of' this one. I think this is so beautiful it deserves being called art and needs a place on a screen on my wall, in an infinite loop.

  • @aric7726
    @aric7726 6 ปีที่แล้ว +913

    The spiking network looked like what I'd imagine the brain would do

    • @myothersoul1953
      @myothersoul1953 5 ปีที่แล้ว +83

      @hyper Computational neural networks model brains the same way a stick figure models a person. 웃 Adding a couple of lines for hair, might might the stick figure more closely model a person but it's still a bad model.
      The interconnected nature of brain neurons might be partially modeled by neural networks but there is a lot of brain structure that is left out. It's not just a matter of scale, it's a matter of kind. For example, hormones are integral to brain function but neural nets have nothing that is analogous.

    • @TheRealJavahead
      @TheRealJavahead 5 ปีที่แล้ว +37

      @@myothersoul1953 Hmmmm... All models are wrong, some are useful. Just because it is incomplete and doesn't get anywhere near the scale or complexity of the brain doesn't make it a bad model. What's important is to know what you are trying to learn from the model and if it serves that purpose it is a good model. Got a better idea for computationally modelling the brain?

    • @myothersoul1953
      @myothersoul1953 5 ปีที่แล้ว +8

      @@TheRealJavahead That it doesn't get near the scale of complexity or include major components of the brain makes it a very poor model. Just like a stick figure is very poor model of human anatomy. Fortunately I am not in the business of modeling the brain because that's a very challenging task. Before a model could build how the brain functions needs to me understood. Many scholars across the world are working on parts of that. I'm sure they would tell they are making progress but are we no where near a complete understanding.
      You are right, what you are trying to learn from the model is important to know. What aspects of the brain you model focuses will vary depending on whether you are interested on perception, cognition, emotions or motor control. It would be a huge mistake to think the such a simple model such as neural nets come close to representing any of those.

    • @TheRealJavahead
      @TheRealJavahead 5 ปีที่แล้ว +29

      @@myothersoul1953 I do note that you have gone from categorising this as "a bad model" to "a poor model," next step might be that this is an "acceptable model." ;-) Relying on a reductio ad absurdum argument with your stick figure analogy is a false equivalency and doesn't support your assertion that this is a very poor (or bad) model. My point is, neither of us is in a position to determine how bad or good the model is without knowing its purpose.

    • @myothersoul1953
      @myothersoul1953 5 ปีที่แล้ว +7

      @@TheRealJavahead The purpose of a model is to represent something. A poor model does a bad job of representing.
      The reason I use the stick figure analogy is neural nets are often represent with lines a circles which are the same things used to draw stick figures. Stick figures only represent actual humans at the grosses of levels and neural nets resemble brain function at the grosses of levels (at best). That is neural nest are poor modes. But you are right, all analogies break down when pushed. The neural net analogy of the brain just needs the slightest breezy to fall down.
      A better representation of neural nets would be a set of equations and procedures but that still doesn't match the brain. That's why they do such a bad job of representing how brains actually function.

  • @Phiwipuss
    @Phiwipuss 3 ปีที่แล้ว +62

    This is amazing! It must've been a pain to render, considering the reflections and the frame-rate.

    • @SubtleArtOfLiving
      @SubtleArtOfLiving ปีที่แล้ว +1

      @DarkXSeries7 how about you can easily code it ;) in python or c#

  • @jydk37
    @jydk37 6 ปีที่แล้ว +16

    This is amazing. I think this animation provides an incredibly intuitive understanding of how neural networks operate and a generalized interpretation of the fundamental mechanics of how they work.

  • @ultravidz
    @ultravidz 6 ปีที่แล้ว +984

    I’m tryna make a neural net that discovers better neural nets through random trial and error. I’ll update you guys in 42000 years.

    • @ItsGlizda
      @ItsGlizda 5 ปีที่แล้ว +143

      it has already been done by deepmind, they used neural network to tune hyperparameters of other neural network.

    • @vishalmishra4408
      @vishalmishra4408 5 ปีที่แล้ว +25

      Already done. Check out Google's AutoML !!

    • @J4hk2
      @J4hk2 5 ปีที่แล้ว +93

      Ah, but where is the neural network that tests neural networks on their ability to discover better neural networks?

    • @nilaksh007
      @nilaksh007 5 ปีที่แล้ว +26

      @@J4hk2 you can always go deeper.

    • @Madlion
      @Madlion 5 ปีที่แล้ว +3

      check out HyperNEAT

  • @altimmons
    @altimmons 7 ปีที่แล้ว +178

    This is so cool. I love it. The spiking neural net was the coolest to watch. However, I couldn't help but notice that the spiking net wasn't working either.

    • @kronek88
      @kronek88 5 ปีที่แล้ว +30

      They are super difficult to train. But they have been shown to be potentially more powerful than any ANN

    • @martiddy
      @martiddy 5 ปีที่แล้ว +4

      @@kronek88 I think it depends on the problem you want to tackle, if you need a immediate approximation of something that requires a lot of computational power, then yes it's useful. But if you want a very precise result of a problem that isn't time consuming computationally. Then I think there are better algorithms than this one.

    • @pilotavery
      @pilotavery 4 ปีที่แล้ว +13

      @MetraMan09 Yes, they mimic natural human brains. Like they can try and solve a task, approach it another way, check their answer, etc. It's kind of able to divide itsself up and basically train another couple neural nets to each do their thing to work together to solve complex tasks. It requires a LOT of computational resources but also can solve tasks static networks simply can not solve. It is, however, capable of being potentially dangerous if not done correctly. In theory, this kind of network is the kind of artificial intelligence that we theorize could pass for human in a turing test.

    • @kotcraftchannelukraine6118
      @kotcraftchannelukraine6118 9 หลายเดือนก่อน

      Also spiking neural network could create autonomous AI system, simulate memory and brain functions.

    • @Plash14
      @Plash14 หลายเดือนก่อน

      How? Can you elaborate?​@@kotcraftchannelukraine6118

  • @DG123z
    @DG123z 4 ปีที่แล้ว +14

    Machine learning makes sense to me at a very basic level but overall it still seems like magic to pass stimulus through a weighted network like that and it eventually can recognize patterns. Especially since this process leads to consciousness in human brains..

    • @neponiatniichell9508
      @neponiatniichell9508 9 หลายเดือนก่อน

      Суть всей "магии" заключается в том, что скрытый слой можно настроить так, что на любое входное значение, на выходе будет соответствующий нужный правильный выходной сигнал, который мы хотели получить.

  • @knoriy
    @knoriy 5 ปีที่แล้ว +3

    That's amazing, best visualisation on a nn I've seen!! Great work!

  • @haissayf
    @haissayf 4 ปีที่แล้ว +2

    Best video on youtube, deserves to be on main stream during football game commercials

  • @demaitre2255
    @demaitre2255 4 ปีที่แล้ว +4

    The final version shows the back propagation in such a nice way! Well done

  • @sukalporoy8186
    @sukalporoy8186 4 ปีที่แล้ว +2

    Beautiful !
    Thanks Denis! Wonderful Creativity!

  • @flamboyanz
    @flamboyanz 6 ปีที่แล้ว +1

    Hats off to the visualization!! Great job

  • @joseortiz_io
    @joseortiz_io 4 ปีที่แล้ว +3

    Beautiful animations! You did a terrific job with the visualizations! Thank you, it brings great insights to a network!😊

  • @williamseipp9691
    @williamseipp9691 4 ปีที่แล้ว +2

    absolutely incredible upload. Thank you!

  • @martindzudx2865
    @martindzudx2865 7 ปีที่แล้ว +1

    This is crazy! Awesome visualization! Thx! :)

  • @abhishekshivdeo455
    @abhishekshivdeo455 4 ปีที่แล้ว +2

    Thanks a lot man! Just incredible!

  • @MsSinyria
    @MsSinyria 7 ปีที่แล้ว +1

    this is absolutely awesome! great work

  • @olexandrsubota81
    @olexandrsubota81 5 ปีที่แล้ว +1

    Gorgeous! Great Work!

  • @josepedroalmeida6586
    @josepedroalmeida6586 7 ปีที่แล้ว +1

    This is absolutely awesome, will share it on my social network, great job!

    • @TheChangeYT
      @TheChangeYT 4 ปีที่แล้ว

      pls make 3d visulaization of that lol

  • @RagMama123
    @RagMama123 6 ปีที่แล้ว +1

    Beautiful simulation! Thanks.

  • @shakir5604
    @shakir5604 5 ปีที่แล้ว +3

    this is really amazing man , Exquisite

  • @MT_Sami
    @MT_Sami 5 ปีที่แล้ว

    Excellent work, truly praiseworthy!

  • @SebHaugeto
    @SebHaugeto 4 ปีที่แล้ว +1

    This is amazing. Thanks for sharing!

  • @pariscatblue
    @pariscatblue 5 ปีที่แล้ว +5

    Absolutely AWESOME !!!!

  • @AFIXFORNIX
    @AFIXFORNIX 7 ปีที่แล้ว +1

    This is absolutely beautiful.
    We're currently developing our deep learning infrastructure in our group (freeD), and I work specifically on the visualizing tools.
    I'm nowhere near your master level rendering skills and I kinda feel like crying right now.

  • @user-yx4tb1sm7m
    @user-yx4tb1sm7m 6 ปีที่แล้ว +1

    This is absolutely awesome! music too!!

  • @SebHaugeto
    @SebHaugeto 4 ปีที่แล้ว +2

    This is just like I imagined neural nets when I first heard about them. So glad you were able to make it real!

  • @manvelarzumanyan4388
    @manvelarzumanyan4388 5 ปีที่แล้ว

    Denis.. Congratulations !!! Amazing render + animation

  • @GL-Kageyama2ndChannel
    @GL-Kageyama2ndChannel 4 ปีที่แล้ว +2

    Great work !

  • @willjennings7191
    @willjennings7191 4 ปีที่แล้ว +5

    This is a good spatial representation of the tensor as a hypergraph.

  • @amineech-cherif2386
    @amineech-cherif2386 6 ปีที่แล้ว +1

    This visualization is so awesome that it feels like a science fiction movie!!! Great job!

  • @artinbogdanov7229
    @artinbogdanov7229 4 ปีที่แล้ว

    Good job, Denis.

  • @maasteeve
    @maasteeve 4 ปีที่แล้ว +4

    As someone who has written digit recognition networks from scratch and wrote a paper about it I must say that this is a really good 3d visualization of the neural net.

  • @Cornul11
    @Cornul11 7 ปีที่แล้ว +7

    This is so satisfying to watch.

  • @epsilontic
    @epsilontic 6 ปีที่แล้ว +2

    This is an awesome visualization job.

  • @whiterozz
    @whiterozz 4 ปีที่แล้ว +1

    Amazing work

  • @deyanpetrov4447
    @deyanpetrov4447 5 ปีที่แล้ว +3

    The image actually moves when you stop the clip. So cool!

    • @arielferdman5842
      @arielferdman5842 4 ปีที่แล้ว

      It is not the image that moves - it is our brains automl experimenting with the bias hyperparameter.

  • @kostyanoob
    @kostyanoob 6 ปีที่แล้ว

    Great job. Very exciting demonstration

  • @raakeshbhardwaj
    @raakeshbhardwaj 3 ปีที่แล้ว +1

    The Coolest and the best visualization to understand neural nets! loved it!

  • @yutaiyama7501
    @yutaiyama7501 5 ปีที่แล้ว +1

    I must say this video is brilliant!

  • @nickvaleontis4657
    @nickvaleontis4657 4 ปีที่แล้ว

    Amazing video! great work

  • @junghweekwon6199
    @junghweekwon6199 5 ปีที่แล้ว +1

    This is the coolest video I have ever watched.

  • @gowthams1963
    @gowthams1963 5 ปีที่แล้ว +9

    So mesmerizing 😍, reason 1: The beauty of the network, reason2: The Background Score.

  • @mirandamoralez6354
    @mirandamoralez6354 6 ปีที่แล้ว +1

    great animation - especially in combination with those sounds!

  • @binxuwang4960
    @binxuwang4960 5 ปีที่แล้ว +4

    Actually even the music is awesome! it evokes curiosity and adds sense of mystery to the scene!

  • @marco.nascimento
    @marco.nascimento 4 ปีที่แล้ว +1

    this visualization is next level, dope as hell

  • @edgarreneramosacosta5428
    @edgarreneramosacosta5428 2 ปีที่แล้ว

    This is amazing! congrats my friend!

  • @paulburger9904
    @paulburger9904 5 ปีที่แล้ว +179

    That's a lot of hidden layers ya got there Bucko.

    • @trentonpaul6376
      @trentonpaul6376 5 ปีที่แล้ว +44

      I smell... overfitting

    • @Stierguy1
      @Stierguy1 5 ปีที่แล้ว +6

      @@trentonpaul6376 Depends on the size of the dataset.

    • @NilesBlackX
      @NilesBlackX 4 ปีที่แล้ว +1

      3? I guess that's a lot... If you're training on like an embedded graphics chip 😆

    • @terrykarekarem9180
      @terrykarekarem9180 4 ปีที่แล้ว +1

      @@NilesBlackX 3 is for really non linear data. Written numbers doesn't need more than 1 hidden layer

    • @NilesBlackX
      @NilesBlackX 4 ปีที่แล้ว +4

      @@terrykarekarem9180 MNIST doesn't, but proper handwriting training benefits from more layers. Adding punctuation, capitalization and diacritics makes the complexity rise above O(26) by an exponential.
      Regardless, 3 hidden layers isn't 'a lot' by any means, since that's a relative term which implies greater than average, and average depth for a FFNN definitely isn't < 4.

  • @VincentsPath
    @VincentsPath 4 ปีที่แล้ว

    WOW! amazing visualisation!

  • @enchanted_swiftie
    @enchanted_swiftie ปีที่แล้ว +1

    The spiking viz was amazing. Feels like in your brain, you're trying to understand the concept but it doesn't sink in and there is the darkness. And suddenly you get the point! It all lights up.

  • @marjim6998
    @marjim6998 4 ปีที่แล้ว

    Very intuitive thanks!

  • @joshiyogendra
    @joshiyogendra 4 ปีที่แล้ว +1

    hands down.. this is the best visualization of neural networks I have ever seen! just WOW

  • @RichardBaileyrichoncode
    @RichardBaileyrichoncode 4 ปีที่แล้ว +1

    Amazing!

  • @DAIQRY
    @DAIQRY 5 ปีที่แล้ว

    This is just awesome. I usually don’t comment on videos, but mate, this, is one of the best videos I’ve seen on yt

    • @DAIQRY
      @DAIQRY 5 ปีที่แล้ว +1

      Ben Kahrmann what? Do you even know anything about machine learning?

  • @chrisharri7376
    @chrisharri7376 3 ปีที่แล้ว

    super amazing, thanks a lot!!

  • @osvaldocruz386
    @osvaldocruz386 5 ปีที่แล้ว +5

    Watching this made me reflect on life.

  • @zhenlee5037
    @zhenlee5037 4 ปีที่แล้ว +1

    what a fantastic job!

  • @jiachenglee2554
    @jiachenglee2554 7 ปีที่แล้ว +1

    It's really helpful. Thank you.

  • @JohananJoysingh
    @JohananJoysingh 5 ปีที่แล้ว +1

    UNBELIEVABLE !! Wow... :) Thank you... !

  • @Drcalatayud
    @Drcalatayud 5 ปีที่แล้ว +1

    Great video, thanks :)

  • @ming-fengho662
    @ming-fengho662 7 ปีที่แล้ว

    Awesome video!

  • @DocMacLovin
    @DocMacLovin 5 ปีที่แล้ว

    excellent visualisation

  • @mikhailsladkomedov9037
    @mikhailsladkomedov9037 4 ปีที่แล้ว +2

    Man, that's awesome!

  • @moneyprinter9269
    @moneyprinter9269 4 ปีที่แล้ว +2

    i subscribed for content like this!

  • @madannikalje760
    @madannikalje760 6 ปีที่แล้ว +1

    Amazing appreciate your work

  • @sufiaji
    @sufiaji 5 ปีที่แล้ว +1

    This really cool... The music also!

  • @massimoesposito7014
    @massimoesposito7014 3 ปีที่แล้ว +1

    Professor! Too Cool!

  • @brussong1867
    @brussong1867 5 ปีที่แล้ว +1

    That's beautiful!

  • @chenqu773
    @chenqu773 4 ปีที่แล้ว +2

    Impressive man !

  • @gabrielsdsdsd
    @gabrielsdsdsd 5 ปีที่แล้ว

    Awesome animation!

  • @ChengliangShan
    @ChengliangShan 4 ปีที่แล้ว +2

    super cool video.

  • @keonkim8870
    @keonkim8870 7 ปีที่แล้ว +3

    really cool visualization :)

  • @Dilroopsingh
    @Dilroopsingh 5 ปีที่แล้ว

    Great work

  • @user-md6jf4pu7f
    @user-md6jf4pu7f 6 ปีที่แล้ว

    Really good , thanks

  • @conceptualprogress
    @conceptualprogress 5 ปีที่แล้ว +1

    Impressive!!

  • @paulfrischknecht3999
    @paulfrischknecht3999 4 ปีที่แล้ว +1

    Perfect visualization.

  • @planktonfun1
    @planktonfun1 7 ปีที่แล้ว

    A way to summarize it all this is great!

  • @suraj-ram7488
    @suraj-ram7488 5 ปีที่แล้ว +1

    Absolutly amazing

  • @doinktastic
    @doinktastic 5 ปีที่แล้ว

    This is fantastic. thankyou.

  • @ammadcheema638
    @ammadcheema638 3 ปีที่แล้ว +1

    Music+visual both are cool

  • @Lukka8_8
    @Lukka8_8 5 ปีที่แล้ว +4

    This is an amazing creation.

  • @fenilkaneria3249
    @fenilkaneria3249 4 ปีที่แล้ว +1

    this is the most fascinating visual representation of the neural network

  • @lalitghode300
    @lalitghode300 5 ปีที่แล้ว

    Great..Nice visualisation👍

  • @tserbkim2070
    @tserbkim2070 6 ปีที่แล้ว +1

    Thank you

  • @zilog1
    @zilog1 ปีที่แล้ว +2

    Wish the resolution was a bit higher and the bit rate didn't destroy the detail. I'd like to see this in at least 1440p

  • @timdai6396
    @timdai6396 4 ปีที่แล้ว +2

    This is so cool.

  • @Zsomx93
    @Zsomx93 7 ปีที่แล้ว +2

    Awesome!

  • @pyeleon5036
    @pyeleon5036 5 ปีที่แล้ว +1

    It's sooo beautiful!

  • @lightningspeed6466
    @lightningspeed6466 5 ปีที่แล้ว

    Really liked this

  • @polinabotova5376
    @polinabotova5376 7 ปีที่แล้ว

    Денис, великолепная работа!
    Хорошая демонстрация работы нейосетей для новичков этой сфере

  • @SurajKumar-xk6mo
    @SurajKumar-xk6mo 4 ปีที่แล้ว +2

    most awwesome video for neural networks representation

  • @child_of_god_
    @child_of_god_ 4 ปีที่แล้ว +1

    Soo clear, helps us understand better how theyvwork

  • @jasonhoi85
    @jasonhoi85 4 ปีที่แล้ว

    So cool!

  • @pectenmaximus231
    @pectenmaximus231 6 ปีที่แล้ว

    Stunning

  • @shrutiiyyer2783
    @shrutiiyyer2783 4 ปีที่แล้ว +1

    Sir, salute!

  • @shabank
    @shabank 3 ปีที่แล้ว +1

    Spiking neural network gave me goose bumps.

  • @Fuz2yman
    @Fuz2yman ปีที่แล้ว

    Very cool!