MIT Introduction to Deep Learning | 6.S191
ฝัง
- เผยแพร่เมื่อ 4 มิ.ย. 2024
- MIT Introduction to Deep Learning 6.S191: Lecture 1
New 2024 Edition
Foundations of Deep Learning
Lecturer: Alexander Amini
For all lectures, slides, and lab materials: introtodeeplearning.com/
Lecture Outline
0:00 - Introduction
7:25 - Course information
13:37 - Why deep learning?
17:20 - The perceptron
24:30 - Perceptron example
31;16 - From perceptrons to neural networks
37:51 - Applying neural networks
41:12 - Loss functions
44:22 - Training and gradient descent
49:52 - Backpropagation
54:57 - Setting the learning rate
58:54 - Batched gradient descent
1:02:28 - Regularization: dropout and early stopping
1:08:47 - Summary
Subscribe to stay up to date with new deep learning lectures at MIT, or follow us on @MITDeepLearning on Twitter and Instagram to stay fully-connected!! - วิทยาศาสตร์และเทคโนโลยี
What a privilege and great time we live in that most precious courses like these from MIT are accessible for freee.
After being in college for 4 years and dealing with loads of professors, I can hands down say this guy is the best lecturer I've ever seen! Explains tough concepts so well.
Maybe 'cause I don't have a strong base, there's a bunch of stuff I just don't get.
Mnn no n no k no no n no nnnnnn. 😅😅mn no nnn no nnnnnnnnn nnnnnn😅nnnnnnnnn no n no 😅 no nnlnn
No nnlnn😅n nn
Nnnnnnnnnnnn no nn
Nnnnnn non nnnnnnnnnnn
It's wonderful to see universities of the calliber of MIT making education accessible to everyone for free. Thanks MIT!!
This is not for beginners. Having 3+ years of experience in deep learning i found it interesting on how much information is shoved into 1 single video . Note that each concept is very vast if we dig deeper
could you link some real beginner information so i can understand this course?
There is a playlist in TH-cam names 100 days of deep learning by campusx. You can find everything in deep
U know where we can find some real number training example of using a basic liquid neural network ?
this 1 video covered an entire semester worth of deep learning course of my college
@@adityaverma1298 you mean this video series right?
Finally I can follow live lectures
since you strongly pointed that out, what are these big advantages over offline lectures that you're so in favor of?
@@webgpu ofline lectures? I guess you meant to say, "What are the advantages of following live online lectures over recorded online lectures? Did I get the question correctly?
@@page002 sorry I most probably was not able to express myself properly. I meant "what are the advantages of the [opposite of live] lectures - so I think that's what you also meant in your past comment 👍
@@webgpu don't worry. So here's my point -
I prefer Live Recorded lectures over only recorded lectures because when we follow live I think we can connect more with the instructors. Also it gives us the impression that we are also a part of it which a recorded and already published can never give(at least that's what I think).
And last but not the least if we follow the live (recorded) lectures here we will have a clear goal and a Dateline to follow. And I think that's a great thing.
So, any day I prefer Live Recorded lectures or Live lectures if possible over recorded lectures specially for technical things and programming.
I am a pretty bad communicator so, I hope you got your answer even a little. BTW, if you don't mind, try to follow Live lectures once I think you will be able to see the difference personally.
Happy Learning
I usually find neural networks challenging to grasp until I watched this lecture. I truly appreciate how you simplified the concept for me.
I am a high school student and I am currently self-studying deep learning and I find it very helpful.
I hope one day I can attend your lectures in person.
Thank you very much.
Both theory and actual implementation in industry code! Perfect! Also, great pacing and depth!
After 5 minutes in one episode, and i can already tell this is the best beginner ai lecture series I have seen!
I look at these videos every year after the new annual release and it just never gets old. Too bad in my work, I don't get a chance to apply this knowledge. It is still super fun to watch, like a fun show to me
just WOW! You almost summarize my learning of 4 years PhD in 1 hour. Keep it up dear. You have everything to speculate your expertise :)
YahoooOoo!! Another great season ahead!
Yesterday we started system identification using neural network, I watched your lecture and now I feel quite comfortable using the concept of deep learning. Thank you Sir and love from Pakistan....
Thanks for the videos and the slides, they are great assets for students and teachers.
I wish that you have explained more about back propagation with a numerical example, and the different activation functions we can use in the last layer for the different classification problem, like binary classifications multi-class classification and regression problems
Every year I'm here, you remain the best
Always be your big fan, really excellent teachings. These are the ones I'd love to go through again and again!
I've been following these MIT Deep Learning lectures since 2019. I've learned so much. Thank you, Alexander and Ava.
So do I need to watch all previous lectures too? Or are the ones in this 2024 course enough?
@@lakshyajain6765 don't need to since every semester course is self contained unit. This is not created for TH-cam, it's for MIT students and every semester there is new batch.
@@user-xn5do6xc1u Thanks a lot!!! Do you have any other resources on MIT ML lectures for their students? this is my alt acc
@@user-xn5do6xc1u Thanks a LOT!!! this is my alt. Do you have any idea on some more MIT ML related lectures. I would like to do some research in this field and try to get into a phd program
@@user-xn5do6xc1uWhere can I find the next part?
It's nice having up to date lessons on this stuff considering how fast it moves, even if a good amount of the core content presumably largely stays the same.
I want to take this moment to thank TH-cam, MIT and Alexander Amini for suppling this content 4 a person like me who is studding deep learning but was not fortunate enough to study in MIT🙏🙏
Great presentation, thanks for always simplifying these concepts to the understanding of all.
Your way of explaining is like movie screenplay or storytelling we are totally into the world you created.
Thanks for the session, Alex.
Looking forward to this! 🙏🏻
what not to love in things that seem good and are about to happen ?
introduced to the title 4 decades ago...thanks for updating
was waiting from last December. Thnak you
Thanks for the lecture, please please make a video or provide a pdf of MATH too, I wanna know the math behind deep learning, svms, pca, ML in general aka grad descent etc, how then that changes when many layers are involved (as in deep learning) so basically
normal ML -> i/p -> mat mul -> o/p
deep learning -> i/p -> mat mul = linear x matrix . non linear x matrix . linear or non linear x matrix ..... -> o/p
etc etc etc I mean try and simplify what goes on mathematically then also give enough formalization that some of us can begin to understand a few of the key ML papers on Arxiv. This has been our biggest challenge truly.
Absolutely amazing. Great to be here.
i am also very happy that i am really right here where i am now.
Thank you, Alexander and MIT for make this information available for everyone.
Awesome course !! Can't wait to complete it 😁
WOW!!!!😍My professor is chinese and I know he knows a alot of things but after watching this teacher teachin, I understood the importance of a good presentation and most importantly, what a good presentation look like.
I was waiting for this for so long ❤
Hands down, this is the best low level explanation of deep neural networks I have seen so far.
It's not low level... It's High level like programming languages.
@@HeyMr.OO7 What do you mean by low level in your definition? It is as low level as you can get in this field that you can perform calculations on an entire network by hands without having to rely on computers, not to mention programming languages or libraries. Some data scientists or self-taught professionals I have talked to who are fluent in machine learning tools which are considered high levels do not quite completely understand this low level fundamental and I doubt if they could hand calculate an entire network from scratch.
@@paultvshow alright man ! Now, Go get some air !
@@HeyMr.OO7Stop it and get some help if you can’t even reason. You don’t even know what level means lol.
@@paultvshow God bless your brain man ! Now leave 😅😅
I loved this, It's my major course......It's extremely helpful...love from Bangladesh
Amini genius is back!!
This is the amazing work. Thank you for sharing.
Looking forward 😃
If I were just starting to learn deep learning, I would start with this video
Amazing lecture. I can't thank you enough!
I loved this session! I am getting interested in it.
Thank you!
Thank you for making these content accessible for everyone
I'm a beginner in ml and ai fields and it's amazing to have these lectures online and free. I've a doubt: the neural network showed in 33:44 shouldn't be named 'multi' layer rather than 'single' layer neural network since it has an output layer separated of the hidden layer? Thanks!
Sir you are doing a great job, I am student of BSCS, last year from Pakistan. But being a student to learn Deep Learning from last 2 year, I am still a beginner, as the system is not very modern. This lecture seems like a new start for me, which feels very promising. Can you please share the other lectures, so I (students like me) can really advance in this field, and maybe start working at MIT someday. Thanks for teaching in such a beutifull way.
It's finally out!! 🤗🤗
Finally the wait over 😊
Such a great content about computer vision , really helpful and thanks 👍❤❤
Attended Deep Learning lectures at a topmost college of a country, here he clearly explained all that in a single lecture for which the former took 10s of lectures to explain.
Thank you for your course !
Love your style!
You are a great teacher. I wish my professor explained this way. 🎉
That was sick!
Amazing explanation. Thank you
Excellent lecture! Was wondering, when would the next lecture (in the same series of year 2024) be coming out? :D
Every year I look forward to this!
i too love to expect things that occur periodically to happen the next time!
A big Thank you to you for this great course
Hello Alex 😊😊 Thank you so much ❤❤
Sir's explanation is better than any Udemy and Coursera course out there fr😮
You make it so understandable
Muchas gracias!!! estas lecturas me han sido de mucha ayuda :)
Great video! Where can I watch the software lab lessons? And will the first lab Intro to TensorFlow/Music Generation be available this week? Thank you!
This video is interesting because,this video helps me understand the current price and prediction of Palantir stock. The analyst explains incredibly. Thank you for sharing this valuable information.
Hi dear, Thanks for the course. Like always informative and to the fundamentals of DNN.
The mathematics which I studied this semester is completely making sense now.
This is one the best lecture series for deep learning out there... keep up the good work!!!! Will there be any lecture on the lab assignment - on how do you configure your tensorflow on Google Colab for the assignement/project? I believe that it would be idea/good if there is some lecture video to show how do you configure the Tensorflow on Google Colab. Thank you.
This I got if it may be helpful:
Setting up a TensorFlow lab assignment on Google Colab involves a few steps:
1. *Create a new Colab notebook*: Go to Google Colab and create a new notebook by clicking on "New Notebook" or "File" > "New Notebook".
2. *Install TensorFlow*: Run the following command to install TensorFlow:
```
!pip install tensorflow
```
1. *Import TensorFlow*: Run the following command to import TensorFlow:
```
import tensorflow as tf
```
1. *Verify TensorFlow version*: Run the following command to verify the TensorFlow version:
```
print(tf.__version__)
```
1. *Enable GPU acceleration*: If you have a GPU available, run the following command to
Check this out..
1. _Create a new Colab notebook_: Go to Google Colab and create a new notebook by clicking on "New Notebook" or "File" > "New Notebook".
2. _Install TensorFlow_: Run the following command to install TensorFlow:
```
!pip install tensorflow
```
1. _Import TensorFlow_: Run the following command to import TensorFlow:
```
import tensorflow as tf
```
1. _Verify TensorFlow version_: Run the following command to verify the TensorFlow version:
```
print(tf.__version__)
```
1. _Enable GPU acceleration_: If you have a GPU available, run the following command to enable GPU acceleration:
```
!pip install tensorflow-gpu
```
Then, restart the runtime by clicking "Runtime" > "Factory Reset Runtime" or "Runtime" > "Restart Runtime".
1. _Verify GPU acceleration_: Run the following command to verify GPU acceleration:
```
print(tf.config.experimental.list_devices())
```
This should list the available devices, including the GPU.
1. _Set up the assignment_: Follow the instructions provided in the assignment or project to set up the environment, load the data, and implement the required tasks.
2. _Load the data_: Use the appropriate library (e.g., Pandas, NumPy) to load the data into Colab.
3. _Implement the tasks_: Write the code to implement the required tasks, such as data preprocessing, model training, and evaluation.
4. _Run the code_: Execute the code cells to run the tasks.
5. _Visualize the results_: Use visualization libraries (e.g., Matplotlib, Seaborn) to visualize the results.
6. _Save the notebook_: Save the notebook regularly to avoid losing your work.
Some additional tips:
- Make sure to save your notebook regularly to avoid losing your work.
- Use the "Cells" menu to insert new cells or delete existing ones.
- Use the "Markdown" option to format text and headings.
- Use the "Code" option to write and run code.
- Use the "Output" option to view the output of your code.
- Use the "Restart" option to restart the runtime if needed.
By following these steps, you should be able to set up your TensorFlow lab assignment on Google Colab and start working on your project.
bessssst!
Awesome!
These lectures are goated 🔥
I am waiting to know what's next in that amazing field.
Game changer lecture is stating.
Great work thank you❤
sir you don't know how much i needed this! i am begining to start my research very soon, is there anythingyou recommend to get started with dl ?
good Presentation agood overview about deep learning thanks sir Alexander Amini
You teach fabulous
Let's gooo!!!
Thank You Sir
Amazing for free lectures ❤
my favorite youtuber just dropped a new episode!
ah that moment when someone who produces good content, produces good content!
Genial, saludos desde Chile.
Excellent video! just a minor comment: about 27:00 i think you should state clear that (1+3x1-2x2) = z and include the "hat" to y (in the graph)...🖖
What is the prerequisites one must know before diving into this lecture?
Thanks!
Amazing, top content! Out of curiosity: Why TensorFlow instead of Pytorch?
Finally i looked your session
Next session pls came
NEW SEASON BOYS
hi Its great work MIT is doing for the enthusiast learners, I am thankful. I have one question may I know the frequency of upload in TH-cam? will there be any practicals? using python and library?
Is there any group to follow with other peers? Has anyone made a link?
None yet, but you could start one 😊
If yiou made one, I'll join, if not, I have a Telegram one.
@@mihaidanielbeuca1083 what's the Telegram link?
Please if you send here the Link please
amazing video
I love it
yea buddy!!
At 22:45 you mention the ReLU function has a discontinuity at '0', IIUC this is not true, ReLU is a continuous function, even at '0'. It is however not differentiable at '0'.
Explained so well, hopefully I will get more video to watch.... Can somebody suggest me to find best free material (video) like this video for AI, I desperately want to make my career in field of data science and AI
Wao Amazing And cool live labs
So basically what Meta with Llama 3 has done is give to the community the weights for each perceptron?
As a society we should be open sourcing education it’s a net + no matter what
In Deep/Multi-layer neural network slide , does non-linearity will be applied on y1^ ?
Can anyone tell me,
Are there other videos that are going to be premiered for this 2024 course, or is this the only video we get a chance to watch?
I am in a bit of a fix, hope someone in the comments or the publishers of the series can shed some light.
I am a professional embedded software engineer. I have been fiddling with the idea to develop expertise in embedded AI and thus looking for an inroad, lets call it that. Now i know there are options like TinyML(TF lite) , edge impulse and other frameworks where maybe i could jump in.
The question is, is this a good way or is it more suggested to take up an uni/grad level curriculum like this one?
I guess something that brings me to hands on implementation at the embedded level relatively quickly will be very enticing.
will the lab class be available in the youtube too?
28:24 This is a very basic idea of deeplearning. I should have watch these lectures before I started my computer vision courses.
Thanks for your good lecture for deep learning, Alexander Amini!
I have a question for you. I would like to translate and adapt your deep learning lecture videos into Korean to introduce them to Korean speakers. Would it be possible to use your content for this purpose? I plan to upload the adapted videos on my channel.
I won't be using the videos in their entirety but would like to incorporate some of the material. The adapted videos will not be monetized, and I will include reference links to your original content.
Your explanations of deep learning are excellent and extremely informative. I want to make this knowledge more accessible to my Korean audience, so I'm reaching out to ask for your permission.
Thank you!
Great lecture, but I wonder why u guys take out the robotic learning from your curriculum ?
At 46 min. Where does the initial loss landscape came from?