Why do we split data into train test and validation sets?
ฝัง
- เผยแพร่เมื่อ 21 ก.พ. 2023
- To train machine learning models we need to provide the model with a training and testing set. And sometimes even a validation set. These terms tend to be used interchangeably causing confusion. So once and for all, let's learn what each of these data splits do and how they contribute to model development.
👋 Keep in touch?
==========================
🐥 Twitter - / misraturp
🔗 LinkedIn - / misraturp
📹 TH-cam - / @misraturp
🌎 Website - misraturp.com/
Courses & resources
============================
📙 Fundamentals of Deep Learning in 25 pages
misraturp.gumroad.com/l/fdl
👩💻 Hands-on Data Science: Complete your first portfolio project
www.misraturp.com/hods
📥 Streamlit template
misraturp.gumroad.com/l/stemp
🤖 Deep Learning 101 with Python and Keras (FREE)
• 50 Days of Deep Learning
🏃♀️ Data Science Kick-starter mini-course (FREE)
misraturp.gumroad.com/l/kick-...
🐼 Pandas cheat sheet (FREE)
misraturp.gumroad.com/l/pandascs
📝 NNs hyperparameters cheat sheet (FREE)
misraturp.gumroad.com/l/hcs - วิทยาศาสตร์และเทคโนโลยี
Just what I was looking for, your video is so simple and easy to understand, and straight to the point!!!
Great to hear, thank you :)
Thanks for making a distinction between testing and validation
Thanks for your explanation, it is very useful for me.
video is very much useful. Your channel is so underrated.
Brilliant and clear!
Simple and good explanation, thank you so much ☺️
Good one!
This is very helpful on my ongoing thesis🥹
Superb
You are the best, thank you!😊
Thank you!
After finding the best hyperparameters for a model using validation data, should we retrain the model using both the training and validation data before using it on the test data?
No
I love your content. Everytime I split my data into train and valid, either using trainsplit function or manually, my val loss does not decrease below 1. The only way to get my val loss lower and lower, is to use part of my train data as validation data 😢
Your model might be overfitting in the first case :/
What camera do you use?
Good day ma, please can you help me out? I have been trying to figure out this for a long time but i could not. I want to know the best evaluation plots for machine learning models, specifically for classification problems. How best can someone visualize performance? Unlike deep learning models, you can use train and test curves, how best can we visualize using machine learning models? Do you have any video you have done about that? been checking your playlists but i can't find such, kindly help us out. Thanks
Teşekkürler.
please make a video on logestic regression
what is the need of testing data is the hyperparameters don't to be optimized?
Teşekkürler!
Rica ederim!
Can you explain something about it?????
Example the meaning and useful of each one
Can you make a project use of some ML application
0:50'de blop efekti ödümü kopardı
No demo?
Not for this one :)
Can we expect more pandas related videos
For sure! more to come.
You are soo cute❤❤
Ah, if you were living in France, I would have married you immediately, I would have taken you to some fancy restaurant everyday and during the night, you would have done my assignments within data science.
NOLIKE for UN useful!!!!!