Тёмный

Why do we split data into train test and validation sets? 

Mısra Turp
Подписаться 36 тыс.
Просмотров 55 тыс.
50% 1

To train machine learning models we need to provide the model with a training and testing set. And sometimes even a validation set. These terms tend to be used interchangeably causing confusion. So once and for all, let's learn what each of these data splits do and how they contribute to model development.
👋 Keep in touch?
==========================
🐥 Twitter - / misraturp
🔗 LinkedIn - / misraturp
📹 RU-vid - / @misraturp
🌎 Website - misraturp.com/
Courses & resources
============================
📙 Fundamentals of Deep Learning in 25 pages
misraturp.gumroad.com/l/fdl
👩‍💻 Hands-on Data Science: Complete your first portfolio project
www.misraturp.com/hods
📥 Streamlit template
misraturp.gumroad.com/l/stemp
🤖 Deep Learning 101 with Python and Keras (FREE)
• 50 Days of Deep Learning
🏃‍♀️ Data Science Kick-starter mini-course (FREE)
misraturp.gumroad.com/l/kick-...
🐼 Pandas cheat sheet (FREE)
misraturp.gumroad.com/l/pandascs
📝 NNs hyperparameters cheat sheet (FREE)
misraturp.gumroad.com/l/hcs

Наука

Опубликовано:

 

21 фев 2023

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 34   
@athulyadevermadam1169
@athulyadevermadam1169 9 дней назад
finally someone explained the basics
@iaboodws11
@iaboodws11 Год назад
Just what I was looking for, your video is so simple and easy to understand, and straight to the point!!!
@misraturp
@misraturp Год назад
Great to hear, thank you :)
@jamalnuman
@jamalnuman 5 месяцев назад
Thanks for making a distinction between testing and validation
@toyl6727
@toyl6727 Год назад
Brilliant and clear!
@sapnilpatel1645
@sapnilpatel1645 Год назад
video is very much useful. Your channel is so underrated.
@facundostratocaster356
@facundostratocaster356 4 месяца назад
Simple and good explanation, thank you so much ☺️
@syahwiza
@syahwiza Год назад
Thanks for your explanation, it is very useful for me.
@bay-bicerdover
@bay-bicerdover Год назад
Good one!
@volodyslove
@volodyslove Год назад
You are the best, thank you!😊
@misraturp
@misraturp Год назад
Thank you!
@ArifMuhammad-qd6vf
@ArifMuhammad-qd6vf Год назад
Superb
@jamesadeke9873
@jamesadeke9873 8 месяцев назад
Good day ma, please can you help me out? I have been trying to figure out this for a long time but i could not. I want to know the best evaluation plots for machine learning models, specifically for classification problems. How best can someone visualize performance? Unlike deep learning models, you can use train and test curves, how best can we visualize using machine learning models? Do you have any video you have done about that? been checking your playlists but i can't find such, kindly help us out. Thanks
@SocialAviation
@SocialAviation Год назад
I love your content. Everytime I split my data into train and valid, either using trainsplit function or manually, my val loss does not decrease below 1. The only way to get my val loss lower and lower, is to use part of my train data as validation data 😢
@misraturp
@misraturp Год назад
Your model might be overfitting in the first case :/
@aowowow-no1xe
@aowowow-no1xe Месяц назад
What camera do you use?
@ozgurartok9488
@ozgurartok9488 11 месяцев назад
Teşekkürler.
@misha4915
@misha4915 Год назад
After finding the best hyperparameters for a model using validation data, should we retrain the model using both the training and validation data before using it on the test data?
@bay-bicerdover
@bay-bicerdover Год назад
No
@jamalnuman
@jamalnuman 5 месяцев назад
what is the need of testing data is the hyperparameters don't to be optimized?
@097_suryakantdhote9
@097_suryakantdhote9 Год назад
please make a video on logestic regression
@patiklimikrofon
@patiklimikrofon 3 месяца назад
Teşekkürler!
@misraturp
@misraturp 3 месяца назад
Rica ederim!
@jsingh190
@jsingh190 Год назад
Can you make a project use of some ML application
@jameshopkins3541
@jameshopkins3541 5 месяцев назад
Can you explain something about it????? Example the meaning and useful of each one
@bay-bicerdover
@bay-bicerdover Год назад
0:50'de blop efekti ödümü kopardı
@jameelabduljalil25
@jameelabduljalil25 Год назад
No demo?
@misraturp
@misraturp Год назад
Not for this one :)
@SyamKishoreNaidu
@SyamKishoreNaidu Год назад
Can we expect more pandas related videos
@misraturp
@misraturp Год назад
For sure! more to come.
@Randomsi_10
@Randomsi_10 Месяц назад
This is very helpful on my ongoing thesis🥹
@sumitranjan7858
@sumitranjan7858 10 месяцев назад
You are soo cute❤❤
@babaabba9348
@babaabba9348 10 месяцев назад
Ah, if you were living in France, I would have married you immediately, I would have taken you to some fancy restaurant everyday and during the night, you would have done my assignments within data science.
@jameshopkins3541
@jameshopkins3541 5 месяцев назад
NOLIKE for UN useful!!!!!
Далее
How is data prepared for machine learning?
13:57
Просмотров 54 тыс.
СОБАКИ ГОЛОДАЮТ ИЗ-ЗА ЛЕРЫ 🥲
01:00
Train, Test, & Validation Sets explained
6:58
Просмотров 202 тыс.
ML Was Hard Until I Learned These 5 Secrets!
13:11
Просмотров 245 тыс.
All Learning Algorithms Explained in 14 Minutes
14:10
Просмотров 200 тыс.
$1 vs $100,000 Slow Motion Camera!
0:44
Просмотров 26 млн