Machine Learning Tutorial Python - 11 Random Forest

Подписаться 1,1 млн

Просмотров 358 тыс.

50% 1

Random forest is a popular regression and classification algorithm. In this tutorial we will see how it works for classification problem in machine learning. It uses decision tree underneath and forms multiple trees and eventually takes majority vote out of it. We will go over some theory first and then solve digits classification problem using sklearn RandomForestClassifier. In the end we have an exercise for you to solve.
#MachineLearning #PythonMachineLearning #MachineLearningTutorial #Python #PythonTutorial #PythonTraining #MachineLearningCource #MachineLearningAlgorithm #RandomForest #sklearntutorials #scikitlearntutorials
Code: github.com/codebasics/py/blob...
Exercise: Exercise description is avialable in above notebook towards the end
Exercise solution: github.com/codebasics/py/blob...
Topics that are covered in this Video:
0:00 Random forest algorithm
0:50 How to build multiple decision trees based on single data set?
2:34 Use of sklearn digits data set to make a classification using random forest
3:04 Coding (Start) (Use sklearn digits dataset for classification using random forest)
7:10 sklearn.ensemble RandomForestClassifier
10:36 Confusion Matrix (sklearn.metrics confusion_matrix)
12:04 Exercise (Classify iris flower using sklearn iris flower dataset and random forest classifier)
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Next Video:
Machine Learning Tutorial Python 12 - K Fold Cross Validation: • Machine Learning Tutor...
Populor Playlist:
Data Science Full Course: • Data Science Full Cour...
Data Science Project: • Machine Learning & Dat...
Machine learning tutorials: • Machine Learning Tutor...
Pandas: • Python Pandas Tutorial...
matplotlib: • Matplotlib Tutorial 1 ...
Python: • Why Should You Learn P...
Jupyter Notebook: • What is Jupyter Notebo...
Tools and Libraries:
Scikit learn tutorials
Sklearn tutorials
Machine learning with scikit learn tutorials
Machine learning with sklearn tutorials
To download csv and code for all tutorials: go to github.com/codebasics/py, click on a green button to clone or download the entire repository and then go to relevant folder to get access to that specific file.
🌎 My Website For Video Courses: codebasics.io/?...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Codebasics Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📱 Twitter: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
🔗 Patreon: www.patreon.com/codebasics?fa...

Опубликовано:

30 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 360

@codebasics 2 года назад

Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

@vipulsemwal478 Год назад

Hi, I have a question regarding fitting the model. When we do model. fit in every training, there will be a random set of samples for training. For example, in the iris dataset, I fit my model and then fine-tune with n_estimators =10,20,100, etc. sometimes it is getting 1.0 score on 20, but if I run it again, it gets 0.98, so how can I fix the x_train and y_train so it will not change every time. ? And I am really thankful for your lectures I am learning day by day. Thank you.

@freecodecamp 5 лет назад

This is a great series! Would you be interested in allowing us to repost it on our channel? We'll link to your channel in the description and comment section. Send me an email to discuss further: beau [at] [channelname]

@ShubhamSharma-to5po 4 года назад

mega.nz/file/LaozDBrI#iDkMIu6v-aL9fMsl-X1DETkOqnMqwptkn54Z51KINyw (like data in this file )//help if anyone understand. mega.nz/file/LaozDBrI#iDkMIu6v-aL9fMsl-X1DETkOqnMqwptkn54Z51KINyw (like data in this file )//help if anyone understand.

@ShubhamSharma-to5po 4 года назад

sir, can you tell me how to plot random forest classification with multiple independent variables.so confused in that

@codebasics 3 года назад

yes sure. go ahead. You can post it.

@sanchit0542 5 лет назад

Keeping the tutorial part aside (which is great), I really love your sense of humor and it's an amazing way to make the video more engaging. Kudos!! Also, thank you so much for imparting such great knowledge for free.

@codebasics 5 лет назад

Thanks for your kind words and appreciation shankey 😊

@srujanjayraj9490 5 лет назад

The way you teach or explain the concepts completely different thanks a lot!!!!!! Please make more videos

@codebasics 4 года назад

github.com/codebasics/py/blob/master/ML/11_random_forest/Exercise/random_forest_exercise.ipynb Complete machine learning tutorial playlist: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-gmvvaobm7eQ.html

@lokeshplssl8795 4 года назад

xlabel is the truth and ylabel is the prediction but in the video it is reverse.... Am I right? because we take "confusion_matrix(y_test,y_predicted)"

@jiyabyju 2 года назад

@@lokeshplssl8795 I do have same question

@lokeshplssl8795 2 года назад

@@jiyabyju I figured it out

@jiyabyju 2 года назад

@@lokeshplssl8795 hope there is no mistake in code..

@lokeshplssl8795 2 года назад

@@jiyabyju no mistake, He took y_predicted as a model of prediction with X_test.

@AbhishekSingh-og7kf 3 года назад

I can watch this type of videos whole day without take any break. Thank you!!!

@kausikkar2587 Год назад

Sir, I am damn impressed by you!!!! You are the best ML instructor here on YT!!!!

@zerostudy7508 5 лет назад

Lets promote this channel. I am just a humble python hobbies who took local course yet still I don't understand most of the lecturer says. Because this channel i've finally found fun with python. In just 2 weeks(more) I already this Level? Man....! Can't Wait for Neural Network but only from this channel

@spicytuna08 2 года назад

again, just spectacular graphics and easy to understand explanation. thank you so much.

@RustemShaimagambetov 5 лет назад

Man, its great! Your videos is best i have seen ever about machine learning. Its very helpfull material. I am waiting when you make tutorial about gradient boosting and neural networks. I think you can make easily to report it. Thanks!

@motox296 4 года назад

Great Video! I'm working on my first project using machine learning and am learning so much from your videos!

@codebasics 4 года назад

Hey Alex, good luck on your project buddy. I am glad these tutorials are helpful to you :)

@sumitkumarsain5542 5 лет назад

Just love ur videos. I was struggling with python. With ur videos was able to get everything in a weeks time. Also completed pandas and bumpy series. I would highly encourage u to start a machine learning course with some real life projects

@Moukraan 3 года назад

Thank you very much! This tutorial is really amazing!

@adityahpatel 3 года назад

I cannot quite express how amazing teaching you are doing. I am doing masters one of the finest universities in America and this is better than the supervised learning class I am taking there. Kudos! Please keep it up. appreciate you are making this available for free although I would be willing to see your lectures even for a fee.

@codebasics 3 года назад

Thanks for leaving the feedback aditya

@sohamnavadiya992 5 лет назад

Amazing man, keep it up and share more tutorial like this.

@tk1215 5 лет назад

Amazing, I like how you explain simply

@rameshthamizhselvan2458 5 лет назад

frankly telling your videos are more neat and clear than anyother videos in the youtube

@codebasics 5 лет назад

Thanks Ramesh for your valuable feedback :)

@iaconst4.0 23 дня назад

eres un excelente profesor!, gracias por compartir tus conocimientos! saludos desde Peru!

@Pacificatorrr 17 дней назад

You sir, are a gem! Thank you for this series! I managed to get an accuracy of 98%!

@ashish-blessings 2 года назад

You are amazing brother. I really loved this. You made it so simple. Thank you so much.

@panagiotisgoulas8539 2 года назад

It is a good practice to make a for loop for the n_estimators check the score for one of these: scores=[ ] n_estimators=range(1,51) #example for i in n_estimators : model=RandomForestClassifier(n_estimators=i) model.fit(X_train,y_train) scores.append(model.score(X_test,y_test)) print('score:{}, n_estimator:{}'.format(scores[i-1],i)) plt.plot(n_estimators,scores) plt.xlabel('n_estimators') plt.ylabel(('testing accuracy') And then you can sort of see what's going on. This practice is very useful for knearest neighbors technique for calculating k.

@cololalo 2 года назад

Thank you! I was looking for something like thi. I think in the fourth line the i is missing, as in model=RandomForestClassifier(n_estimators = i)

@panagiotisgoulas8539 2 года назад

@@cololalo yep forgot it thanks.

@fathoniam8997 Месяц назад

Thank you, I am trying to find something like this since the previous video!

@vishank7 4 года назад

This is sooo awesome! Amazing work sir💎

@ajaykumaars2154 4 года назад

Hi Sir, Can we use any other model (eg: svm) with the random forest approach, that is, by creating an ensemble out of 10 svm models and getting a majority vote? Thank you for the wonderful video.

@roodrakanwar3300 4 года назад

I achieved an accuracy of .9736. Earlier, I got an accuracy of .9 when the test size was 0.2 and changing the number of trees wasn't changing the accuracy much. So, I tweaked the test size to .25 and tried different number of tree size. The best I got was .9736 with n_estimators = 60 and criterion = entropy gives a better result. Thank you so much sir for the series. This is the best RU-vid Series on Machine Learning out there!!

@lokeshplssl8795 4 года назад

xlabel is the truth and ylabel is the prediction but in the video it is reverse.... Am I right? because we take "confusion_matrix(y_test,y_predicted)"

@panagiotisgoulas8539 2 года назад

@@lokeshplssl8795 I think I know why you are probably confused. This not a plot chart. You should not assume that because you passed y_test as a first argument you would see it horizontally similarly you do with xlabel. Unfortunately the confusion matrix is printed out unlabeled. True/Actual/test values are vertically alligned and predicted ones are horizontally. A couple of videos before he used another library to demonstrate the matrix labeled. If you have any questions regarding confusion matrix this is by far the best video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-8Oog7TXHvFY.html . Also a similar use case has to do with Bayesian statistics. Another great example ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE--1dYY43DRMA.html You don't have to get into it since the software does it for you, but it would help understand what is going on

@pablu_7 4 года назад

Thank you Sir for this awesome Explanation about RandomForestClassifier . I got score of 1.0 for every increased value in n_estimators

@codebasics 4 года назад

Nice work!

@TheMarComplex 2 года назад

Thank you so much! I love your videos.

@allahbakshsheikdawood466 4 года назад

Nice to watch your videos.. you make us understand things end to end !!

@codebasics 4 года назад

👍😊

@harshalbhoir8986 Год назад

This is so awesome explanation!! Thank you so much!!!

@anji1164 5 лет назад

Another Great Video. Thanks for that. I got 1.0 as score with n_estimators=1000. Keep doing these kind of great videos. Thank you.

@codebasics 5 лет назад

Anji, it's great you are getting such an excellent score. Good job 👍👏

@igorsmet1123 3 года назад

Thank you so much for very dynamic and clear content with the ideal depth on the topic details

@codebasics 3 года назад

Glad it was helpful!

@bikram40 4 года назад

Nice explanation as always. Great work.

@VivekKumar-li6xr 5 лет назад

Hello Sir, I have started learning pandas and ML from your channel, and i am amazed the way you are teaching. For Iris Datasets I got score =1 for n_estimators = 30

@codebasics 5 лет назад

Great Vivek. I am glad you are working on exercise. Thanks 😊

@rajmohammed8134 2 года назад

Thank you for such wonderful videos, I got accuracy score a 1 in the exercise question

@ericwr4965 4 года назад

Thank you so much. I need some help on this classifier for my data set. This helped a lot.

@codebasics 3 года назад

Glad it helped!

@Tuoc_Nguyen 2 месяца назад

For Iris Datasets I got score =1 for n_estimators = 40,50,60 Thank sir very much

@jeminceman4211 3 года назад

This video was amazing. Thanks!

@chrismagee5845 Год назад

FYI if you are using version 0.22 or later the default value of n_estimators changed from 10 to 100 in 0.22

@ashishsinha8893 5 лет назад

It's nice to see you bhaiya again

@mycreations3452 5 лет назад

Please upload frequently..we will wait for you

@2015murat 5 лет назад

great videos! thank you so much

@tanishqrastogi1011 7 месяцев назад

ok so i read one comment and put test_size = 0.25 and n_estimator = 60. I rerun my test sample cell as well as model.fit and model.predict cell and got the accuracy of 100%. I am having a god complex right now thank you for this amazing series

@mohamedabouobayd1992 5 лет назад

Love your videos. They're helping me a lot. thanks

@codebasics 4 года назад

Hey Mohamed, Thanks for nice comment. Stay in touch for more videos.

@alokpratap2094 5 лет назад

Again a nice video from you. Sir I have one general question. What is random_state and why we sometime take 0 and sometimes we assign value to it. What's the significance of this.

@James-pe3wl 4 года назад

Maybe I am a bit late jumping on the train, even though, I still want to say thank you for everything you have been doing. Your videos are much better to understand the field rather than the courses of top class Universities such as MIT. I have to say that you outperform all your competitors in a very simple way. As far as I know you had some problems with your health and I hope everything is good now. Wish you good luck and stay healthy at least for your RU-vid community. ^_^

@codebasics 4 года назад

Hey Yea James, thanks for checking on my health. You are right, I was suffering from chronic ulcerative colitis and last year 2019 had been pretty rought. But guess what I cured it using raw vegan diet, ayurveda and homeopathy. I am 100% all right and symptoms free since past 10 months almost and back in full force doing youtube tutorials :)

@prvs2004 4 года назад

@@codebasics Good to hear, Things are working out in a positive way! Be safe and I pray everything works well in the long run. Jai SriRam

@bhaskarg8438 2 года назад

your teaching is superb, and your knowledge sharing to Data Science community is Nobe|. I tried the exercise by giving the criterion = "entropy" got score as 1

@vijaydas2962 5 лет назад

Thanks for another post.. It's really helpful.... Just a question- Considering the fact that Random forest takes the majority decision from multiple decision trees, does it imply that Random forest is better than using Decision tree algorithm? How do we decide when to use Decision tree versus Random forest?

@veeek8 Год назад

You made that so simple thank you so much

@granothon8054 2 года назад

Excellent. Thank you.

@maruthiprasad8184 2 года назад

I got 93.33 accuracy at n_estimators=30 after that accuracy not increasing w.r.t increase in n_estimators. Thankyou very much for simply great explanation

@strifef7 Год назад

great, thank you so much!!!!

@adarshkesarwani6775 4 года назад

Thanks a lot sir for the videos, I wanna know when to use random forest or just tree?

@vijaykumarlokhande1607 3 года назад

this is crash course; if you are in hurry; this is the best series out there on youtube

@jyothishp143 4 года назад

This is the only channel i subscribed.

@codebasics 4 года назад

J Es, thanks. I am happy to have you as a subscriber 👍😊

@devendragohare5221 4 года назад

I Got 100% accuracy!.... by changing criterion = "entropy"

@lokeshplssl8795 4 года назад

xlabel is the truth and ylabel is the prediction but in the video it is reverse.... Am I right? because we take "confusion_matrix(y_test,y_predicted)"

@carti8778 2 года назад

@@lokeshplssl8795 it doesn’t change much, i mean u are just transposing the confusion matrix. The info still remain the same

@abhinavsharma6633 3 года назад

I got an accuracy of 0.982579 by giving, n_estimators = 100, well 100 is the default value now, and sir, big fan of your teaching 🙂

@codebasics 3 года назад

Good job Abhinav, that’s a pretty good score. Thanks for working on the exercise

@abhinavsharma6633 3 года назад

@@codebasics sir just wished to get in contact with you, to get a proper guidance

@fezkhanna6900 Год назад

Fantastic!

@austossen 4 года назад

first of all, your video is amazing. it simplifies image analysis to a 15 minute task. may i ask you a question regarding brain tumor data? i want to implement a random forest on the BraTS data set. i have a 4d array with 4 modalities: (flair,t1,t1ce,t2) => [modalities, image slices, x-plane,y-plane] and the labels are just 2d. your video is amazing but i don't know what to do with these 2d labels because target variable in your video is 1d. might you be able to give me an idea of how to deal with my labels or how to approach this problem generally?

@rajatbhalla1455 5 лет назад

Sir u r great thnx for these kinds of videos please make more videos 😊😊😊😊

@rajatbhalla1455 5 лет назад

Sir make more videos

@javadkhalilarjmandi3906 4 года назад

I've done all the Exercise till here. But I was planning not to do it for this video until I saw your last picture! I don't want you to be angry! so I am going to do it right now!

@codebasics 4 года назад

Ha ha nice. Javad. Wish you all the best 🤓👍

@geethanjaliravichandhran8109 3 года назад

Hi sir,i did your exercise of iris data and got an accuracy of 1.0 with n_estimators=80

@ousmanelom6274 2 года назад

thank you for this tutorial how to visualize randomforest and decision tree

@nomanshaikhali3355 3 года назад

Hey, Hope you're doing well! I have a query regarding random forest algo! I want to ask that I have predicted random forests algo and made 70 30 ratio! But how i can specify the prediction for 30days! Any variable or specifier? Looking forward to hearing from you soon! Thanky!

@usmanafridi9668 2 года назад

Best explanation of Random Forest!!!!!!

@codebasics 2 года назад

I am happy this was helpful to you.

@theodoregiannilias5140 Год назад

you're so much fun dude

@late_nights 4 года назад

The default value of n_estimators changed from 10 to 100 in 0.22 version of skllearn. i got accuracy of 95.56 with n_estimators = 10 and for 100 the same.

@MazlumDincer 4 года назад

n_estimators = 1 (also 290 or bigger) is even made accuracy %100 but, as all we know , this type of datasets are prepared for learning phases, so making %100 accuracy is so easy as well.

@usamarehmanyousaf2010 2 года назад

Hi, just want to ask this question that, in a data set split why should we drop the target column. Like that is the actual or final result that either the row is true or false. Then while spliting why should we have to drop that?

@izharkhankhattak 3 года назад

Nice work.

@shivamtyagi5614 3 года назад

default 100 n_estimators or 20 n_estimator , each case it gives 1.0 accuracy. well after getting on this channel , i can feel the warmth on the tip of my fingers.

@praveenkamble89 4 года назад

I got 100% accuracy with default estimator and random_state=10. Thanks a lot Sir

@codebasics 3 года назад

Good job Praveen, that’s a pretty good score. Thanks for working on the exercise

@erinwolf1563 5 лет назад

Thanks a lot Bro great videos👍👍👍....where can I get more Exercises for machine Leaning

@jyothishp143 4 года назад

Nice videos, Your videos are the best..Keep doing

@codebasics 4 года назад

Jyothish, I am happy this was helpful to you.

@aishwaryakilledar1742 2 года назад

Very nice sir.... Expecting more videos 😀

@codebasics 2 года назад

Glad it was helpful!

@jessehahka 4 года назад

Is it possible to predict a set of numbers that will output from a random number generator, finding the algorithm, in order to duplicate the same pattern of results?

@aminearbouch4764 4 года назад

ure great , thank you so much

@neelgorasiya7199 4 года назад

When I fit the data into model I didn't get the output as you like all feature are included in in model.It just showed me the model fitted nothing else.what can I do for to see full details of model at fitting??

@GerConGdeGato 4 года назад

Awesome channel. I have a question though. To find the optimal n_estimators I made a loop that went from n_estimators=1 until a number of my choice (number_trees) But I thought that a lucky train_test_split could give a very good score to a shitty model. So i made an inside loop that run up to a number of my choice (number_sets) the split, Train model, score and keep the best and worst scores. The result is that I see absolutely no tendency on the score depending on n_estimators. For example, with n_iterations = 3 and doing the split 5 times, the worst i get is 0.97 accuracy, which is great But with n_iterations = 4, the worst i get is 0.89, which is worse But then again, n_iterations = 10 i get 0.97 And so on so forth. My question is, why do not I see a tendency on the score depending on n_estimators? I was expecting the score to go up up to a certain n_estimators and then not changing. CODE (RU-vid doesnt allow copypaste so there might be a typo) number_trees = 100 number_sets = 5 pd.set_Option("Display.max_rows", None) results = pd.DataFrame(columns = ["min_score", "max_score"]) for i in range (1, number_trees+1): modeli = RandomForestClassifier(n_estimators = i) min_score = 1 max_score = 0 for j in range (number_sets): X_Train, X_test, y_train, y_test = Train_test_split(X,y) modeli.fit(X_train, y_train) score = modeli.score(X_test, y_test) if score > max_score: max_score = score if score < min_score: min_score = score results.loc[i, "min_score"]= min_score results.loc[i,"max_score"]= max_score results

@HarshithaMortha 4 года назад

Thank you so much for the tutorials sir. My interest in learning machine learning made easy by you. Can you please make tutorials on chatbots using python. Thank you

@codebasics 4 года назад

Hey harshitha, thanks for your kind words of appreciation and sure I will note down the topic you suggested 👍

@hanfeng32 5 лет назад

very Great video!!!!! thanks

@codebasics 5 лет назад

glad you liked it Han

@snehasneha9290 4 года назад

sir suppose to consider the 4 decision trees in that 2 trees give the same output and another 2 trees give the same output then which one considered both having the majority at that time plz clarify this doubt

@meenakshimalik7102 2 года назад

Hi Sir, we are blessed that we got your videos on youtube. Your videos are unmatchable. I am interested in your upcoming python course. When can I expect starting of the course?

@codebasics 2 года назад

Python course is launching in June, 2022. Not sure about exact date though

@boooringlearning 3 года назад

excellent lesson!

@codebasics 3 года назад

Glad it was helpful!

@RexeygamingOfficial 3 года назад

Amazing sir

@dickson9877 5 месяцев назад

I see many people is saying that in Irises they had 1.0 with 50+ esitmators. I am just starting with ML but for me 4 functions in Irises means that we don't need much estimators, there is actually only 6 unique combinations of functions. 10 if we used also solo columns as estimators which I presume is not happening. Am I correct that anything beyond 6 estimators shouldn't improve the model?

@supra20000000 2 года назад

The R2 we got is for test set (R2test), what about the model's R2 which is generally termed as R2training

@flamboyantperson5936 5 лет назад

Hey your vidoes are great. But where do you go away in the middle of making videos then come back after a long time.

@vadivelan4228 5 лет назад

Good one.

@jrajpal5 Год назад

Hi sir, i have a simple query regarding jupyter notebook. I can't see the parameters of randomforestclassifier() after applying model.fit() Is there any way to see those parameters

@dreamphoenix 2 года назад

Thank you.

@sagnikmukherjee8954 4 года назад

n_estimators = 10, criterion = 'entropy' led to a 100% accurate model !! Thanks!

@codebasics 4 года назад

Great job Sagnik :) Thanks for working on exercise

@sagnikmukherjee8954 4 года назад

@@codebasics My pleasure ! Amazing tutorials !! Been a great learning experience so far ! Cheers :)

@aliasjad9560 3 года назад

this video is very helpful .

@codebasics 3 года назад

Glad it was helpful!

@jaswanthnaiduravada4888 3 года назад

Sir when we are loading dir( iris) or dir(digits) datsets we are getting some other stuff.

@talharauf3111 2 года назад

Sir I have Done the Exercise with 100% Accuracy

@muhammedrajab2301 3 года назад

I am not afraid of you, but I respect you! So I am gonna do the exercise right now!

@ilfat_khairullin 3 года назад

thank you!

@VIVEK-ld3ey 2 года назад

Sir how are you deciding the xlabel and ylabel in the heatmap

@AlvinHampton-rz2iz Год назад

What makes you put truth on the y_label and predicted on the x_label?

@sonikusum3 Год назад

I am new to machine learning. Why am I not getting the same numbers as you did for the confusion matrix or scores? I used exactly the same coding as in the video.