Tutorial 3-End To End ML Project With Deployment-Project Problem Statement,EDA And Model Training

Подписаться 980 тыс.

Просмотров 85 тыс.

50% 1

Project Code: github.com/krishnaik06/mlproject
Join iNeuron's Data Science Masters Course with Job Guaranteed Starting From April 3rd 2023
ineuron.ai/course/Full-Stack-...
Join this channel membership to get access to materials:
/ @krishnaik06
check out the project playlist
• End To End Data Scienc...
--------------------------------------------------------------------------------
Timings
00:00:00 Exception Handling Logger code
00:02:43 Problem Statement
00:08:03 EDA And Feature Engineering
00:21:05 Model Training
00:36:54 Git Commit
----------------------------------------------------------
Check Out My Other Playlist
Python Playlist:
Python In English: • Complete Road Map To B...
Python In Hindi: • Tutorial 1- Python Ove...
Stats Playlist:
English 7 Days Statistics Live Session : • Live Day 1- Introducti...
Hindi: Stats Playlist: • Starter Roadmap For Le...
Complete ML Playlist: • Complete Road Map To B...
Hindi: ML Playlist: • Introduction To Machin...
5 DaysLive Deep Learning Playlist: • 5 Days Live Deep Learn...
Complete Deep Learning Playlist:
• Why Deep Learning Is B...

Опубликовано:

3 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 208

@krishnaik06 Год назад

Join this channel membership to get access to materials and connect with me: ru-vid.com/show-UCNU_lfiiWBdtULKOw6X0Digjoin

@Pravin33unique95 Год назад

I sir i have got problem as how to extract data into vs code CSV student daya

@SylvanusNusetorAtiku 29 дней назад

@krish naik could youplease help with step by step how to commit to large files of the project to github?

@arias2832 Год назад

I was lost after finish an ibm course in data science. Nobody give me a job because I don´t have experience. I think that with your videos i will get it. Thanks for your excelent work, really has helped me a lot. Greetings from Colombia!

@gourabguha3167 Год назад

Thanks a lot Sir for extending the series..with ci/cd pipeline and mlops..Very much looking forward to it.

@javeedtech Год назад

After this series I regained the interest in machine learning, thanks for timely series..👍

@insaneclutchesyt948 Год назад

thank you very much you are the very few of those ppl who shows errors , it helps a lot , keep going!!

@ashishsharma214 Год назад

Thank you for this amazing playlist Krish! God bless you.

@kumaronlineplay Год назад

Excellent Video.. Thanks for sharing it.

@rajeshvenaganti6797 Год назад

I have gone through your Python & Ml Playlist and it was a great learning experience, Thanks for this End to End Ml Project playlist, and thanks for your note that you will extend this deep learning & NLP, I am eagerly waiting for your session for deep learning & NLP implementation in this playlist,

@bilelkhelifi897 5 месяцев назад

Best Playlist and channel i ve ever seen, THANK YOU SO MUCH KRISH

@tatakae6666 8 месяцев назад

This series is absolute gold

@opman5657 Год назад

very well explained and good job for learners like me. Thanks. Gob bless you

@suvarnapawar3186 Год назад

very nice explaination sir...thank u very much

@ramkisundararaman3711 4 месяца назад

Krish - You are awesome as always. I was out of the market for more than a year and now getting back to Data Science and your videos are helping me refresh my skills. Thanks

@list10001 5 месяцев назад

Thank you for the valuable tutorials.

@nanditagautam6310 Год назад

Great ! Thanks Krish

@matindram Год назад

Thank you for the series

@shahilshrestha3700 Год назад

thank you so much sir for your video. I am learning a lot of new concept in better explaination all because of you

@karanbais1843 3 месяца назад

loving the playlist sir thank you for it

@sudeepmathur9654 Год назад

Excellent video . I retired recently & just thought to keep myself engaged by learning new things , saw your video & found it very useful. Keep it up & best wishes for all the hard work you are doing in spreading knowledge. -- Sudeep Mathur

@elnazfathi 21 день назад

You are doing an amazing job presenting how to get this done in industrial environment. Thanks for your effort!

@ransinghray3688 5 месяцев назад

Krish you are really redefining the tech educational system, you are awesome!!

@sparshjain7542 Год назад

you are the why I love machine learning

@shalakam1617 Год назад

Thanks for this series

@mahdiaspanani8004 20 дней назад

I love the parts that you have an error, but you don't stop recording. and this teaches us every person might have these problems.

@royalchallengersbangalore535 9 месяцев назад

your teaching is like ❤❤

@beingbawe 13 дней назад

i enjoy ur style of teaching. Thank you for all your hard work

@mahikhan5716 Год назад

Nothing be better than . He just poured everything as data science needs . Owe to him

@jaysamirhegshetye5660 4 месяца назад

I really wanted to do a ML project where I can utilize all ML algorithms on single dataset. I find this playlist best for my project. Thank you a lot krish sir for making this informative and instructive tutorial !!!

@nirbhaysedha8541 Год назад

thanks sir it will help us a lot🙏

@sudhirmalik100 6 месяцев назад

I think there is one improvement required here which is we should split data first then do fit_transform on training data and then transform data on test set.

@Mery._.11111 Год назад

Thank you so much !

@pankajkumarbarman765 Год назад

Thank You So much sir 💗

@sanket_a2033 Год назад

Thank You Sir..

@talibdaryabi9434 Год назад

I wonder why most of those who watch it learn something well but don't press the like button. I think this is the least you can do it. So please support those who try to teach the world-class method for free.

@sharifdeenashshak4496 Год назад

looking forward for deep learning end to end series

@PRIYASINGH-kq9fc Год назад

Thank you so much sir❤

@pankajkumarbarman765 Год назад

Thank you so much sir

@shalakam1617 Год назад

Thank You for series

@aslanali9977 Год назад

Thanks!

@sibaprasadnaikbehera3442 Год назад

Thank you for problem statement sir we are eagerly waiting for that

@rohitbharti2882 Год назад

So much happy sir ❤❤❤

@apurvtewari3779 4 месяца назад

What this entire project be described as to mention in my resume as a fresher. Help will be appreciated all. :)

@AnimeAficionado28 Год назад

we thankful for your wonderful knowledge on ML and i have a wish if could make a Deep Learning project playlist from scratch it would be very grateful of you.

@mayankamble2588 2 месяца назад

Amazing Playlist. Learning alot. One point on transformation: Standard scalar should be applied separately on training and then use that scaler to transform the test data. This way there wont be any data leakage in the testing set.

@javeedtech Год назад

Thanks again

@sh__-- Год назад

Thanks 😊

@robinchriqui2407 Год назад

Thank you, Krish. It refreshed a lot of information and skills I'm looking forward to seeing the automation and deployment part of it. Will you integrate the ML Ops part in the future?

@harishs-dm8mm Год назад

Hii Krish thanks for extending the project. Please include Data and model versioning and mlops practices

@ManojKumar-ez2lb Год назад

Yes @krishnaik much needed one.

@feras6471 10 месяцев назад

Thanks

@hmtbt4122 Год назад

thanks

@rupindersingh1312 Год назад

thanks for this video 10-07-2023

@mrityunjayupadhyay7332 Год назад

great

@khirooo 9 месяцев назад

Hi Sensei, I am following your projects and every detail, and I am very thankful for your valuable content. but I think I found a code mistake at EDA part. with this new code : works well .... regards

@yashpisat9267 7 месяцев назад

Thankyou for the solution, I am facing a similar issue with "df.groupby('parental_level_of_education').agg('mean').plot(kind='barh',figsize=(10,10))" at this statement

@HimanshuBisht94 6 месяцев назад

@@yashpisat9267 Here is the solution. df.groupby('parental_level_of_education')[['math_score','reading_score','writing_score','average']].agg('mean').plot(kind='barh',figsize=(10,10))

@shivankvishwakarma2994 6 месяцев назад

Thanks man!!

@user-dc5ow6ip3j 6 месяцев назад

how u solved that error please tell emmediately @@shivankvishwakarma2994

@laxmanteja Год назад

I'm very interested Krish about your teaching techniques and in this end-to-end project, can I expect automation of the project with code

@utkarshapadhye7656 9 месяцев назад

I am getting packages not found in vcode , though I followed all the steps from start and also in my global env all packages are installed.

@ravulapallivenkatagurnadha9605 Год назад

Neeed more videos like this

@asieharati Год назад

You should't do the preprocessing on X. You should fit to X_train and fit_transform on X_test

@manar4944 Месяц назад

That's super great work, it really helped me. But i'm surprised that you've done columns transformation "Standard Scaler" before splitting the train/test sets, most articles said it will result in data leakage, can you please elaborate

@Pravin33unique95 Год назад

How you create notebook folder and in that EDA and model training I don't understand

@ncheymbamalu4013 Год назад

Adjusted R² instead of R² for the evaluation metric.

@video89652 Год назад

Hello Krish, is there any projects that solved Direction of Arrival Problem in Audio Signal Processing. Can you do a tutorial on it

@sabinadhikari2643 Год назад

For the sns.countplot() function we have to pass the value for x. i.e sns.countplot(x=data) will work. otherwise sns.coutplot(data) will give an error.

@leelavathir9151 Год назад

Thank you @sabin Adhikari

@sabinadhikari2643 Год назад

@@shwetakumari__2085 What is the error?

@AkilaDS-kz6yv Год назад

How can we export data and eda codings could you please explain that part?

@abhijeetrokade2349 Год назад

Which kinds of project need to choose when we preparing for interview?

@gauravmishra7591 Год назад

Please make a Pyspark end to end project like a real world

@user-zu9kc3lx1t 10 месяцев назад

Hi, How are we importing the data of the csv file into VS ?

@aravinda1595 3 месяца назад

Sir amazing video btw Boys have performed really well in MATHSSS

@RaghavTigadi-de3xv 2 месяца назад

where's the code video about this session?

@shruthakeerthipurushothkum2724 2 месяца назад

hi @krishnaik06 , can you kindly show how did you work with jupyter in vscode , i mean did you do the eda in jupyter notebook and then converted to vscode ..

@nikhildoye9671 7 месяцев назад

Shouldn't we split the data first and then apply transformation? Won't this lead to data leakage?

@surajpandey-er4nt Год назад

Hi Krish, just a small doubt I am facing an issue with installing everything through requirements.txt instead I had to install everything separately. what could be the issue here?

@sagarthacker5114 Год назад

Hello Krish, I was hoping to ask for your opinion on a particular aspect of data preprocessing. Shouldn't we perform data splitting first to prevent data leakage, as standard scaling considers the mean and variance of the entire dataset? This may include the test set, leading to potential data leakage. Would you kindly share your thoughts on this topic? Thank you very much.

@krishnaik06 Год назад

Yes i will take care of it while writing in a modular way...

@yashsoni1153 Год назад

Sir I am not able to open jupyter notebook in vs code I thing there is error in file Pls help me to resolve this...

@swL1941 Год назад

@Krish Naik Hello Sir, why didn't you use Cross Validation instead of Train-Test-Split ?

@subrataassam Год назад

Could have used CV or might be any other data splitting techniques but I guess the main aim of this tutorial was to build a framework for an ML project. Can improvise later as per new ideas or in-depth explorations.

@shahirajlakade7921 Год назад

sir any upcoming data analyst batch missed 50% off offer😔

@swL1941 Год назад

If Boosting and Bagging methods are very powerful then why a simple Ridge Reg has more R2 score ??

@kumarsrajesh9078 Год назад

Please make a end to end project of pyspark

@maximilianlossl226 10 месяцев назад

Sorry, but I really don't understand how to get the data and jupyter files into my Visual Studio Code, can you help me?

@Pravin33unique95 Год назад

I have doubt while running code I face syntax error in exception handling

@abubakarsaddiq4098 2 месяца назад

stuning

@RaghavTigadi-de3xv 2 месяца назад

where's the code video about this session?

@brightlyricsmusic 10 месяцев назад

i am getting error while reading dataset using relative path can someone help

@r.ranjankumar2106 Год назад

Im facing Module not found error even after creating the enviornment. Any help me how to fix this

@ridj41 11 месяцев назад

I have become mad after again and again setting up the environment,since even after installing all of the libraries but running the code it says that library is not there.

@ShivamPatel-yg3kd Год назад

Hi Sir, I have a doubt, as you have created "total marks" and "average marks" as two separate independent features, and you are doing EDA for both the features, suggested to create 2 separate models for each of them as well. But my doubt is why do we need to do the same things for both of them separately as average marks is directly correlated with total marks(total marks/3). Am I missing something? Please clarify. Love your videos 😊

@uditthakkar8130 Год назад

Hey Shivam, It kind of depends on the problem that we are trying to solve. Suppose, what we are doing here is all self learning but there must be a target decided by the stakeholders/clients. If you are trying to predict a student's eligibility for a scholarship, the total marks might be more important than the average marks since scholarships may be based on total marks. If the model indicates that the total marks are a strong predictor of a student's performance, it may be harder to understand how much the average marks contributed to that prediction if they are not considered separately. Also, elimination of noise and variability in the data is a factor here!

@user-nx6ib3tv7b 10 месяцев назад

Hey Krish i have all my libraries such as numpy but when i try to run it through the ipy kernal it shows numpy not found

@prianshmadan 10 месяцев назад

Bro, were you able to resolve this?

@riachoudhari7297 9 месяцев назад

@@prianshmadan Kindly let me know the solution for the same please

@shitikanthabagh9859 3 месяца назад

Install the ipykernel again, it would may be upgrade to the latest python package available not 3.8 used in this video conda install -p environment path ipykernel --update-deps --force-reinstall and then in the interpreter selecte the correct jupyter kernel, it should work

@Svilco Год назад

What is the correct sci-kit learn version for 3.8

@user-mn1kz9gx4f 7 месяцев назад

how I can add notebook folder..? you did'nt tell about notebook and csv.

@AmbarGharat 3 месяца назад

add it from vs code

@krislai7453 10 месяцев назад

why is that when i tried to import library it says "no module named 'numpy'

@mayankporwal4858 Год назад

Here we did not discuss about catboost_info file that is present, why is there and what is it's use?? please explain Krish sir.

@AmbarGharat 3 месяца назад

It will automatically come once you install catboost and IDK why.

@dhaneshkajrolkar6925 Год назад

🔥🔥🔥🔥🔥🔥

@nishantverma2966 Год назад

How we can export the EDA, model training and data file to Visual Studio

@Pravin33unique95 Год назад

Yes I have same question

@aishwaryaumare4985 3 месяца назад

How did u enter that csv dataset

@amazingplaytv2661 Год назад

where do I get the data files. I mean the contents of the notebook folder?? I am coding along the series

@santhoshkoppisetti5034 7 месяцев назад

bro do u know how to get contents of notebook,please sayy????

@Laizin Год назад

anyone getting an error related to installing catboost?? or is it just me?

@lionsinescanor405 Год назад

same here. Did u find the solution?

@mhapich Год назад

Me too - Failed to build catboost ERROR: Could not build wheels for catboost, which is required to install pyproject.toml-based projects

@Pravin33unique95 Год назад

How to import stud.CSV file i don't get it please help me

@harendrakumar7647 Год назад

Create any ai as an api project

@rahulsharma5693 Год назад

Hi Krish, when I try to do from src.logger import logging, it gives error no module named src, but if i do from logger import logging then it works? any idea???

@karishmamehar4081 Год назад

bcz both .py files are present in same module so we can directly import it, if exception is present outside of src then src.logger will work

@rahulsharma5693 Год назад

@@karishmamehar4081 yep i was able to understand that but why did it work for krish in the video and me getting error

@avbendre Год назад

@@rahulsharma5693 yes same doubt i think it has something to do with magic

@umerfarooq-ck3qn 10 месяцев назад

Hello Sir , thank you so much for this playlist. Here getting an error : ValueError: A given column is not a column of the dataframe while executing 'X = preprocessor.fit_transform(X)' , even i have done with X = df.drop('reading_score',axis=1) . Please help