Тёмный
No video :(

Sentiment Analysis with BERT Neural Network and Python 

Nicholas Renotte
Подписаться 276 тыс.
Просмотров 121 тыс.
50% 1

Опубликовано:

 

29 авг 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 207   
@sahilsmohanty2663
@sahilsmohanty2663 3 года назад
These kind of content is what most budding ML enthusiasts need. Thanks for this
@NicholasRenotte
@NicholasRenotte 3 года назад
Anytime, so glad you enjoyed it @Sahil!
@madhu1987ful
@madhu1987ful 2 года назад
@@NicholasRenotte Hey, pls do a detailed video on Beautiful Soup. Also my request is pls make a video on other NLP usecases - text summarization, topic modeling, NER, text generation, Q&A with pretrained models (BERT, ROBERTA, GPT and so on)
@abrh2793
@abrh2793 2 года назад
I love how you take your time to explain each sentences and what they do! Absolutely love it! Very helpful as a beginner! Keep up
@superrelaxation508
@superrelaxation508 3 года назад
brother I wanna say that your videos are very easy to understand and along the way to follow practically in our computer please make complete course on NLP and OPENCV And Machine learning because you are very good teacher I very like you god give you long life with a lot of happiness
@sebastianzapata9368
@sebastianzapata9368 2 года назад
amazing video! I mixed the content from your code with a csv file that I got from extracting tweets and now I can do a sentiment analysis on so many subjects! Thank you!!
@JcOnAFieldtrip
@JcOnAFieldtrip Год назад
hi im trying that as well, did you convert your file to a data frame like in the video?
@Michael-dl4sj
@Michael-dl4sj 3 года назад
Awesome video! If its to the extend of your knowledge, a subsequent video about fine-tuning a pre-trained model to a particular dataset would be very interesting. So train, test and validate the accuracy of a model pre- and post-training. I have read some articles which showed accuracy of a model can be improved significantly when trained on the particular dataset.
@NicholasRenotte
@NicholasRenotte 3 года назад
Definitely, plus the models become a lot more practical when tuned to your use case. Definitely will have a series of tutorials or one mega tutorial coming on it soon @Michael!
@khouloudsafi1445
@khouloudsafi1445 2 года назад
@@NicholasRenotte did you make a tutorial about this issue already ? I couldn't like your video more,, it's simple, informative, short and just straight to the point :) Thank you
@thaGkillah
@thaGkillah 3 года назад
Hey Nik! I've been looking left and right for a guide on how to interpret the logits from BERT and thank god you've uploaded something that explains it well! I liked and subscribed. (Maybe you could refer me to a source, where you happen to learn it? - looking one for the FinBert variant) Also, your crash course on that scraping part is straight on point and I love that you executed each line from it to show you how it gets transformed. You are truly blessed with an out-of-this-world tutoring skill!
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks sooo much @Capt_Kaplan! I'm kinda just doing a lot of googling to learn it atm, there's heaps of examples of custom models in the HF model repo though, check this out: huggingface.co/ProsusAI/finbert
@joe8ones
@joe8ones 3 года назад
Yes, i think a bigger web scraping tutorial would be beneficial
@sebasgutierrezjuansgutierr3666
Did he make a tutorial about it?
@rolsondeleferme6825
@rolsondeleferme6825 3 года назад
Very good pal. You keep it simple and at high level. I would be happy to see those two negative votes to elaborate further why they are not satisfied though..
@Aynold
@Aynold 3 года назад
Hello Nicholas Reynolds, I am a college student, I like your video very much, I keep learning, you are my half teacher, thank you very much, look forward to more videos
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks so much! Stick around, plenty more mega courses to come!!
@satoshinakamoto5710
@satoshinakamoto5710 2 года назад
Thanks again for this tutorial Nick. My challenge is to 100% finish all your tutorials. 3hrs, 5hrs, 8hrs, 100hrs. all of it.
@hemalshah1410
@hemalshah1410 2 года назад
BERT with multilingual benefit is great advantage for analysis of text (especially with large-diverse dataset ) . This is enlightening ! Thank you Nik
@bhavikdudhrejiya852
@bhavikdudhrejiya852 2 года назад
Your channel is a treasure for Data Scientist.
@raznyrazeek
@raznyrazeek 9 месяцев назад
You are a life saver man. i was stusked with my research. you saved me.. i understood the basics. Thanks
@pauliusjanuska4090
@pauliusjanuska4090 2 года назад
Amazing video! Simple, structured, keep up the good work !!! P.S This helped me so much on my course lol
@arjumann5480
@arjumann5480 3 года назад
You made it sound so simple! This is apt for beginners like me. Thank you ^^
@metinunlu_
@metinunlu_ Год назад
Incredible work, love your explanations. Thank you!
@christophercrager1925
@christophercrager1925 2 года назад
Great video. Would love to see a scraping tutorial. Especially one where you could pass credentials and log in first
@JohnM-ch4to
@JohnM-ch4to 3 года назад
Great vid! Not one of the more popular requests here but would be interested on a deep dive in building scrapers. It's kind of a niche topic since it's not the most exciting part of ML or Data Science but at least I get to throw my hat into the table. Haha. Looking forward to more vids =)
@NicholasRenotte
@NicholasRenotte 3 года назад
You got it @John, was planning on doing a live stream on it! But might put it into my Python for Data Science course that's coming!
@seherkanwal245
@seherkanwal245 Год назад
I love the way you teach. I'm going to do my final year project on sentimental recommendation system. This will help me a lot
@stefan6825
@stefan6825 3 года назад
Love this video! You have an amazing skill in teaching others and make it look so simple. I'm subscribing you and I guess on my journey learning python I will watch a lot of your videos. Thanks a lot!
@francescue8128
@francescue8128 2 года назад
Awesome video. Simple and easy to follow. Thank you.
@madhu1987ful
@madhu1987ful 2 года назад
Awesome video, so neatly explained step by step --- thanks a lot
@sagara5982
@sagara5982 3 года назад
I'm a new subscriber.., loving ur videos already... Cheers man all the best
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks so much @First Attempt, welcome to the fam!
@luizkrein
@luizkrein 2 года назад
Awesome video, now I need to find a Brazilian Portuguese trained model asap to test it. Thanks!
@daniel_partida
@daniel_partida 2 года назад
Excellent video explaining multiple concepts. Thank you for the great content!
@liamalam
@liamalam 3 года назад
An excellent tutorial. Thank you much for this.
@GauravKumar-xg4sw
@GauravKumar-xg4sw 2 года назад
This is best content on bert .. loved the explanation ..
@Daniel-dv6kw
@Daniel-dv6kw 2 месяца назад
Awesome stuff man, helping me on my project
@dheerajchoudhury
@dheerajchoudhury 3 года назад
Love your videos bro 😉 Feel like lot to learn
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks a bunch @Dheeraj! Definitely always something new!
@shabirahmed6510
@shabirahmed6510 Год назад
Great video! simple and quick to get good results thanks a lot!
@santiagobardelli5675
@santiagobardelli5675 8 месяцев назад
Great job, Nicholas!
@dec13666
@dec13666 3 года назад
Nice vid. It's an application of BERT, does not quite add much new science... But good enough for some hands on with it. Keep it up 👍
@NicholasRenotte
@NicholasRenotte 3 года назад
Yah, kept this one super high level. Can definitely get way further down into the weeds!
@muzammelmokhtar6498
@muzammelmokhtar6498 3 года назад
Very good explanation and content
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks so much @Muzammel! So glad you enjoyed it.
@bertranddol
@bertranddol 2 года назад
Great content, great delivery .... overall great video
@PriteshRPatel-lr5uh
@PriteshRPatel-lr5uh 5 месяцев назад
really loved your video. Would like to see if you can do same video but for stocks such as NVDA or TSLA. Thanks.👍
@krishnamore2281
@krishnamore2281 3 года назад
Thank you for making a video on this
@NicholasRenotte
@NicholasRenotte 3 года назад
Anytime! So glad you liked it!
@69nukeee
@69nukeee 6 месяцев назад
Sweet video, loved it!
@heisenbergwhite5845
@heisenbergwhite5845 3 года назад
Would love a video on fake news detection. Thanks for teaching us!
@NicholasRenotte
@NicholasRenotte 3 года назад
Ooooh, yeah that'd be sick, I'll add it to the list!
@heisenbergwhite5845
@heisenbergwhite5845 3 года назад
@@NicholasRenotte Thank you Have a nice day
@NicholasRenotte
@NicholasRenotte 3 года назад
@@heisenbergwhite5845 you too!
@kian69topgun1
@kian69topgun1 2 года назад
Good conceptual video. I was your 1k'th like
@rizf800
@rizf800 Год назад
exactly what i was looking for thank you you made my day🥰🥰🥰
@ameerazam3269
@ameerazam3269 3 года назад
Appreciate your work sir
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks for checking it out man!!
@subratasaha8820
@subratasaha8820 2 года назад
awesome explanation. however i have some questions, is text preprocessing included in the BERT model? and what is the thing with 'x[:512]' limitation?
@nimishbansal4752
@nimishbansal4752 3 года назад
Great work bro..pls make a video on activity recognition using mediapipe
@NicholasRenotte
@NicholasRenotte 3 года назад
You got it!
@rainymornings
@rainymornings Год назад
Hmm this is helpful for reviews but not for pos/neu/neg sentiment analysis, which is what I was actually trying to get some examples of regarding score interpretation.
@peterkhoo9606
@peterkhoo9606 3 года назад
Fantastic explanation on all videos. just wondering whether you can do a video on sktime - installation, introduction, processes , etc. Hope to hear from you. cheerio
@NicholasRenotte
@NicholasRenotte 3 года назад
Haven't heard of it before, is that a timeseries lib for scikitlearn? Sounds awesome if so!
@morningstar618z8
@morningstar618z8 2 года назад
Great tutorial thanks
@JC-xl5ti
@JC-xl5ti Год назад
Awesome video! But, I was wondering if text preprocessing (removing punctuations, stopwords, lemmatization, etc) is needed before encoding the reviews? Appreciated if can get an answer
@faizanyounas4799
@faizanyounas4799 Год назад
Yes, in the preprocessing we remove all the noise from the data.
@ameerazam3269
@ameerazam3269 3 года назад
Again best explanation
@NicholasRenotte
@NicholasRenotte 3 года назад
Ayyye, thanks so much @Ameer!
@celynraquel5982
@celynraquel5982 3 года назад
Amazing video!
@molmock
@molmock Год назад
Thank you so much !
@lowwwleechi
@lowwwleechi 3 года назад
Hi Nicholas, thank you for the video! It's really helpful for my work. Also, I have a question that is it a must to do text pre-processing by applying NLP model using deep learning? because it seems like you didn't apply any text preprocessing method for the raw text you've scraped.
@NicholasRenotte
@NicholasRenotte 3 года назад
For these models they're able to handle raw unprocessed input as they have a pre-processing pipeline built in @lowwwleechi. If i got sucky results I might add some additional pre-proc to improve the results!
@lowwwleechi
@lowwwleechi 3 года назад
@@NicholasRenotte Got it! Thanks a lot!
@sitiauniamaram3422
@sitiauniamaram3422 2 года назад
How to validate the output of the sentiment?
@Michael-dl4sj
@Michael-dl4sj 3 года назад
Hey Nicholas, is there any way of changing the bert sentiment score from 1-5 to a floating value between 0-1, similar to for example the vader sentiment score? Or do I need another bert sentiment model for this? Thanks in advance :)
@NicholasRenotte
@NicholasRenotte 3 года назад
Need another BERT model @Michael, this one is specifically trained to give you a binary value.
@AmirRoyaee
@AmirRoyaee 16 дней назад
Tnx for your useful video
@RedCloudServices
@RedCloudServices Год назад
Love mito but had them on a zoom call - it does not work with streamlit app. Perhaps it does not work with any app outside of a Jupyter notebook not sure 🤷‍♂️
@merakshitrading9216
@merakshitrading9216 11 месяцев назад
scraping a web page and using that data as training data within a chat bot would be very interesting.
@ritajohn5102
@ritajohn5102 2 месяца назад
can you explain the advantage and disadvantage of using pre-trained model in our data?
@nandakadibrayogasta3719
@nandakadibrayogasta3719 2 года назад
the video is good, very petrified for ordinary people like me. but how to test the accuracy of the bert that is used?
@naresh22081989
@naresh22081989 2 года назад
Hi Nichola, thank you for this video. Good information 👍 I have a doubt, can it handle sarcastic reviews? Also don't we remove shop words from text data?
@NicholasRenotte
@NicholasRenotte 2 года назад
Ooooh, I doubt it tbh. You can definitely do stop word removal, I was just being a little lazy in this.
@rolandohernandez6627
@rolandohernandez6627 2 года назад
Muy util. muchas gracias por la informacion. Saludos desde Mexico
@diveshbhagooli6631
@diveshbhagooli6631 3 года назад
You’re the best around!! Thank you for this!! One question: is it possible to extract comments from a Facebook post? Thank you.
@NicholasRenotte
@NicholasRenotte 3 года назад
I think it's pretty tricky, FB is notoriously hard to scrape. Can probably get your own comments via the API?
@nandankakadiya1494
@nandankakadiya1494 3 года назад
Another great tutorial thanks man Have one question in this video we are able to extract reviews from page 1 only so how to extract reviews from all the pages? Thanks once agian
@NicholasRenotte
@NicholasRenotte 3 года назад
Could loop through the subsequent pages as well @Nandan! Would need to build a more sophisticated scraper for that however.
@ey5722
@ey5722 3 года назад
Thank you so much. Your video is so helpful. Is it possible to make another one about how to do sentiment analysis with BERTweet for covid -19 tweets? Thanks again.
@NicholasRenotte
@NicholasRenotte 3 года назад
You got it! Working on a bunch of NLP stuff atm.
@ey5722
@ey5722 3 года назад
@@NicholasRenotte Did you make a video about BERTWEET? I didn't find it.
@NicholasRenotte
@NicholasRenotte 3 года назад
@@ey5722 nope, not yet.
@subhanbasha8813
@subhanbasha8813 3 года назад
Hello Nicholas, Is it recommend to code all the machine learning algorithms from scratch so that I can learn math behind it or just understand and start to code?
@NicholasRenotte
@NicholasRenotte 3 года назад
I don't personally think so, I think it's more important to know how to use them as a Data Scientist. If you're looking to get into research however you would probably need a deeper understanding however!
@fahnub
@fahnub Год назад
Cool and informative.
@sebasgutierrezjuansgutierr3666
Awesome as always!! I really appreciated this. Did you finally made a web scraping for data science super tutorial!??. Please tell me you did!😃
@owaisahmad8336
@owaisahmad8336 Год назад
Amazing!
@owenhochwald506
@owenhochwald506 Год назад
instead of using a lambda function for adding the review scores to the dataframe, would it be equally as good to use list comprehension to get a list of the scores then creating a new column out of that in the dataframe?
@ghpkishore
@ghpkishore 3 года назад
Can you make one on mT5 or m2m100 for language translation models and how they can be trained from huggingface. Would be super helpful for techies across countries where content is limited.
@NicholasRenotte
@NicholasRenotte 3 года назад
You got it! Got a ton more HF stuff coming as well.
@ajithnaidu6978
@ajithnaidu6978 Год назад
Hi Nicholas , can you explain me how can I scrape rating of particular user from the webpage you mentioned
@yeast1103
@yeast1103 Год назад
Thank you
@henkhbit5748
@henkhbit5748 3 года назад
Multi-langual and Dutch too... A double Heineken for u🍻 Maybe another vid of text classification for different classes/categories based on Bert ( Bert-base, multilangual cased) Not specific sentiment but categorizing sentences/text into subjects like cars, beers,soccer...
@NicholasRenotte
@NicholasRenotte 3 года назад
You got it, actually started work on a mega NLP tutorial. Zero-Shot Classification would be perfect for that!! Can't wait to drink that Heineken this weekend, still hoping Hamilton beats Verstappen though 😂.
@henkhbit5748
@henkhbit5748 3 года назад
@@NicholasRenotte Looking forward👍 Until this new season the F1 races were dominated by Mercedes. It is like running tensorflow with gpu versus tpu 😁 If Verstappen or other talented drivers got the same racing car as Hamilton then the competition would be more interesting .... But of course I hope Verstappen will win!
@NicholasRenotte
@NicholasRenotte 3 года назад
@@henkhbit5748 you almost had your wish this weekend 😂 if those tyres didn't blow Verstappen was on a dream run!
@henkhbit5748
@henkhbit5748 3 года назад
@@NicholasRenotte Yes the anomaly detetection algroritjm of Red Bull could be improved and I think Hamilton has not trained with the rigt AI Gym RL algorithm 😎
@NicholasRenotte
@NicholasRenotte 3 года назад
@@henkhbit5748 😂 😂 😂
@monicaaraneda7462
@monicaaraneda7462 Год назад
I have a problem: RuntimeError: Failed to import transformers.models.bert.modeling_bert because of the following error (look up to see its traceback): No module named 'torch.utils'
@melly-by8tm
@melly-by8tm 10 месяцев назад
May I know if this support a multi-language in one sentences or in one review?
@kashishrajput4934
@kashishrajput4934 Год назад
Great Thank you.
@ariebenzadon6435
@ariebenzadon6435 Год назад
Is there a bert multingual up to date? This program you are using, uses old versions of numpy... between others. If there is an up to date version, it would be amazing to know, where to find it, thanks!
@ariebenzadon6435
@ariebenzadon6435 Год назад
if not, could you especify the version of nunmpy that was used
@DeliHunV
@DeliHunV 5 месяцев назад
Hey Nicholas Great Video!!! I was wondering if I could change the url in the code and give the class name of another website's comments other than YELP will it still work...
@mysticallybeautiful2368
@mysticallybeautiful2368 9 месяцев назад
I am stuck as i want to add an input which will be predicted. So basically i want to add an input ( a user would write a line for which the sentiment should be predicted) but i am unable to write the code for it. Can anyone please help me.
@harryfeng4199
@harryfeng4199 2 года назад
What’s the logic behind setting the slice up util 512 when we were making our predictions?
@ghost_assassinz1877
@ghost_assassinz1877 Год назад
How would I fine tune this because right now im getting some inaccurate reviews. For some some reviews it is giving me 3 when it should be 4 stars or it is giving 5
@ravikshdikola6089
@ravikshdikola6089 3 года назад
Can we add fully connected layer on top of that model to use it for other text preprocessing tasks 🤔
@NicholasRenotte
@NicholasRenotte 3 года назад
Could probably pass through the logits to a subsequent layer!
@chrisfig2387
@chrisfig2387 3 года назад
Hello Nicholas!, i got a question is there any ML that can extract keywords from a text?
@NicholasRenotte
@NicholasRenotte 3 года назад
Could use Named Entity Recognition to extract keyword types. If you're just looking for specific keywords you could just use a find function!
@chrisfig2387
@chrisfig2387 3 года назад
@@NicholasRenotte Thank you, love your work!
@chiranshuadik9818
@chiranshuadik9818 3 года назад
bert is too big (1GB for the one with good quality). What would be the best way to deploy it with my django back end? Any recommendations?
@NicholasRenotte
@NicholasRenotte 3 года назад
Deploy it as an API or use a pre-hosted instance (they're available direct through HF Hosted)
@pahadiasd5992
@pahadiasd5992 2 года назад
@Nicholas Renotte can u help me or tell me how to apply word embeddings in BERT for text classification
@wsr005
@wsr005 2 года назад
Hi, I'm just learning NLP and it's totally new to me. Just want to know how to know how tokens / text can be passed for particular nlp pipeline? Thanks in advance
@RS-vu5um
@RS-vu5um 2 года назад
Excellent Video. Can you point me to the changes to be made if TensorFlow is used?
@atharvagangil4860
@atharvagangil4860 Год назад
Hey! When I change the website to another one (like Amazon), it doesn't go with it. Please help me with it
@datawaly
@datawaly 2 года назад
i like so much your cours
@yussefleon4904
@yussefleon4904 Год назад
Hello, instead of doing the first 512 tokens, aren't you just taking the first 512 characters? Lov your videos btw :)
@interlightstudio1645
@interlightstudio1645 2 года назад
Do you currently have a video that covers how to do this? ->> "Can't be bothered building a model from scratch?". i would like to learn how to build or fine tune BERT. thanks
@sruthikreddy003
@sruthikreddy003 Год назад
df["sentiment"] = df["review"].apply() here in this function its giving me error related to tensor size pls help me
@ashaoluayanfe7474
@ashaoluayanfe7474 2 года назад
Hello Nicholas, many thanks for the vidoe, how can one implement this code in tensorflow or what advantage pytorch has over tensorflow in Bert implementation?
@asrikinantifebriany6228
@asrikinantifebriany6228 Год назад
hey what a great videos, can you make a tutorial for sentiment analysis deployment to a simple web?
@akshatkhanna2517
@akshatkhanna2517 2 года назад
Please make a video tutorial on Web scraping as well.
@leonvanpersi8044
@leonvanpersi8044 Год назад
Thank you for the video. Can I run a content analysis on short Customer Feedbacks that's releable?
@jegadeeswarisridharan341
@jegadeeswarisridharan341 2 года назад
how to calculat performance in unsupervised learning?
@shanthiathisayaraj7833
@shanthiathisayaraj7833 3 года назад
Awsome buddy
@NicholasRenotte
@NicholasRenotte 3 года назад
Thanks a bunch @Shanthi!
@squadgang1678
@squadgang1678 Год назад
Can you do sentiment analysis using apache spark - pyspark mllib
@msvirat143
@msvirat143 3 года назад
Nice video.. easy to understand many new term.... but I cant understand line 4, why we use this particular URL? And use them with data...how that useful?... Please reply
@NicholasRenotte
@NicholasRenotte 3 года назад
Which line? The installation line?
@msvirat143
@msvirat143 3 года назад
@@NicholasRenotte No, Instantiate model lines!!!
@NicholasRenotte
@NicholasRenotte 3 года назад
@@msvirat143 oh those aren't URLs that's the reference to the model we want to load from the Hugging Face repository.
@mohamedanas8493
@mohamedanas8493 22 дня назад
can you tell me how to save this model and use it
Далее
BERT Neural Network - EXPLAINED!
11:37
Просмотров 391 тыс.
What is Sentiment Analysis?
10:05
Просмотров 17 тыс.
What is BERT and how does it work? | A Quick Review
8:56
ML Was Hard Until I Learned These 5 Secrets!
13:11
Просмотров 282 тыс.