You literally saved my thesis with this! Thank you so so much, I could understand everything you did even with just some basic knowledge in python :) Thank you so much for this vid and your help! 🙏
hi! whats thesis topic. well i have only a month left for the master deadline but i have not started due to mental health issues. i am thinking of doing sentiment analysis on twitter data.
Thanks to you I just cobbled together a twitter scraper that downloads all images that a user tweeted, with next to no Python experience, in more-or-less one afternoon. It's scary how little it takes to make a scraper. Thanks for the video! Edit: I just noticed that some tweets are missing. Actually, if you go to someone's home page and compare that to the advanced search results, you'll see that twitter's own search is missing some posts. Since snscrape uses that search, it's results will be just as incomprehensive as twitter's own search. (note: this isn't a disaster scenario, the vast majority of tweets are found)
Hey, this is amazing! I've been wasting a lot of time trying tutorials that were outdated or didn't work anymore. This works and is a solid foundation for a proper Twitter analysis. Thanks!
This is massive! Just saw this recently. I just scrapped off 5000 tweets. Please could you do more videos around web scraping and sentiment analysis 🙏 you're the best! 🙌🏿
Hello, probably a stupid question, but where can I find all tweets after I generate them? How can I view them in something like an excel file? Thank you
Thanks for watching! Check out this video for tweet sentiment analysis ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-uPKnSq6TaAk.html P.S.: If you saw the error that "Tweet object hand attribute 'user'", try changing tweet.user.username to tweet.username
@@aispectrum one more thing😁, could you please go a little bit deep when explaining stuffs in your videos. Helps beginners like me. Thanks. You the best👌🏽
Man, thank you so much! I was having dificult to do this and you made this so simple, thank you again! You're the best, just continue doin web scraping and sentiment analysis videos!
This is a life-changing video! I am waiting for my application for a Twitter developer account to be passed, and I found this video. Now I can start doing my project! Thank you sooooooo much! 💯
Hello, probably a stupid question, but where can I find all tweets after I generate them? How can I view them in something like an excel file? Thank you
Congratulations on the video. I think many were in need of this video. I usually used the twint library, but I was having some problems. Thanks for sharing.
OMG, you have no idea how helpful this is, saved me days of being limited by the API. Thank thank you very much. Just got 80,000 tweets for a project I will work on later.
it throws an error, stack overflow is kind of confusing on this issue raise ScraperException(msg) snscrape.base.ScraperException: 4 requests to api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&send_error_codes=true&simple_quoted_tweets=true&q=python&tweet_search_mode=live&count=100&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel failed, giving up.
Amazing content - Thank you so much! One question: Is it also possible to collect all replies to a certain tweet using e.g the tweet ID? Because I need not only the tweets with certain key words, but also the replies to the respective tweets. Would be much appreciated!
thank you, you just saved my time. As you know the current api twitter need academic research role to get all tweets, but its not gonna work for undergraduate study hmm
thank you sir, your video really helped me in learning as a school kid, it seems your explanation is clearer than my teacher, don't forget to upload videos often
Dear Mehran, I really found this tool very helpful. I am grateful to you. Just wondering if for the tweets that contain a query term, - is there a way to get all the replies to those tweets, and - if the tweet is a reply to a tweet, get the original post. Thank you so much.
Great video. I'm having hard time running this code, and am wondering if it's because Twitter's new policies with their API. It looks like my code attempts to make requests to Twitter four times before giving up. Thank you!
Same here...Errors: blocked (404), blocked (404), blocked (404), blocked (404). Something about the Guest User o something like that... it's broken right now
Great video, I was struggling with the Twitter API limit. Just one question, I want to perform sentiment analysis on a topic and to study the evolution of the sentiment over time. When I scrape the tweets I get only the one that are near the upper bound of the specified period. A solution will be to execute many queries specifying a narrow period. But, is there an automated way in snscrape to retrieve equally spread tweets?
This doesn't work anymore as I have tried doing it. Nevertheless, request you to post a video so that we can easily use Twitter data for Sentiment Analysis.
Hi sir, I followed your all tutorial and love it. I searched whole RU-vid but I didn't found any single tutorial on multiple twitter accounts sign up automation. Can you please create one?
Awesome video! Thank you! Do you have a suggestion, how I can get the comments under one tweet? And do you know a solution to get all tweets, because I just get a quarter of all tweets...That would be super helpful!
Great video, thank you for your time ! I still have a question: I scrapped few hundreds tweets from a user and when I double checked manually I realized that some tweets were missing (not talking about retweets). I reran the line of codes several times and everytime it is the same tweets missing. Is there a reason why some tweets could be missing + is there a way to avoid that? Thanks a lot !!!
This library searches for the query and scrape the results to get the tweets. I think the issue is that twitter doesn't return all the tweets of the specified users in search results. Maybe you could try the TwitterUserScraper method to see if it solves the issue.
Hey! When i run the script, I get a non-200 status code in return where I cannot retrieve data from the twitter api. A link related to the twitter api is presented to me, where i find a error message code "2015" for bad authentication. Do you or anyone have some experience with this, and how to work around it? Thank you :)
This is such a powerful tool, but with changes on the platform, this code no longer works for me. Are you planning on making a new video that does the same thing with another tool?
Hi I was wondering if you know whether the selection of tweets is random or not. (I specified my query on a specific date range, for 5000 tweets for example. How are these 5000 tweets chosen?)
Is scraping millions of tweets still possible because i would like to build an AI model using the text data. Please if it's possible how can I go about it?
hi. thanks for this video. I'm getting a ScraperException error, long texts of jargons and the message that says "failed, giving up. Errors: blocked (404), blocked (404), blocked (404), blocked (404)" how do I get around this please?
