Thank you guys for your support 🙂. I made new videos about getting tweets from users or tweets by keywords/hashtags, and streaming tweets in real-time. Links of the videos are in the description.
Hi! You write code that is elegant and systematic. In your 2 videos, the file with keys and token do not use the bearer token which I think is creating problems for me. I am having trouble getting tweets older than 7 days via academic access-authenticating my account and then searching a sizable number of tweets using hashtag and a specific date. It will be very helpful for researchers to have another video on this topic!
can you kindly help me if we want to download tweets for a specific subject? i tried making changes to the public_tweets = api.home_timeline() line but was not successful after some experiments.
It would be great if we see real-time tweets of any particular account. There is not much information on that as of now. Would be helpful for us. Thanks. Appreciate your effort. God bless you!
Hi !! I have this exception: "453 - You currently have Essential access which includes access to Twitter API v2 endpoints only. If you need access to this endpoint, you’ll need to apply for Elevated access via the Developer Portal." But in the Developer Portal i have all proyects in Elevated Access 🙁
you can also use pandas json_normalize() function, which transforms a json dic into a nice pandas DataFrame. tweets = pd.json_normalize(response["data"]) tweets With tweepy you would need to change the return_type to requests.Response. client = tweepy.Client( bearer_token=BEARER_TOKEN, return_type = requests.Response # Needed to use json methods, which makes life much easier )
Thanks so much for this it was extremely helpful. Also going to watch your video relating to searching using keywords. However, can you recommend how to get tweet images that users had posted?
Hi, friend. Thanks for the video! I need to store hundreds of tweets safely; and use them later (in original format) in my thesis, throug an easy way. Does Tweepy do that, or just returns text and metadata? Is there some sort of "recoversion" to original format?
I don't think you can use the API for this. API only returns the data in json format. If you want to do save them in original format like twitter website, you may have to write a script with HTML + CSS + JS to get what you want.
hello AI spectrum.. its a great tutorial.. easy to understand thank you, and really appreciated. does it work in essential access or we have to upgrade to elevated access ?
Well I don't think you can run this code with essential access. Essential access only allows you to connect to API v2 (this is equivalent to using tweepy.Client class). But I use API v1.1 here (since I use tweepy.API class).
Many thanks for your video. It's extremely useful. I am a PhD student, and I am trying to extract tweets according to keywords. I'll target your video. Thank you very much!!!
@@aispectrum Thank you for your kindly reply. I've got an academic research API. I just tried to follow your code step by step, but I am stuck at video 11:30. I got the return "453 - You currently have Essential access which includes access to Twitter API v2 endpoints only. If you need access to this endpoint, you’ll need to apply for Elevated access via the Developer Portal". I am struggling with it. I am not very familiar with coding and Twitter API, but my research requires this. So I am trying my best to do it. If possible, could you please give me a clue? Thank you very much. God bless you.
Thank you my lovely, this was really helpful. I was wondering if there was a way to change the date/time format? At the moment, it comes out as something like [2022-04-29 14:58:39+00:00] - which cannot be recognised as a date in excel.
According to the official API document, you can get up to 800 tweets from home timeline. For this, try using tweepy.Cursor and passing to it api.home_timeline
So, this tutorial uses 'OAuth 1.0a' correct? I don't see any option too 'edit app options' on 2.0. And OfCourse I can't save those settings until I figure out the 'Callback URI / Redirect URL' and 'Website URL' which Is not in the tutorial here. Twitter changes things around way too much
Thanks so much for this it was extremely helpful. Also going to watch your video relating to searching using keywords. However, can you recommend how to get tweets as much as say 5000-10,000? I currently have the elevated access. IF its not possible can you suggest methods we can try out? Looking forward to your reply.. Thanks
hi sir, i would like to learn this content for my thesis and i want to ask something. How it works with emoticon because i saw the output print emoticon? thankyou
Thank U so much, I had problems with the separators, so much tweets .text has comas or tabs or | , when I import this to excel (for example) is imposible. How I can converter to numpy object?
Thank you so much for the helpful and succint video. Please, how can I run these codes on Jupyter notebook? Being unfamiliar with VS Code text editor, I find it challenging to replicate these codes on my notebook. I need help.
Great video! Thanks a lot for sharing this! I have two questions though: 1. Is it possible to use your method to collect, say 10k tweets, at one time? I tried but only returned about 1k tweets. 2. What's the difference between tw.Cursor() and tw.Paginator()?
Unfortunately the API restricts the tweets that you can get with essential access. If you want to get more tweets, you need to elevate the access, for example to academia access. For the second question, Cursor() is for pagination of API v1.1 methods (this is when we write tweepy.API for instantiation), but Paginator() is for API v2 (that is tweepy.Client).
awesome explanations. i have completed all three videos and successfully extracted tweets. however, if I need only 'English' language tweets, where to modify in the code? can you help me on this? # please upload more videos.
Thanks! For filtering based on language, you can pass to api.search_tweets the parameter lang='en'. For streaming, pass to stream_tweets.filter the parameter languages=['en'].
Thanks for the instructions and the video! I am still stuck in the set up process: when giving the app the read and write permission, I also have to specify a Callback URI / Redirect URL and a Website URL. This information is required. What do I have to enter there? I have neither a Callback URI nor a website to refer to.
hello.. i try to use the code but i have an error . tweepy.errors.Forbidden: 403 Forbidden 453 - You currently have Essential access which includes access to Twitter API v2 endpoints only. If you need access to this endpoint, you’ll need to apply for Elevated access via the Developer Portal. please help me
2 года назад
Thanks for great video and coding. Can you find how many times tweet and share your tweet ? (meaning count)
Great video, 👍 Can we have more than 1 developer app? I already have an autoposter so it's not letting me add a different dev app only Production & Staging. 😕
Hi @AI sectrum, could you say what should I put in fields CallbackURL & Website URL on twitter dev site at registration process (when they ask me to choose between different type of OAuth(I'm choosing 1.0a)? Without filling those fields I can't finish the registarion and I can't give my app write & read permission. I have no clue what I should put in there
I see that they now changed a bit the UI. As you figured it out, you should now change the app premission in the User authentication settings section. Just choose OAuth 1.0a, give to your app the read/write permission, and for the Callback and Website URLs, you can simply give the link to your github repository.
@@aispectrum So, i did this and im still getting a traceback bad request 400 215 tweepy error bad authentification data. Imma check the keys one more time. Really excellent video
thank you so much for this. by the way, how can i define the time length? for example, I would like to search tweets containing certain keyword or hashtag posted between 2022-01-01 to 2022-02-01. If this is not possible. Could you give me any suggestions about this?
For getting tweets by searching keywords/hashtags, you can check out this video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-FmbEhKSpR7M.html For the time period, just pass the until parameter to the search_tweets method, something like until='2022-02-01'. Just have on mind that the api only reteruns tweets that are 7-days old.
Thanks for this video, it was very useful Just note, I noticed in this video and when doing a similar project, the tweets are not printed into full text and so tweets that are long in length are replaced by ... And so is there any way to get around this, as this is holding me back from getting a large dataset. Thanks in advance
You’re right. The Twitter API by default only returns 140 characters. To avoid this, put tweet_mode=‘extended’ in the api.home_timeline method. Also use tweet.full_text, instead of tweet.text, to read the tweet.
This is my code, and the tweet_mode parameter doesn't work in my function. Also the tweet.full_text doesn't work, so this is a barrier, so Im not sure how to get around this. cursor = tweepy.Cursor(api.search_full_archive, label="Tweets", query="Bitcoin", fromDate="202001010000", toDate="202012312359").items(number_of_tweets) for i in cursor: tweets.append(i.full_text) likes.append(i.favorite_count) time.append(i.created_at) retweets.append(i.retweet_count)
@@philipung5335 I do not have an Academic Research access to run the search_full_archive method. What you can do is to check the json data that you get from the API. First see if the "truncated" element is True, then inspect the data and look for "extended_tweet" element, this has the full text.
Thanks for your reply. I will give that a try, but Im a newbie to coding, so Im not sure what you mean by 'check the json data'. I only have elevated access which includes premium v1.1
Very helpful video, thank you. Could you kindly show how to possibly find tweets with specific keyword matching; also how to run the script in a server to keep extracting data continuously. Thank you !!!
I’m happy that it was helpful to you. You can check my new video for getting tweets by keywords: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-FmbEhKSpR7M.html
Hi, thanks a lot for this, I'm a beginner at Python and was struggling how to get started before seeing this. I have done all the steps as you do, but for some reason when I want to import tweepy it doesn't show even though I previously installed it using pip3. Configparser works fine though. I have not yet heard back from twitter regarding my elevated access, could that be the reason?
Sir i thought i miss the section or don't understand completely. But i want to ask you how to connect your tweet to the code? I didn't get it. Coz i didn't see any of your twitter account name in the code...
This is probably a stupid question (and slightly out of topic).However, I try anyway. I don't get this section: config = configparser.ConfigParser() config.read('config.ini') api_key = config['twitter']['api_key'] How can you use the variable "config" in config['twitter']['api_key'] to have access to the file( config.ini) when the file is not read yet? In my VERY RUDIMENTAL knowledge of Python I would expect something like: config = configparser.ConfigParser() x = config.read('config.ini') api_key = x['twitter']['api_key'] Am I completely off mark? Thanks!
when i type "pip install tweepy" in terminal it gives me this... ip : The term 'pip' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. why is that?? HELP PLEASEE!
Hi great video! If I wanted to search for a certain word from my home timeline how would I exactly do it. I know I'll need a api.search_tweets and a for loop but how would I go about doing it?
If I understood right, you want to search for some keywords. If that's the case, I have made a video for searching tweets. You might want to check it out.
Hello ! thank for the video. I'm a beginner, I have an error at the first print and I dont know why. Traceback (most recent call last): File "c:\Users\****\Documents\VisualCode\try\twitter_api.py", line 9, in api_key = config['twitter']['api_key'] File "C:\Users\****\AppData\Local\Programs\Python\Python310\lib\configparser.py", line 964, in __getitem__ raise KeyError(key) KeyError: 'twitter' Do you have an idea? :/
Sir if anyone twit and I want her twit in 1-2 second , so it is possible with api or not? For example Elon Musk make twit and I want newly twit in 1 second through api. Please tell me
It's actually different. bearer_token is for OAuth 2. You can pass this to the Client class of tweepy instead of API. But note that the methods of Client are different than API.
hey @aispectrum not able to solve this error You currently have Essential access which includes access to Twitter API v2 endpoints only. If you need access to this endpoint, youÆll need to apply for Elevated access via the Developer Portal. please help me solve this
Hello, I want to learn this course. I applied twitter developer account three times and all of them has been rejected. Could you help me apply a twitter developer account? Thank you most warmly.
Hello AI Spectrum! Thank you for your usefuls contents ;). But when I write "Import tweepy" in Virtual studio, it's like I didn't install tweepy while i installed it by writing "pip install tweepy" in terminal. Can you help me?
In your terminal type "pip list" (without the quotes). This shows you the list of all installed libraries. If tweepy is not there, the package is not installed correctly.
Hi. When I click the submit button, it gets loading for a second and then the website stays in the developer agreement and I don't receive any notification. I've tried with two different accounts and I have no idea what's wrong. Thanks for your help. UPDATE: When I move into the third step, the cell 'USE CASE' looks empty, which makes no sense (I've put "making a bot" in my case). I don't know if it has something to do with the problem.
For your twitter account, you need to verify your email and phone number. If this didn't help, try with a different browser as well. I hope this helps.
Hi AI Spectrum, so I tried your tutorial and it said my twitter account only has essential access to twitter v2 endpoint only. It says I need an elevated access to be able to access this endpoint. How do I change the endpoints to collect data or is there something else I can do to resolve the issue without updating to the elevated access?
If you only have access to v2, you can tweepy.Client instead of tweepy.API. tweepy.Client has different functions that can be helpful. Also, In my last video I show how to get tweet data without using the API. Maybe that can help.
