You are awesome Derrick! Could you Please upload a video of automating data transfer from AWS S3 to AWS Redshift (Using AWS Glue) or any other appropriate method .
Thanks for the vid man! Noob questions here. Can the S3 subdirectory be created on the fly from within the python script? Say I get a .py file but I have no python subdirectory in my bucket. If my script calls for storing the file in my bucket's non-existent "python" subdirectory will it be created or do I have to manually do it beforehand? Thanks!
Thank you so much. Derrick Please can you take me along with you in a journey to use Python for data manipulation using strings, lists, tables, SQL and excel with regex.
Hi! Do you think Python allows us to scrap data from the screen, not only from a website? I see there is a lot info about web scraping but I want to scrap words that I type in an app. I dont have acess to the API.
In the Python file, write a program to get all the files from a public S3 bucket named in random list. In there there might be multiple files, but your program should find the file with the prefix __cb__, and then output the full name of the file. You should use the boto3 module to solve this challenge.
@Derrick Sherrill everytime I try to run the code it picks up files from windows32 directory. I have the .py file inside a folder with few test .txt files but it keeps picking up txt files from the win32 dir. Whats happening, please help
It's not working for me. Showing error: boto3.exceptions.S3UploadFailedError: Failed to upload upload_data_S3.py to new-bucket/python/upload_data_S3.py: An error occurred (NoSuchBucket) when calling the PutObject operation: The specified bucket does not exist
Nice video. I have one question. I don't want to download the content from S3, and I want to know the content details like no. Of .txt, no. Of. py within that bucket. I am using aws s3 ls bucket_name/ - - recursive - - human-readable - - summarize It shows the total size and objects no. But can't find the file counts with respect to their extensions.
I have my bucket like "parent_Bucket/Chield_Bucket", Now I want to upload my file to Chield_Bucket. Could you please suggest what I need to do for this.
Hi, I was trying this and I'm getting an error of "FileNotFoundError: [WinError 2] The system cannot find the file specified:" I tried searching it everywhere but I couldn't figure it out. Any advice?
Hi Derrick and all I tried this method and I am getting the error below ImportError: cannot import name 'access_key' from 'secrets' (C:\Program Files\Python37\lib\secrets.py) did anyone had same error? and how do you go about it?
how can i upload a 1 gb video to s3 bucket quickly . or if i could upload it asynchronosly(i.e., my page should get redirected to next page and the video can get uploaded at background)
How to securely insert the Access key and password to the python or c# Because using your method any one can decompile my program and have my access key and secret key ?
just reviewed another video from someone that literally walked through this same scenario. however, their video was 57 mins! no. i did not watch the 57 min video. i watched about 3 mins and saw your video sitting in the sidebar screaming '7 minute video over here!' haha. to the point and just the facts. no showboating knowledge and skills. if im ever drowning, i hope you are on the shore to save me and not the person who makes a 57 min video on 'how to jump in and save a drowning person'. haha
Hi, thanks for great video. I did though run into an issue if you have time. I followed the tutorial and I can get the file (image.jpg) from my images directory (I see this image by running print("file", file) in the os.listdir for-loop) but when I run: "client.upload_file(file, upload_file_bucket, upload_file_key)" I get error "FileNotFoundError; [WinError 2] Can't find the file 'image.jpg' Do you have an idea what the issue can be? Thanks
Hi 👋 thanks for your valuable KT. I'm requesting you to help me with a automated python script to check RDS snapshot name and snapshot created time for multiple Rds in multiple regions. Like N.V, ohio, Sydney, Singapore, Ireland, Paris, Belgium, etc..