Just started learning Python last week. Stumbled onto your channel today and it’s a breath of fresh air to provide some excitement halfway through my coursework! You explain everything in easy terms and it’s a lot more exciting than basic programs. I’m looking forward to finishing my course now!!!
I really like the fact that you explain things so clearly, and I regret the fact that I haven't been able to see your videos in the past few months Great work!
hey mate, i recently found your channel when looking for some projects to busy myself with in lockdown and i love how simple you explain things and i hope you get many more subs because your amazing 😀
@@MakeDataUseful 🙂 Also, if you need a video idea Id love to see a notepad / MS word kind of thing in python. It doesn't have to have a GUI but I've been trying to make one and I'd love to see how someone else would try this. I'm using as few external librarys as possible so it could be a kind of plugandplay solution for quick edits?
masterful tutorial dude by far the best explanations of everything even though im still trying to understand some for loops and exception handling also what packages to use but with practice i know i can do it i just stumbled on your videos so i hope i can start learning to do jobs like this so i can do this on the side
This is the second tutorial I am following with you and I like this one way better than the first (the website in the 1st one didn't work), it s good to see the process of webscraping working, thank you!
I was able to accomplish the first video, if you need help ask away. The xml sitemaps page changed in this video's (#2) and now has images instead of the text in 4:38 , but I don't think it is important, but the speed at which this site has changed over 3 years is amazing.
Many thanks to you! I found an Upwork job after watching your tutorial and creating portfolio project. Keep it up, your tutorial are indeed practical. Thanks agian!
Hey there, absolutely loving this series. It is quite hard for new comers to get their first job on upwork, if you had any tips regarding how to land the first job, smooth and easy it would be a real help ! Anyways, keep the series going. Loving these videos
Thank you for the feedback and yes totally agree about landing those first few jobs! I will do some more client communication and landing the job in upcoming videos :)
@@MakeDataUseful wow... Really excited... U know it's really useful... I was struck at a point thinking what will i do after learning python. How will i convert my skills to a profession... Now this tutorials really helped me... I am thinking of learning web scraping with python and if u teach any webscraping courses with python.. please let us know.... Will be happy to be your student...
Thanks for the video. I have a python experience as a backend developer for 1 year. I have used python flask framework. Due to covid ,the start i was working has stopped its operation and i lost my job. Can i know how can i start earning as a freelancer with the python skills.
when you do work with python yourself do you usually only target web scrapping or do you other jobs as well. by the way i really like web scrapping with some practice i think i can become good at this
I do a lot of web scraping when I am building my own databases/APIs. A lot of my work is data cleaning and remediation prep for the visualization of data. The viz component is usually 10-20% of the effort, most of it is extracting and transforming data. Keep practicing an let me know if you need any help!
In 8:29 and 14:04 you defined "soup" and "loc" on different lines. Does that mean we can use the same name for variables? Sorry im still new to python. Also i noticed you mispelled "response" as "repsonse" in 11:50, was that intentional? Thank you for a real practical use of python though :) Edit: nevermind, you said its okay for repeating the "soup", my bad :)
Python is both a strongly typed and a dynamically typed language. Strong typing means that variables do have a type and that the type matters when performing operations on a variable. Dynamic typing means that the type of the variable is determined only during runtime. So yes, you can use the same variable
I tried to follow along but couldnt get the xml to work. FeatureNotFound: Couldn't find a tree builder with the features you requested: lxml. Do you need to install a parser library?
In Aug 2023 the page format is changed and BeautifulSoup has changed too. Fixes that worked for me: 1) install lxml (letter L in front) with pip install lxml 2) Then use this at about line 20: soup = BeautifulSoup(response.text, features="xml") The web page structure has changed so that the id number is on one line and the PNG on the line following it. I used the following code (may not be the best way but it works): for image_url in master_list[0:5]: # get a sample of some images. (requires two lines per image) this 0:5 downloads 2 images if 'image' in image_url: # the id number line has the word 'image' in it id_number = image_url.split('/')[-1] # get the last string following the backslash print (id_number) elif 'files' in image_url: # the png line follows the id line and has the word 'files' in it print(image_url) image = requests.get(image_url) # download the PNG image image_title = image_url.split('/')[-1] # get the file name in the last string after the final backslash file_name = id_number + "-" + image_title # add the id number + image name together # write the PNG file # example: 755899-Poker-Chip-PNG-Photos-80x80.png with open(file_name, 'wb') as file: file.write(image.content)
Please create a video in which you interact with the employer? I'm looking for my first job at the platform, but I'm not sure how to proceed when I finally get "selected" and have to interact with the employer. Thanks!
Did RU-vid suggested me this video because it has Eren Jeager's images in this video or is it because i am learning python lol. every where i go my favorite anime follows me.
Hey Art, Thanks for the feedback! At around 20:10 I source the image URL then use a response = request.get(image_url) to source the image then use a with open... and access the response.content to obtain the binary image file. Best of luck! Adam
There are several no-code/low-code tools available that allow you to perform machine learning tasks on images without having to write code. I imagine they may be utilising one of those. Also might be easier to give the task to someone else to do to save time and focus on other aspects of their project
@@MakeDataUseful HTTPConnectionPool(host='www.pngmart.com', port=80): Max retries exceeded with url: /image/246105 (Caused by NewConnectionError(': Failed to establish a new connection: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond'))
@@rahalmehdiabdelaziz8121 looks like a timeout, a couple of things to test. Try visiting the url with your browser and I'd you are successful they connection may be getting refused due to incorrect headers. Another option you could try is adding timeout=X where X is the number of seconds you want to wait. More details available here requests.readthedocs.io/en/master/user/quickstart/
@@MakeDataUseful I tried those type of solution but there is no efficient result ... however I found a " SOLUTION" : the error doesn't occur everytime (I suspected the weaknesss of my internet connection) so I've done a WHILE loop to repeat the request until it works ... thank you very much for your response ... I wish you do series of real world tasks other than webscraping ... Thank you and good luck
