Scraping Data from a Real Website | Web Scraping in Python

Подписаться 808 тыс.

Просмотров 375 тыс.

50% 1

Take my Full Python Course Here: bit.ly/48O581R
In this Web Scraping tutorial we are going to be scraping data from a real website!
GitHub Code: bit.ly/442kIVi
____________________________________________
SUBSCRIBE!
Do you want to become a Data Analyst? That's what this channel is all about! My goal is to help you learn everything you need in order to start your career or even switch your career into Data Analytics. Be sure to subscribe to not miss out on any content!
____________________________________________
RESOURCES:
Coursera Courses:
📖Google Data Analyst Certification: coursera.pxf.io/5bBd62
📖Data Analysis with Python - coursera.pxf.io/BXY3Wy
📖IBM Data Analysis Specialization - coursera.pxf.io/AoYOdR
📖Tableau Data Visualization - coursera.pxf.io/MXYqaN
Udemy Courses:
📖Python for Data Science - bit.ly/3Z4A5K6
📖Statistics for Data Science - bit.ly/37jqDbq
📖SQL for Data Analysts (SSMS) - bit.ly/3fkqEij
📖Tableau A-Z - bit.ly/385lYvN
Please note I may earn a small commission for any purchase through these links - Thanks for supporting the channel!
____________________________________________
BECOME A MEMBER -
Want to support the channel? Consider becoming a member! I do Monthly Livestreams and you get some awesome Emoji's to use in chat and comments!
/ @alextheanalyst
____________________________________________
Websites:
💻Website: AlexTheAnalyst.com
💾GitHub: github.com/AlexTheAnalyst
📱Instagram: @Alex_The_Analyst
____________________________________________
All opinions or statements in this video are my own and do not reflect the opinion of the company I work for or have ever worked for

Опубликовано:

10 июл 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 279

@jorge.roques5533 2 месяца назад

Honestly I love that you include your missteps in your tutorials for several reasons. It makes coding seem more human, it also shows us that even content creators and great programmers can have missteps that they need to go back and fix which is usually edited out of other tutorial videos. Not to mention there might be people having the same issues without understanding why and you explain it so its almost a mini tutorial on debugging and your programmer thought process. Overall it was an easy 25 minutes to spend watching this. Thank you.

@nocturnalcb 2 месяца назад

Exactly😁

@Charlay_Charlay 5 месяцев назад

12:21 I literally stopped when i couldn't figure out why i was getting extra titles when i pulled the titles. I'm so glad that you showed your Rookie mistake. Everyone please watch Alex's videos in full before stopping the video. Thank you for showing your mistakes.

@chrille91 4 месяца назад

In fact, YOUR approach is the correct way of solving such issues! Trying to figure out the error on your own is the ACTUAL learning taking place! Always try for yourself first, before you have a look at the solution. Otherwise you might fall victim to the fake-learning trap.

@francescab1413 7 месяцев назад

I'm so glad you make mistakes and show us where to check if something goes wrong! It's my main problem when I have to work on my own after a tutorial, I mess up and don't ever know where to start to clean up my mess.

@Kicsa 10 месяцев назад

I saw all the videos for this playlist and I am getting to this last one, I haven't felt so happy to learn in a while, thank you for your work and help!

@aaronklingensmith159 6 месяцев назад

Alex: when I needed to learn SQL for my first analyst job as a career changer, you were there with videos to help me do so. Now I'm in a role that is using more python and once again, you're there! Really appreciate all the work you are putting into creating content to help people!

@--Manoj007 6 месяцев назад

Can you tell me that this playlist is useful for analyst

@EKTurduckin 8 месяцев назад

Last year I got a job as a BI Analyst and I've been watching your stuff here and there. This video is hands down one of the best videos I've watched of yours. I had to take multiple tables, pivot them, and label them with the table name and this video 100% helped me get there. I had run into my own set of issues, but not far removed from your sections of mistakes, so thank you for not letting those hit the cutting room floor. Anyway, keep up the great work and thanks so much!

@saudtechtips8674 4 месяца назад

my mind is blown after watching the whole video i didnt imagine this could be done by python.i have to watch it again!what a person you are Alex!

@eatersdaily 4 месяца назад

dude it's awesome ! just keep teaching. short, empty of long stories, useful and update data! that's all i want always.

@neronova1176 11 месяцев назад

Thanks, Alex! This was a really helpful lesson and project. This helped me get a better understanding of web scrapping and restructuring the data. Now, I feel confident in applying this to a project I've been working on.

@traetrae11 10 месяцев назад

Thank you for doing this Alex. I learned a lot and followed along while watching this series so that I could learn how to do this as well. Now all I need to do is practice, practice, practice.

@noob4head 10 месяцев назад

Thank you for this video with a extremely clear explanation. I always wonder why my college professors can't explain something as clearly as some people on RU-vid can.

@sj1795 6 месяцев назад

This was one of my FAVORITE projects in your series so far! It was SUPER interesting and HELPFUL/USEFUL. I can see using this info for many future projects. P.S. I LOVE that you included the "rooky mistake" because that is definitely something I would do and then NOT be able to figure out for an hour. These included "mistakes" are such valuable lessons for people in your audience like me. :) P.P.S. I really appreciate how you summarize what we do in each video/project at the end. It's these extra details that make your instruction = A+, not just an A. Also, thank you for including the index = False. As always, THANK YOU ALEX!! You ROCK!

@takudzwakarombo5204 3 месяца назад

FACTS 100%

@Nomuz32 11 месяцев назад

Hi Alex, thank you a lot for all the videos. I'm currently doing a change of career to data analyst, and you are giving me more than just a little help with all your courses. Thanks for all

@sarurajendran5762 9 месяцев назад

same

@giriraj191 8 месяцев назад

@@sarurajendran5762 same

@molecularptsdneuroscience4123 8 месяцев назад

Same!

@leonardnewbill793 11 месяцев назад

Super excited to finish the lesson! Thank you sir. I appreciate it!

@sojourner5294 3 месяца назад

Completely quick, efficient and clear, really appreciate your effort and content Alex ! Thank You !

@izzyvickers6258 8 месяцев назад

You made this wayyyy easier than I thought it would be! Worth a sub from me sir!

@prasad_create2687 7 месяцев назад

Thank you, I learnt basics of python yesterday(had learnt C+ 8 yrs back so it was easy to relate) and I am a mechanical engineer but want to get into Product. This video was useful to learn and will modify it for other websites hopefully. Thanks again!

@louisamkeyakala9420 11 месяцев назад

the way i was waiting for this video😂..thank you Alex

@user-xb7og2ls5s 10 месяцев назад

Thank You so so much for this video, Alex! It was super useful and easy to follow!

@yunusaprianus736 9 месяцев назад

I'm done with the tutorial today and end with awesome successful, i'm facing some trouble since i use different site but yeah, my scraping going well! Thank you so much!

@Autoscraping 5 месяцев назад

A fabulous video that has been of great help in orienting our new collaborators. Your generosity is highly valued!

@dhanienugroho4323 9 месяцев назад

Thanks for the tutorial! I just found the channel and I like the way you explain it!

@anthonygordon5052 11 месяцев назад

Thanks for the videos as usual Alex !

@margotonik 4 месяца назад

I loved this!!! Very good practice I enjoyed working in this project including the mistakes. Is always good to know that having errors doesn't make myself an idiot and is part of the process. Thank you so much for everything Alex I am sure we all love you as well!!

@pritamlaskar7265 10 месяцев назад

Thank you so much! Very clear and well explained!

@YourYTHUB 9 месяцев назад

Hey Alex, thank you so much for ur effort,,,its a really super helpful series 🙏

@ibrahimmohamoudbile3424 11 месяцев назад

You’re a ‘God sent’ my g

@ZeuSonRed 9 месяцев назад

This was from the Greatest Videos I have Ever seen Thank you! Very Much! 🙃🙃🙃🙃🙃🙃😊

@blackwidow2899 8 месяцев назад

Wow, Alex I totally enjoyed this. You make it so easy to understand. Now I need to go through your pandas tutorial and learn data manipulation. Thanks for being there!

@jeet611_ 10 месяцев назад

Thanks alot Alex it helped me alot to explore this Webscraping and thanks for making this interesting and on point

@boeingpete 4 месяца назад

Excellent. Great video. Everything explained clearly and in a way I could follow. Thanks so much.

@raphael.dev13 11 месяцев назад

Hey Alex! Thanks for the great video as always! Could you do a video on the repercussions and impact on the Data Analyst career now that OpenAI released their GPT Code interpreter?

@SupCortez 7 месяцев назад

Just finished google data analyst certification, you about to help me make my portfolio look phat with scraping my own data before I do my whole hypothesis and data vis

@moviesprobe6220 11 месяцев назад

Much needed video ❤

@oanhkieunguyen156 11 месяцев назад

Thanks so much for this video! I firstly understand the principle and the way to scrap data :)

@martinbolio257 2 месяца назад

Very very useful! Great video.

@cityoflaredoopendatadivisi9197 Месяц назад

very helpful video. love the troubleshooting as you go, and simple explanation of how you're working through this. thank you.

@richardtorrenueva5512 8 месяцев назад

I love this. Thank you Alex.

@kuiwang3614 2 месяца назад

fantastic lesson, very clear

@vamshikrishnareddyLingam Месяц назад

one word Beautiful video it actually helped to get the client

@ghimirepujya 29 дней назад

I really salute your work . Thank you.

@proud_indian0161 Месяц назад

Great Tutorial, Got what i was looking for thanks

@MudassarAli-bx2pf 9 месяцев назад

Excellent Work Sir!!! I really Appreciated your work believe me You are a great mentor!

@gabinkundwa7215 10 месяцев назад

Thank you Alex, I am new to web scrapping and this video was helpful to me! Keep the good work!

@gameaddict3068 6 месяцев назад

Check out my chanel for nice web scraping tools

@sjb_s2003 2 месяца назад

this was really helpful, thankyou

@ibikunleadekiitan9882 11 месяцев назад

Thanks Alex for making me a great value to the world

@whitey9933 5 месяцев назад

Thanks for the tutorial, Was always told not to add to a dataframe row by row (probably slower for much larger data), so I appended to a list and created a Dataframe off that - pd.DataFrame(company_list, columns=world_table_titles).set_index(['Rank'])

@sumanhachappa2822 9 месяцев назад

fantastic way of explaining things

@ashutoshranjan4644 Месяц назад

I like your way of teaching. Looking forward to learn from you. Thanks for making such content

@adiyansfuntime 2 месяца назад

This is a fun project. Thanks for this.

@tsubame1412 2 месяца назад

Thanks, this video is really helpful for me at this moment !

@Mvjesty23 11 месяцев назад

I’m going to do this today! Thank you Alex 😄

@gameaddict3068 6 месяцев назад

Yes

@Nalla-perumal 5 месяцев назад

Simply Wow!!! handsoff!

@nguyenhuyhoangk18hcm37 5 месяцев назад

I am really like your project! I appreciated you

@Anuj_Hindu_10k 11 месяцев назад

Wow, amazing video sir....Thanks you

@MarciaRibeiro-gd1wx День назад

You are perfect Alex. I loved this video! Thanks a lot.

@AlexTheAnalyst День назад

@ebamybass19 10 месяцев назад

Thank you Alex Frebeg ❤❤

@benjaminkaitany4464 2 месяца назад

Amazing tutorial

@Larocaxx 7 месяцев назад

We love you too Alex ♥ thank you for such great videos

@user-mh1ch3mq7h 9 месяцев назад

Interesting class!!

@anirudh7150 3 месяца назад

Thank you so much. It was really helpful

@assettemirkhan7087 11 месяцев назад

Hi Alex, thanks for the video, it is very helpful

@Vikash-the-analyst 2 месяца назад

Honestly, very informative and this help me very well to learn this topic. Explanation of every code is very useful. Thanks for making this informative video.

@abdelhakemabdelhak4624 10 дней назад

great job !!

@vnrd9 9 месяцев назад

thank you so much, super helpful

@iSky950 5 месяцев назад

Very nice video Alex thanks for sharing! (I love that it's "live" and you make mistakes too, it's more human this way!)

@wesrocha3293 9 месяцев назад

Amazing, thanks!

@UtiaGaxton 11 месяцев назад

Thank you sir. You got me going

@yoshitamanavi530 11 месяцев назад

I just have one comment, You are the best Alex 🤩

@shivamprajapati65 3 месяца назад

very helpful!

@efeberke681 8 месяцев назад

So helpful!

@akshaybharadwaj 4 месяца назад

This is super helpful! Thanks so much!

@matrixnepal4282 4 месяца назад

brother, did 'th' worked in you case? while i was doing it, it shows all the numbering in th too. I will really appreciate you help if you reply

@ucthanhchu3688 Месяц назад

nice video! thanks

@mikeg4691 11 месяцев назад

I found out why the class names were different. It seems to be a common issue. Someone explained it on Stack Overflow, "The table class wikitable sortable jquery-tablesorter does not appear when navigating the website until the column is sorted. I was able to grab exactly one table by using the table class wikitable sortable."

@atrallzerhas3157 11 месяцев назад

great video.Thank you

@sgntsids Месяц назад

Going through this series for a personal project, such wonderful content! For the class tags, it seems like when there's a space, bs4 ignores the 2nd "part". For instance, in my project I'm seeing the element and I just need to ignore the "list-unstyled" part for the soup.find to work. Didn't read through all the comments here so you might have already figured that out and shared, but wanted to comment anyway. Cheers!

@stingray3565 10 месяцев назад

Great video. Thank you...

@joeche7461 8 месяцев назад

Thanks a lot for the video.

@donovanmurray7005 6 месяцев назад

Thank you!

@sergiysergiy8875 4 месяца назад

That was a good one! Thx

@matrixnepal4282 4 месяца назад

brother, did 'th' worked in you case? while i was doing it, it shows all the numbering in th too. I will really appreciate you help if you reply

@artemboichenko743 11 месяцев назад

Hi Alex! Super helpful video, thank you! One detail though: Growth index is not always positive. We may see in the wiki table negative and positive values are present in that column. Instead of using ‘-‘ for negative value, that table uses small triangles. Could you show us how to manage that - to convert those triangles into positive or negative values accordingly?

@ridanaeem1012 7 месяцев назад

hey, any workaround for this?

@pawledz 5 месяцев назад

I am sure that there is a better way to handle this, but this will work: df = pd.DataFrame(columns = world_table_titles) df column_data = table.find_all('tr') for row in column_data[1:]: row_data = row.find_all('td') row_table_data = [data.text.strip() for data in row_data] if row.find_all('span')[1]['title'] == 'Decrease': row_table_data[4] = "-" + row_table_data[4] length = len(df) df.loc[length] = row_table_data

@AtharvChaulkar 6 месяцев назад

Perfect 🫶❤

@ayushsinghrawat1409 Месяц назад

I hands on to my 1st scrapping experience with your sir

@KhushiSingh-vo9nf 5 месяцев назад

thanks a lot for guiding us

@lilyfullery4779 9 месяцев назад

U r the best ❤

@MIRIAMIKECHUKWU 11 месяцев назад

Thanks Sir Alex

@uncaged3076 3 месяца назад

Thank you 🙏🏿

@rasoultk691 5 месяцев назад

Really thanks

@anuradhamondal1601 9 месяцев назад

02:26 lol.. as a beginner to this and already overwhelmed with all information i recently learned, it is exactly what i would had thought!

@Dataciiiiiiiii 3 месяца назад

thanks man

@alicemtopcu743 3 месяца назад

Thank you

@Machiavelli698 11 месяцев назад

I appreciated you, I love you 😂❤

@himanshubisht5023 11 месяцев назад

Hello Alex Sir! Thanks for the great video, super helpful as always! Could you do a video on how to convert PDF file to excel in python | OR | Data extraction from PDF File. It will be really really helpful to me and other student/fresher...

@ZeeshanAli-ds1tm 4 месяца назад

A question. How we can scrape 'td' and 'th' at the same time within same tbody < tr tags.

@ultimategohan2190 11 месяцев назад

Thanks Alex

@coorditecnologia 7 месяцев назад

Muchas gracias excelente contenido

@dakshbhatnagar 11 месяцев назад

Hey Alex, Can you do a selenium scraping tutorial? It would help a lot to scrape dynamic websites.

@jmc1849 3 месяца назад

Hi Alex (as if!) Thanks for all the content

@ezhankhan1035 5 месяцев назад

Really helpful, thanks! You explain this muuuuch better than in the IBM Python Course haha.

@matrixnepal4282 4 месяца назад

brother, did 'th' worked in you case? while i was doing it, it shows all the numbering in th too. I will really appreciate you help if you reply

@ezhankhan1035 4 месяца назад

@@matrixnepal4282Did you do table.find_all('th')? I think Alex also made a similar mistake initially by doing soup.find_all('th'). Should be ON the 'table'

@Photoshop729 8 месяцев назад

So far on my web scraping journey I don’t know if web scraping is any faster than just manual copy paste unless you have repeated scrape requests of the same site or structure