Тёмный

Web Scraping Facebook Marketplace Used Cars with Python 

The Data Circle
Подписаться 453
Просмотров 11 тыс.
50% 1

Опубликовано:

 

31 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 51   
@TheDataCircle
@TheDataCircle 7 месяцев назад
ATTENTION EVERYONE: a new login pop-up might come up when accessing Marketplace, in order to deal with it you should target the "x" on the upper right corner of the popup, it's labeled aria-label="Close": Here's the code that should be added before the scroll down section to handle this (GitHub already contains the updated file): if browser.is_element_present_by_css('div[aria-label="Close"]', wait_time=10): # Click on the element once it's found browser.find_by_css('div[aria-label="Close"]').first.click()
@eugenesilberman1592
@eugenesilberman1592 Год назад
Nice video and narration! Great Job! Good luck with future videos, i think your channel will be poplar in no time!) I'm gonna be the 5th subscriber)
@TheDataCircle
@TheDataCircle Год назад
Thank you so much for the compliment and for becoming the 5th subscriber to my channel! I really appreciate your support, it means a lot to me. I hope to see you around in future videos. Thanks again!
@zingthe64savage18
@zingthe64savage18 11 месяцев назад
i needed this video exactly now lol thank you
@TheDataCircle
@TheDataCircle 11 месяцев назад
You're welcome sir! Glad I could help.
@Brlitzkreig
@Brlitzkreig 10 месяцев назад
Awesome video. Really helped me a lot. How did you get on Facebook Market Place without logging in? Because when I use the url in incognito it does shows me a login page
@TheDataCircle
@TheDataCircle 10 месяцев назад
I'm glad! if you go straight to the marketplace there's no need for login.
@jeffreypoach2440
@jeffreypoach2440 7 дней назад
Hey, there is an initial login window that is able to be closed out, but then a second pop up that can’t be closed out pops up again. Is there a way around this? My CS buddy and I can’t figure it out
@joelbastien212
@joelbastien212 8 месяцев назад
It seems that at times Facebook changes the class names. I could be continously updating them as I encounter errors, but are there some more dynamic ways of coding it (maybe utilizing some other libraries) to not have to manually update the code every few days?
@TheDataCircle
@TheDataCircle 8 месяцев назад
There are a couple strategies you can employ to overcome that, such as using other attributes rather than class or even looking for the text content of elements, which is less likely to change over time. You might even want to employ regex if you're dealing with elements whose attributes might change slightly but still follow a certain pattern. Thanks for watching!
@ottunrasheed4076
@ottunrasheed4076 10 месяцев назад
For some reason, I am getting "DriverNotFoundError: Driver for chrome was not found." from this line browser= Browser('chrome'). The same issue came up with selenium. The situation did not change even by specifying the chrome browser path
@TheDataCircle
@TheDataCircle 10 месяцев назад
do you have chromedriver installed and added to the PATH variable?
@ottunrasheed4076
@ottunrasheed4076 9 месяцев назад
@@TheDataCircle yes I do. I added the path too. It is not just chrome. It gave the same complain for other browers too
@TheDataCircle
@TheDataCircle 9 месяцев назад
You could try updating chromedriver to latest version (chromedriver.chromium.org/downloads), or one compatible with your current version of chrome. Or it could be a permissions issue.
@deviprasadgorrepati3596
@deviprasadgorrepati3596 3 месяца назад
⁠@@ottunrasheed4076: Did you figure out the solution? I’m having the same issue. @TheDataCircle: I do not know how to check permissions, any help is much appreciated.
@andressoto5732
@andressoto5732 21 день назад
How did you solve it?
@kirillbarinov53
@kirillbarinov53 10 месяцев назад
Hi man Great video and tutorial! I got a smal issue, it seems to doesnt care about what car, transmission and millage I want to search for. It just gives me resultat within the price and location. Any ideas who i could slove that
@TheDataCircle
@TheDataCircle 9 месяцев назад
Thanks! Check the complete url to see if anything might be missing after the "?" or if there are any typos. That might also happen when there are not enough results with that specific criteria within your region, then marketplace will just fill up the screen with whatever it finds useful.
@iamwoods_music
@iamwoods_music 4 месяца назад
Is there a way to export the first image of every listing to the CSV file also?
@ashtonsallthat3432
@ashtonsallthat3432 8 месяцев назад
Are you able to collect data such as the number of clicks each listing gets? & I'm not talking about my own listing, im referring to others ?
@TheDataCircle
@TheDataCircle 8 месяцев назад
Not that I'm aware at the moment, but please let me know if you find anything, I'd be quite interested in that. Thanks for watching!
@JayRandal-kq6bg
@JayRandal-kq6bg 5 месяцев назад
Not working for me, says browser not identified
@TheDataCircle
@TheDataCircle 2 месяца назад
Could you send the full error message?
@phpchap
@phpchap 11 месяцев назад
silly question - how do you get past the username + password auth ?
@TheDataCircle
@TheDataCircle 11 месяцев назад
You don't need it to access the marketplace
@rob26r
@rob26r 11 месяцев назад
Nice video. What code would I use to only extract the main image (featured image)? Thanks.
@rob26r
@rob26r 11 месяцев назад
Never mind - figured it out. Nice video! Thanks again.
@TheDataCircle
@TheDataCircle 11 месяцев назад
Thanks!@@rob26r
@chiragjain5887
@chiragjain5887 8 месяцев назад
hey, how did you do it?
@Brlitzkreig
@Brlitzkreig 10 месяцев назад
How do you avoid being detected?
@TheDataCircle
@TheDataCircle 10 месяцев назад
didn't face any issues, perhaps the scrapping volume is not big enough to trigger anything on their end.
@mopailey
@mopailey 4 месяца назад
Is there any way you can filter the search radius?
@TheDataCircle
@TheDataCircle Месяц назад
yes, in that case you'll need to interact with the drop-down selector to chose the desired radius.
@RodrigoSotoCastro
@RodrigoSotoCastro 7 месяцев назад
Nice video bro
@TheDataCircle
@TheDataCircle 7 месяцев назад
Thanks man! I'm glad you enjoyed it!
@JayRandal-kq6bg
@JayRandal-kq6bg 5 месяцев назад
How do I set up the system?
@TheDataCircle
@TheDataCircle Месяц назад
You can refer to web scraping beginner tutorials for that, just look it up on RU-vid, there some really good ones available.
@soumyavyas3696
@soumyavyas3696 8 месяцев назад
I want to scrape facebook posts...images ,videos, caption ,likes and other meta deta ..is that possible and can you guide me ?
@TheDataCircle
@TheDataCircle 8 месяцев назад
it is possible, I might make a video about it in the near future.
@autocomforts
@autocomforts 2 месяца назад
how do you make this run automatically x times per day ?
@TheDataCircle
@TheDataCircle 2 месяца назад
Hey, to make the scraper run automatically multiple times per day, you can use a scheduling tool like cron on Linux/Mac or the Task Scheduler on Windows.
@Melek-jn9hu
@Melek-jn9hu 9 месяцев назад
any python script to scraping facebook marketplace snkears and try to find a specific model based on a target picture ?
@TheDataCircle
@TheDataCircle 9 месяцев назад
You'd need to train, or obtain a previously trained, ML model for the application to identify sneaker models based on a picture.
@mfacciuto
@mfacciuto 7 месяцев назад
hi bro, now we needed an activated account for use marketplace
@TheDataCircle
@TheDataCircle 7 месяцев назад
Hey, thanks for the comment! From what I see on my end you can still access it without login in, but there's a new login pop-up that might come up, in order to deal with it you should target the "x" on the upper right corner of the popup, it's labeled aria-label="Close": Here's a sample: if browser.is_element_present_by_css('div[aria-label="Close"]', wait_time=10): # Click on the element once it's found browser.find_by_css('div[aria-label="Close"]').first.click()
@ishuromina7289
@ishuromina7289 7 месяцев назад
Hi, Great video! Just Subbed! Are you open to paid projects currently? if so what is the best way to reach you to talk details. Hope to hear from you soon!
@TheDataCircle
@TheDataCircle 7 месяцев назад
I'm glad you enjoyed it and thank you for subscribing! For paid projects please reach out to me through thedatacircle.tech@gmail.com. Hope to hear from you soon!
@TheDataCircle
@TheDataCircle 2 месяца назад
Contact pietro@thedatacircle.tech for custom projects.
Далее
This is How I Scrape 99% of Sites
18:27
Просмотров 141 тыс.
A Monster is Chasing Me! 😭
00:19
Просмотров 1,2 млн
This AI Agent can Scrape ANY WEBSITE!!!
17:44
Просмотров 62 тыс.
Web Scraping Facebook with Selenium - AUTOMATED BOT
27:57