Check out ScrapingBee for youself here: www.scrapingbe...
This is a great method for easily scraping infinite scroll websites. Three ways to scroll down the page in playwright, and using the network events we can easily expose JSON data being transferred from the websites backend.
I use this method a lot for exploring sites and seeing whats going on but it's also a great way to extract data.
Scraper API www.scrapingbe...
Patreon: / johnwatsonrooney
Donations: www.paypal.com...
Hosting: Digital Ocean: m.do.co/c/c7c9...
Gear I use: www.amazon.co....
1 окт 2024
