Is this how pro's scrape HUGE amounts of data? 

awesome stuff! it's hard to find best practices around data scraping so it's always great to see an actual helpful "advanced" video. Keep em coming, I'd love to see more of your workflow as well!

Ah. I thought everybody did it like that. Ok.

Thank you for delivering such content. Keep it up

Very handy advices and techniques 👍

Hello John, I have been learning web scraping from your videos for quite some time. I am currently struggling with web page analysis prior to deciding which scraping approach to follow between Requests, Playwright and Selenium or API. If you could make a video around this topic i would really appreciate it. PD: Greetings from Argentina.

Good as always ❤

Always lovely content

Im a proxy noob and have no clue why async-ethics a proxy is essential. Rate limits?

Hi John, Do you have perhaps a Udemy or similar course that you are holding, or at least any learning material that you recommend for obtaining the exact knowledge that you have, ecomerce scraping and analysis. BTW you are amazing, and I honestly suggest investing your time in making a full on course. Id pay for it and Im sure many many more would too.

If the data has some structure, turn it into markdown and use your imagination.

What happens after saving to mongo? That’s the part I was hoping to see 😂

nice