I think you missed to add NODE_ENV = production when you where adding env variables .This was the only working tutorial that is working for deploying pupeteer project on render for me . Thank you very much for the video :)
This is one of the best and well explained tutorials I have ever come up accross, well spoken, consize, perfect. Thank you, hope you start making videos again soon.
Thanks so much man! I was so tired of trying to deploy it to vercel and other platforms using aws-lambda and trying to make it work... You literally saved me
I totally agree with Gabriel. You've got a great teaching style @AviMamenko. It's quick and your zoom cuts really help focus on what you're talking about. One thing I don't ever see though is after the Chromium download error found in the Render logs, you didn't show the full process of how the issue was worked through. I don't feel enough dev show the problem solving side in their tutorials. Or at least highlight the key places to find answers when you're stumped. I would 100% watch you Google for answers. Or maybe you just knew it all exactly as you recorded it. In that case, your know-how is enviable. Either way, I hope to see more content in the future!
brooooo ty so much! even with gpt I couldn't handle, I just had to remove the browser args, but everything running fine now! btw thanks for the final tip, greetings from brasil.
Please somebody help , i can't interact with the browser and perform the actions. , only thing it does is visits the page i given and nothing do , i have to fill a form and click a button , the code works on my local machine but it does not work on render , everything else works perfect , not getting any error too .Please give me a solution to fill a form created by , and click a button made by .
when it runs RUN npm ci from the dockerfile , it says my pakage.json file has a error , it says it show parsing error. anyone with solutions. My node is 16.16.0 and puppeteer version is 19.7.2
It helped a lot. I got an error with the Node environment, but with Docker, it all went smoothly. However, my deploy is always in progress, what can be the issue?
puppeteer waits for the selector to appear but there's a 30 sec timeout. So if whatever selector you're looking for isnt loaded by 30sec it throws an error. there must be an issue with loading the page faster maybe due to the CPU limit on free plan? You can increase that timeout in puppeteer. that'll fix it
@AviMamenko I've been repeatedly recieving this error on render : Error: Requesting main frame too early! at assert. My code works perfectly on local system. Can anyone help?
Hey, can you help us with running puppeteer with userDataDir profile in Render. I've tried putting the chrome profile to the root directory of my project, and used the relative path in puppeteer useDataDir. It works fine on localhost, but not working on production.
Hi I need help please and quickly. I am using a Postgres database running on Render ass well. After adding the docker file and running my web service, my program now refuses to connect to the database anymore.
In order to define multiple services, you can use a docker-compose.yml file which will set up the configurations for both your app and postgres. There are a few tutorials already out there for configuring nodejs and postgres with docker.
Thank you for your great tuto, I just can understand how you are able to use the url with "scrape" at the end. So for me I have a 502 error. When I try my render web service URL it replies "Render Puppeteer server is up and running!" but as soon as I type the url with /scrape at the end, it fails. Would be super nice to understand why. Thank you
Hi ! How are you ? Amazing video Man, thank you very much. But, im not understanding, how you are installing the dependencies, im trying to run "RUN npm install", but i got lot of trouble, so, how can i install Express , i didnt see that in the video. THank you so much again !
Please help me with deploying my puppeteer app .. i am getting this error Tried to find the browser at the configured path (/usr/bin/google-chrome), but no executable was found.
Hi, It shows me this error. Please help. Failed to connect to the bus: Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory
@@allainzenithn.sabandal2299 Thank you for your response. After made the changes, the site keeps on loading and nothing showing in render logs too Any Idea?
Thank you for the tutorial! I'm getting the following error: Error: No element found for selector: .search-box__input Also, how can I run this locally using Docker?
Hi Avi, thank you for this tutorial. It was very helpful. One thing I've noticed is that I keep getting the errors "Cookie “__cf_bm” has been rejected for an invalid domain" and "Cookie “_cfuvid” has been rejected for an invalid domain" in the browser when I try to make an API call. It's strange because there are no errors in the OnRender logs, which is confusing. I'm not sure if this is caused by OnRender, but I was wondering if you or anyone else has encountered a similar issue?
@@AviMamenko Thank you for the reply Avi! It turns out puppeter was being blocked by the website I wanted to scrape. In order to bypass this I installed puppeteer-page-proxy package and added a proxy server in browser args. Even though I can still see "Cookie “__cf_bm” and "Cookie “_cfuvid” warnings in the console, everything works like a charm!
hey! if this method doesn't work for you, try creating a .puppeteerrc.cjs file on the project root and add the following to it: const {join} = require('path'); /** * @type {import("puppeteer").Configuration} */ module.exports = { // Changes the cache location for Puppeteer. cacheDirectory: join(__dirname, '.cache', 'puppeteer'), }; sometimes, the "Chrome not found" error happens when the cache directory is incorrectly configured. this code configures it correctly. this worked for me, hope this helps :)
