Well I guess the limits are imposed by the api providers in this case. For the smaller 70b model groq lists these limits. Groq doesn't have a paid tier yet. Requests per Minute 100 Requests per Day 14,400 Tokens per Minute 131,072 Tokens per Day 1,000,000 For the 405B, both Together.ai and Fireworks.ai have limited free tier as well as a paid tier.
Hey, thanks so much for the encouragement! I'll definitely try to make a tutorial, although I suspect it might be quite a task. But I'll see what I can do!
Thank you for this video, I do all steps, then I upload to github repo, then I want to use AWS as hostinng with amplifier, but after I deploy give me the link I see the page but without any response ?
good video, i have a question, i make recipe finder ai bot so its only generate recipe related thinks not other promt so , what i can do for this to convert this app its olny for recipe ai bot ??
If you want to have a node or nextjs server running on localhost 3000 port, then you can spin that up using npm commands and then expose those ports publicly using ngrok http 3000. Hope this helps.
Hi, I have updated the video description with the links. Also you can get the complete code for free in case you are interested: 👉 ko-fi.com/s/abe25c5e70
hello , this video has been so helpful but I have a problem, at the GoogleGenerativeAIStream,, it has depreciated , please i will appreciate if you can help out
been following this , have a question I have a nvidia GTX 1650Ti on my laptop, when i build this project, i did used the 'GPU' as delegate but the whole feed freezes, and the rocket model moved very slow, on further analysis, my CPU is getting used and its bottle necking, pls tell me a fix, does this involeve me downloding CUDA.?
It seems like so. Although please give the game a try here, with your current set up on Chrome 👉 test-plane.vercel.app/ It's not the final game, but it has the basic building blocks.
Pls add a featurs that if a person does not look into the camera for a particular time, then a warning message and sound pops. This feature will be useful in online exams
I can't seem to have the webcam work on mobile browsers, it doesn't ask for permission to use the camera and even when I always allow it, the webcam area is blank for some reason.
