Chat with Llama-3 with HuggingFace & Build a chatbot with Gradio 

You always keep up the updates. Thanks for the video!

for me i didnt get same output as u when debuged prompt in 07:15

i did the exact ways u did brother..but the model takes a lot of time to generate the response..is there any possible fix?

It seems the chatbot will not answer before checking the history🤔

Thank you for the great video. It was really helpful for getting everything set up. If I may ask, I have a 4090 graphics card and I can this maxing out my GPU usage so the cuda should be working correctly. However, my prompts when asked take anywhere between 20s and 2 minutes to return and after a few questions the chatbot stops responding at all and just stays processing. Is this normal?

Thanks for the tutorial! Is this actually running locally? If so, how did it download so quickly?

Does this work on mac with m2 too?