The Hugging Face Transformers Library | Example Code + Chatbot UI with Gradio

Подписаться 28 тыс.

Просмотров 36 тыс.

50% 1

This is the 3rd video in a series on using large language models (LLMs) in practice. Here, I give a beginner-friendly guide to the Hugging Face Transformers library, which provides an easy and cost-free way to work with various open-source language models.
Series Playlist: • Large Language Models ...
📰 Read more: towardsdatascience.com/cracki...
💻 Example code: github.com/ShawhinT/RU-vid-B...
More resources
pipeline() doc: huggingface.co/docs/transform...
pip installation: huggingface.co/docs/transform...
Vanilla Chatbot demo: huggingface.co/spaces/shawhin...
--
Book a call: calendly.com/shawhintalebi
Homepage: shawhintalebi.com/
Socials
/ shawhin
/ shawhintalebi
/ shawhint
/ shawhintalebi
The Data Entrepreneurs
🎥 RU-vid: / @thedataentrepreneurs
👉 Discord: / discord
📰 Medium: / the-data
📅 Events: lu.ma/tde
🗞️ Newsletter: the-data-entrepreneurs.ck.pag...
Support ❤️
www.buymeacoffee.com/shawhint
Intro - 0:00
What is Hugging Face? - 1:05
🤗Transformers - 2:05
Models - 4:40
Installation - 8:24
Sentiment Analysis - 9:49
Summarization - 11:48
Conversational - 13:04
Chatbot UI with Gradio - 14:42
Web app with Spaces - 17:38
What's next? - 20:46

Опубликовано:

16 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 74

@ShawhinTalebi 10 месяцев назад

More in this series 👇 - Introduction: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-tFHeUSJAYbE.html  - OpenAI API Intro: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-czvVibB2lRA.html 📰Blog link: towardsdatascience.com/cracking-open-the-hugging-face-transformers-library-350aa0ef0161?sk=225a4171af141daeb3869dcf614201dd 💻Example code: github.com/ShawhinT/RU-vid-Blog/tree/main/LLMs/hugging-face More resources pipeline() doc: huggingface.co/docs/transformers/main_classes/pipelines#transformers.pipeline.task pip installation: huggingface.co/docs/transformers/installation Vanilla Chatbot demo: huggingface.co/spaces/shawhin/vanilla-chatbot

@Hys-01 21 день назад

so much more helpful than every other tutorial on youtube! Straight to the point, very relevant and quick. Thanks so much!

@helrod6131 7 месяцев назад

Appreciate you walking through this in an easy-to-understand style.

@ShawhinTalebi 7 месяцев назад

Happy to help! I’m glad it was clear 😁

@user-xj1pr3pn1p 2 месяца назад

I think your video about LLM is the best one in the youtube, thanks very much!!!

@GBangalore 5 месяцев назад

Great introduction. Thanks for putting this together.

@jmitterhofer 5 месяцев назад

Great work Shaw!!!

@ShawhinTalebi 5 месяцев назад

Thanks! :)

@mohammadalibazyar5079 3 месяца назад

Thanks for compiling the stuff....amazing!

@ShawhinTalebi 3 месяца назад

Happy to help!

@muhammadroshanmughees1586 7 месяцев назад

I didn't know of the huggingface spaces. It is amazing. Thank you for this

@ShawhinTalebi 7 месяцев назад

You’re welcome, I’m glad it was helpful :)

@jakewastaken 2 месяца назад

I’ve been living under a rock and just learned about both Hugging Face and Jupyter. Consider my mind blown 😂

@ifycadeau 10 месяцев назад

Great video as usual! SO helpful 🙌🏾

@ShawhinTalebi 10 месяцев назад

Thanks, glad it was helpful!

@jakewastaken 2 месяца назад

Thanks for this fantastic playlist.

@user-ms3nf6tv6h 7 месяцев назад

Thank you Shawhin for this really helpful and informative video.

@ShawhinTalebi 7 месяцев назад

Thanks! Glad it helped :)

@matthcw8745 6 месяцев назад

Extremely useful, I haven't used hugging face, so this is useful!

@ShawhinTalebi 6 месяцев назад

Glad it was helpful!

@user-vw1or7qt9w 2 дня назад

It's very helpful, Thanks for making this video Shaw!.

@jobarmure6169 21 день назад

thx, I love how it was simple and helpful

@spotnuru83 5 месяцев назад

Really useful for beginners like me, thank you for this

@ShawhinTalebi 5 месяцев назад

Glad it was helpful :)

@fuad471 14 дней назад

nice informative and practical video I learned a lot keep sharing nice videos please

@zahrahameed4098 2 месяца назад

Your teaching method is exceptional, providing a balanced blend of theory and practical implementation. I would greatly appreciate it if you could create a video tutorial on training InsightFace using a custom dataset. I'm undertaking my thesis on this topic but struggling to find adequate instructional resources.

@ShawhinTalebi 2 месяца назад

Thanks for the suggestion. I added it to my list :)

@KumR 6 месяцев назад

Great Intro Shaw

@ShawhinTalebi 6 месяцев назад

Thanks, glad it helped!

@vipulbawankar3980 6 месяцев назад

Really great content!!

@ShawhinTalebi 6 месяцев назад

Glad you enjoyed it :)

@lalpremi 4 месяца назад

Thank you for sharing, have a great day :-)

@alemayehudendir3890 4 месяца назад

Amazing! Thank you so much.

@ShawhinTalebi 4 месяца назад

Happy to help!

@hanimahdi7244 5 месяцев назад

Great video, Thank you!

@ShawhinTalebi 5 месяцев назад

Happy to help!

@60pluscrazy 7 месяцев назад

Thanks, excellent 👍

@sathvikmalgikar2842 2 дня назад

Thanks !

@AniHunsaker Месяц назад

This is so helpful! can you record a video guiding us how data scientists can work in Transformers library if they work with low-resource languages?

@ShawhinTalebi Месяц назад

Thanks for the suggestion! What's an example of a low-resource language?

@emanuelokoth1973 8 месяцев назад

This solved me big time, I am working on a client project and this app I'm surprised it's general purpose and answers fitness related questions that is exactly what I'm working on. Big Thanks! Is there a way to fine-tune the model more for my fitness AI?? Big Thanks!

@ShawhinTalebi 8 месяцев назад

That’s awesome, glad it helped! I talk about fine-tuning in another video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-eC6Hd1hFvos.html

@emanuelokoth1973 8 месяцев назад

@@ShawhinTalebi cool let me check that out! was actually looking on how to fine tune this, since the first is a bitt simple!

@Techbro-ho3pp 5 месяцев назад

Thank you for pulling all actionable code in one place and the appropriate amount of technical details. Many of YT videos lab notebooks are stale considering version changes in library. Yours is the first one that worked! In a span of 12 mins, I could complete two of your exercise. While trying the chatbot example, when I import gradio in colab, it causes import of PyTorch and memory spikes and sometimes colab free vm collapses. BTW I want to implement a RAG example to query my pdf with tables. Since my laptop is under resources, was looking for some links or videos on how to push a RAG app to H.F. Would appreciate if you point me to one if you have it, or a better link.

@ShawhinTalebi 5 месяцев назад

Great to hear! I'm not a Collab user so not sure what's going on with that Gradio import. I found this video helpful on RAG with docs: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-WL7V9JUy2sE.html

@Techbro-ho3pp 5 месяцев назад

Thank you Shaw! Do you host or attend live AI related meetups in Dallas area? @@ShawhinTalebi

@ShawhinTalebi 4 месяца назад

Yes, I host at least 1 meet-up a quarter via The Data Entrepreneurs community Events: lu.ma/tde

@Deejayy08 Месяц назад

Great videos.. do you have something similar for AWS bedrock?

@ShawhinTalebi Месяц назад

I do not but that's a great topic for a future video :)

@souravbarua3991 4 месяца назад

Thank you for sharing. Please make same video using hf api.

@ShawhinTalebi 4 месяца назад

Thanks for the rec! Anything specific you'd like to see?

@souravbarua3991 4 месяца назад

@@ShawhinTalebi when we are using transformers pipeline, everytime the model 1st downloads and then it works. I want to know is there any way so that we can call the above models with hf api/token?

@ShawhinTalebi Месяц назад

HF's endpoints might help: huggingface.co/inference-endpoints/dedicated

@TheCloudShepherd 7 месяцев назад

Where did you get the Conversation class?

@ShawhinTalebi 6 месяцев назад

Good question. I forgot to show the imports in the slides, but Conversation() comes from the Transformers library. Here's the full notebook: github.com/ShawhinT/RU-vid-Blog/blob/main/LLMs/hugging-face/hf-sandbox.ipynb

@anicole14774 Месяц назад

Hello...When i'm trying out the gradio chat interface with the vanilla_chatbox function, I run an error saying that the conversation variable is not defined. Why is this the case?

@ShawhinTalebi Месяц назад

I believe there was a transformers library update which broke the could shown in the video. But I have an updated version on the GitHub that should work: github.com/ShawhinT/RU-vid-Blog/blob/main/LLMs/hugging-face/hf-sandbox.ipynb

@ncjatin 15 дней назад

We dont need to create and use HuggingFace tokens to use these models ?

@ShawhinTalebi 14 дней назад

Not if you are running these models locally!

@yumei6607 6 дней назад

Very useful information. I cannot clone the git repository. Got error: invalid path 'TDA/persistent_homology/homology_example_Homology-Changes-Predicted-Crash??.png', Could you please take a look?

@ShawhinTalebi 14 часов назад

I wasn't able to reproduce this error. Note that GitHub doesn't let you clone a part of a repo so you have to download the whole thing: github.com/ShawhinT/RU-vid-Blog.git

@friedrichdergroe9664 2 месяца назад

The sentiment analysis is strange. I put in: "It is fun to hurt people" and it came back with a .99 POSITIVE. I guess it has no clue about morality and values. Also, I have not used Python in a while, and I suppose it has trouble dealing with dependencies, because I had to install tensorflow and tf-keras separately. But it works.

@ShawhinTalebi 2 месяца назад

Thanks for raising this, it's a super important point. While I suspect larger and more recent models will handle that example better, accounting for these edge cases is a major challenge when working with language models.

@djentlover 7 дней назад

Anaconda doesn't find all the depencies when I try to create the environment. What should I do?

@ShawhinTalebi 7 дней назад

Are you using the .yml file from the GitHub repo? If that's not working, you can try making a fresh env and installing transformers following this guide: huggingface.co/docs/transformers/en/installation#install-with-conda

@djentlover 6 дней назад

@@ShawhinTalebi Yes I used your GitHub link and your yml file. Using a M1 mac. Thank you. I will try that.