Тёмный

Fine-tune Mistral 7b on your own documents in under 5 minutes 

UbiOps
Подписаться 133
Просмотров 865
50% 1

Welcome back, data enthusiasts! 🌟 In today's tutorial, we're diving deep into the realm of fine-tuning to craft a domain-expert AI assistant. In this tutorial, we'll guide you through each step, from setting up your accounts and environments to preprocessing your data and executing the fine-tuning process. Whether you're a seasoned data scientist or just starting out, this hands-on guide will equip you with the skills to create a customized chatbot tailored to your unique use case.
Join us as we explore the intricacies of Parameter-Efficient Fine-Tuning (PEFT) with Low Rank Adaptation (LoRA) to retrain an open-source Large Language Model (LLM) on UbiOps documentation. This is a faster, cheaper, and less resource-intensive fine-tuning method.
You can also follow the detailed, written version of this tutorial here: ubiops.com/fine-tune-a-model-...
🔍 Learn how to:
- Create a UbiOps and HuggingFace account to gain access to the Mistral-7b-instruct-v0.2 model.
- Prepare documents to be used as training data.
- Initiate a training run to fine-tune the model.
⚙️ To successfully complete this guide, you will need:
- UbiOps account with training functionality enabled (see below)
- Supporting files and code snippets included in the full tutorial: ubiops.com/implementing-rag-f...
🚀 UbiOps:
- Free trial account sign-up: app.ubiops.com/sign-up/
- Slack community: join.slack.com/t/ubiops-commu...
- Contact form: ubiops.com/contact-us/
- Blog page for more guides: ubiops.com/blog/
- Documentation: ubiops.com/docs/
🎥 Don't miss out on this opportunity to level up your AI and machine learning game. Hit that like button, share with your fellow tech enthusiasts, and subscribe to stay updated on our latest tutorials and insights. Happy coding! 🚀
Chapters:
0:00 Introduction
1:39 Create accounts
1:52 Prepare training data
2:40 Fine-tune the model
3:17 Test the model
3:54 Conclusion
#AI #MachineLearning #finetuning #mistral #LLM #Tutorial #Tech #DataScience #UbiOps

Наука

Опубликовано:

 

10 июл 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии    
Далее
Fine-tuning LLMs with PEFT and LoRA
15:35
Просмотров 116 тыс.
Prepare Fine-tuning Datasets with Open Source LLMs
15:22