Create Custom AI Characters Easily 🎭 How To Fine-Tune LLMs For AI Role Play 

Should I clone myself with AI and try to fool my family?

Finally! I can automate my friendships, have the AI give me the highlights/details of any important information, and get back to living as a hermit.

I see a problem here: how do we know, that model responses "kinda" like Rick not because model knew of this character before finetuning? Any model can do what you did in this video right now, without finetuning.

Very cool! This is really another step into creating our own content... I love the last line where he is going to use the portal gun to go back in time and stop the portal gun from being invented! hilarious.

honestly dude i feel like you specifically know what i'm doing and are making videos to help me. you keep giving me exactly what i need. i need ai agents to set up ai agents for me. smh. great video again! i'm saving this one

Love your channel man! It's always the first thing I watch when it pops up. I have been playing around with famous characters using character sheets and Oobabooga. I've found that with only a few hundred tokens I can create a scary good interaction because (model dependent) everything is already baked in and all you need to do is point out who you want to talk to. I'm willing to bet that Rick and Morty script was part of your models training data set already. That said, AS ALWAYS, your video has filled my head with day dreams. The idea of training a whole model for a single character is so cool. My challenge to you and anyone that reads this is how small of a model can you train into being a coherent and usable roll play bot.

THANK YOU!!! I was just getting ready to go down this exact rabbit hole when you posted this. I WOULD LOVE to see a video of this BUT but using all open source/local llms/software.

00:00 🎭 You can create a custom AI roleplay bot for characters from TV shows, movies, comics, and even yourself using fine-tuning techniques. 00:27 📊 Data for fine-tuning can be obtained from sources like Kaggle for scripts, which are available in CSV format, or other websites for various dialogues. 01:50 📄 You can also fine-tune a model based on your own text messages, DM history, or telegram messages by converting them into CSV format. 03:02 📂 Google Colab is used to prepare data for fine-tuning, and Gradient AI makes fine-tuning models easy and efficient. 05:36 ⚙ Fine-tuning is performed using NAOUS Hermes 2, and you can adjust the fine-tuning process as needed. 07:01 🗨 The model's responses are generated by providing a query, and you can customize the system message and instructions for roleplay. 08:50 🤖 You can deploy the AI roleplay bot for any character, and the process is versatile, allowing you to mimic various personalities.

Yes! Today I was researching how to fine tune Mistral 7B on my dataset and now you post this video! ❤ Would be great to also get a tutorial how to fine tune with HuggingFace AutoTrain. This way it could be uploaded to HuggingFace and used from Text-Generation-Webui.

What about an open-source tutorial. NO THIRD PARTY poo poos (I mean gradient is great and all, but come on!)

The man himself is back. I been looking forward to your uploads you always got so much dope information

Nice! Thanks Matt! Looking forward to this one. Introducing the real, the one, the only, Skippy The Magnificent!

This is fascinating - all of your videos that I've seen so far are! Thank you so much for having a good fine-tuning video. I am very curious about two things that I am not seeing covered much... (1) The topic you mentioned - creating good prompts.. particularly from large bodies of unrefined data. For example 'all the works of Shakespeare' or 'the Guttenberg project'. Especially where those works have both dialog and non-dialog 'things' that happen as part of the writing style. (2) How to work entirely locally, assuming you have the memory / GPU for it - such as if you are working with a large body of local data and you don't want to keep trying to move it into the cloud during training, or you just want to use your own resources.

Know what I'd really like to see? A guide on an open-source installation of multiple roleplay chatbots that can exist on a Discord server as Discord bots with the ability to communicate with each other and humans. That's my dream chatbot project, my server would love it.

Your videos have risen in quality and sophistication. Brilliant.

Amazing thank you! 1. How much data did you use there? How much is needed? 2. Why did you choose that base model?

Yeah! Do it!!! The clone-yourself video! 🙌

amazing! looking forward to have another video for this subject !!💙

I used to do this with markov chains way back, and had an IRC channel full of different characters that would discuss social media posts. One plus of markov chains was they could learn, but couldn't get that big, I wonder if llama index can replace the need for training.

Can you share how you got to rick & morty wiki from Fandom? I search on rick & morty and got a ton of stuff that wasn't you showed in the video. Would also love to see a how to use Fandom for finding dialog from other movies & tv shows. I spent about 5 minutes (not a lot, I know) and really didn't find anything I thought I could use for fine tuning.

…You had me at Rick Sanchez. Subbed. 👍🏽

I use this through CHATGPT custom instructions and voice chat while I make dinner or work on code. I have Rick Sanchez roast me on everything like a Jerry! 🤣

Very well done! Looking forward to the future fine tuning videos

Yes definitely interested in chatting with a Mathew AI .. just don't trick your family members! 😂

Could you do some kind of tutorial of how to make a realtime voice conversation chatbot? So kinda like this where you train it to be the character you want, then add a speech-to-text and text-to-speech chat? Maybe something where you can add your own custom voices.

Can you clone yourself and ask the model questions that you have answered before and compare the accuracy?

yeah! we need self clone with AI video. Eagerly waiting for your video sir

Could you please Do more videos on autogen specifically how to get autogen running with mem GPT and llm and maybe what are you using for if you're using it at all

Thanks. Not really sure about any use case implementations. I think you mentioned using this anywhere, but there’s no context. Maybe you’re assuming most subscribers already have this knowledge?

YES we want that video! :)

I was waiting for you to ask how to pronounce PENALTY. 😂Great video again.

Two problems with the video: 1. You haven't compared the fine-tuned model with the original. Nous-hermes can roleplay at about this level with character prompt and no fine tuning so we don't really know if you did anything at all by fine-tuning the model. 2. The process for doing this locally for free has significant differences to what you shown, so it's not really useful as a tutorial. You wouldn't want to use collab for local training and you probably would use different libraries. Only data collection and preprocessing would be similar.

yes i would love to see a video of you cloning yourself and tricking your family. Great work as always boss. so awesome..

Noob question: how to get the fine-tuned model? Does GradientAI allow downloading the model/lora? or do we need to use its API to interact with the model?

That's Rick Sanchez alright 🤣Cool stuff!

love your channel. please bring back the AI News videos!

Yes do the clone and video keep up the good work you do I enjoy all your videos 🎉

DeepSeek Coder 6.7b Instruct is the only Open Source LLM that I was able to get to generate SNAKE!!!!! It works so well! And I tried the 33b version on their chatbot webpage and it also did it even better. I hope you make a video soon!

Did you ever do a video on unstructured data for finetuning in the end?

That's exactly what i wanted to try out, thanks! :) I would love to see if you can trick your family

Great stuff. Make a version to do this locally.

YES and if you can make it work off a local llm that would be great

Yes to both videos

You're incredibly helpful :D

do it, i think thats the next step, life tuning on your personality and create an alter ego bot of yourself, that would be epic

Imitation episode would be awesome

Missed opportunity, you should have asked Rick "What is my purpose?" :)

I don't see anyone mentioning this so: Here is a case where if you don't know something, the AI will confidently tell you something wrong. Rick doesn't believe in time travel... He would never postulate using a portal gun to "go back in time", but it sure sounded good to everyone who doesn't know that about Rick. Anyone who knows, would know this was an imposter Rick.

As a weaponized autistic, the world is going to regret this tutorial.

Cool see ya in the next one. Bravo!

Great video 👏

How long did it take roughly to complete the fine tune?

Yes!! Would love to see you cloning urself

Cloning yourself I think would be really cool. Would it be possible that instead of csv 2 columns to use audio files? Might be able to feed it an audio memoir or autobiography and make it more real and nuanced

I absolutely want you to finetune a model, clone your voice with elevenlabs and trick your family member in a phone call

>fine-tune my AI on my own data >find them super annoying and hate their guts >"Oh god, is that what I sound like?"

This is great!

Thanks matt❤

Rick would actually do that lmao... He would go back in time to prevent the portal gun from being invented. But he would know he can't

Thanks Matt for another great video, is the data accessible. How did you copy data from fandom and added in the file?. I would really appreciate if you can share that information.

Here an idea for for anybody willing to do it: Fine tune a GPT model to help users install/configure Autogen locally, connect to various LLMs (including local ones) and thereafter quickly generate autogen code of various structures/configurations/tools - I would pay to use that model. Just unsuccesfully spent several hours trying to get local Autogen going.

Does this only work for character behavior and personality or would it work with information if you loaded a database of writings, like, could it think like a person based on a dataset like that, so like talking to Einstein for instance?

Thanks for the vid - curious about the cost for this one...

Okay demonstration, though I would strongly prefer seeing local approach.

From where the model takes the informations besides the input .csv? And why the model making up responses if it dont know the answers? For what the input csv is, if I can chat with thant model with only the system message that inform it who he is?

I wonder if it would be possible to do this with video/audio of myself...

if i finetune model in gradient and then later decide to no longer use gradient, do i iose access to those models?

so how much did that all cost, and how do you download the new model?

Bring on the clones ❤😂

Who wouldn't! I mean, strictly for yuks of course, **and that point has to be emphasized with a disclaimer.** The subject would have to be selected carefully (the more sense of humor they have the better; not too young or old). Maybe do multiple friends/relatives and select the best one. The subject would have to be debriefed afterward, possibly on video. But given all this I think it would be a great video.

I love this! Do you know any way to do clone voices as well? Goal: Generate a Rick Sanchez Voice using some GPT-generated text

my question is, now if i did this, how i use it as an api to incorporate it in my apps?

It is really good but can you give it his voice and run it on his own ecosystem some thing like a raspberry pi with mic speaker....

BTW… there is a way to fine-tune model to use other language than English?

I love the idea of cloning oneself, but is tricking someone into thinking they’re talking to a human when they’re not an unethical version of the Turing’s experiment?

is is possible to take fine tuned model from gradient to runpod? or can i fine tune in runpod?

I want to have a chat interface. I mean like a What'sApp chat with voice. That Chainlit thingy is still hard for me.

Can I use this to fine tune my model that is not for AI roleplay?

There are going to be breaking charges in the world of AI for the next several years as we all figure out exactly how to best use this AI thing.

Id like to see if you could get a good enough model to trick people you know for sure lol

Trick them, I want to see how they'll react,, Create the clone of you

Can this tell me how to make concentrated dark matter?

But how to do it without gradient that's not real opensource

Hello can anyone help me create an Alan Watts bot

👎 You have to contact them for pricing.. Not my cup of tea. How much would it have cost to train your example if it wasn't sponsored.❓ Can you do an fully open source free version of the same task? ❓

Can I fine tune in other language than english?

if "Rick == row["name"]? Sir, Yoda conditions do not have a reason to exist

rick doesn't do time travel.

Okay what about this AutoGen + memGPT + open interpreter?

ive been trying all of your videos i cant get a single one of them to work AHHHHHHH

how to do it without gradient?

I'm RickGPT!

Do it!

Yes plz

slow down! i'm one week behind

Make the vid!

How does this handle foreign language?

Clone yourself 🎉

This is interesting and clever but it's pointless asking questions about its plan about anything. There's no permanence. It's just learning words and phrases and then outputs those to questions asked. The AI doesn't have missions and goals, likes or dislikes or any moral's, at least none that are permanently instilled in it. Not yet anyway.

Yes, trick your family.