100% Offline ChatGPT Alternative? 

Wow. Thanks for such kind words. I appreciate the positive feedback.

In its current state, i think you will be underwhelmed by its performance unless you have a pretty powerful GPU

​@@lynngeek5191In simple English, what are you even talking about dude?

@@Raylightsen I think what he meant is that his GPU is not good enough, since he couldn't use the 8k token version.

@@lynngeek5191 You said the desktop version is limited to 2000 but that is not true, you have the option for 8000, however you need a gpu that can handle it(like a RTX 4090, or RTX A6000, or a quadro rtx 8000 card..)

@@Raylightsen ok dude, here it is for you : He's trying to say that this shit ain't free homie. Apprently far from it according to @lynngeeks5191

Thanks! I just started there. Still will make my normal youtube content but this open source project is exactly the sort of stuff I would normally cover. Glad you liked the video.

I’ve always liked H2O, I used to use their deep learning framework a lot. Will definitely check this out.

@@robmulla You work for this?... Sad.

@@sylver369 get off his back

​@@sylver369if you worked for anyone "better" then why are you here? 🤔

Thanks for the feedback! Glad you liked it. Please share it anywhere you think other people might like it.

Glad you enjoyed the video! Thanks for the feedback.

The last thing they want is AI “noticing” patterns in modern western society.

there are plugins for this fine an open source one and use that

@@pirateben what's it called Ben? Linkey pls.. :)

Look for "Faster WhisperAI", maybe it could help you in creating transcriptions and translations from audio-to-text, I've had great success in using it to transcribe youtube videos and create subtitles for them.

Thanks for watching! Will def look into a video with steps to setup on the cloud.

@@robmulla definitely interested in the cloud provider video too

update?

You should refit the model using Lora to get a smaller size, more narrow for in game usage, that way it's more optimize

Would AMD cards work or is it a headache?

@@CollosalTrollge currently they are using cuda technology which require nvidia cards.

@@hottincup good suggestion, i will try.

If you’re trying to shoe-horn a full fledged LLM to power some NPCs then you’re doing it wrong. All that you need is basic chat personalities and the ability to train based on in-game events, this requires very little processing power!

@TheTen-PointFormatStyle-di1ez anything can have an automated installer made. It’s just if they want to invest the time or not. Nothing is so special about what they are doing

any specific use-case?

@@tacom6 I write Inspection and test Plans, inspection test reports and standard operating procedure for industrial engineering and industrial construction. For instance if we need to write a procedure and checks for the correct way to flush HDPE or terminate and electrical panel etc. Currently I can paste SOPs or our checklists and ask if it was missed anything, ask about new ideas to add or new things entirely. It's great at asking for ASTM codes instead of looking it up or buying the PDF. I'm using Claude currently and perplexity. My company does everything internal it doesn't want the data hosted with another company. I'd like to make something for us to use internally. I believe using AI language models has sped up our procedure drafting and checksheet drafting about 40% so far. It's been game changing. But, I'm using 3d party sites and I have to scrub out client details, names etc. If I had an in house model I could let it retain all client or confidential data and others could ask requests against it also. I have a bot running that I've made through Poe using Claude as the base but I can't make it public for colleagues to use.

@@BryanEnsign sounds fantastic. my interest is similar but with focus on cybersecurity. thanks for sharing!

@@tacom6 That's awesome. So many possibilities. Luck to you brother!

It does have many limitations such as requiring fairly beefy hardware (or get really restrictive questions) and a ton of storage space.

@@Coecoo do you think nvidia rtx 4090 can handle this? When you say beefy hardware what do you have in mind?

Thank you! Cheers!

How did you get it to work with your CPU? I keep getting token limitations on the answers. Did you follow the documentation?

You need a huge GPU to train the model and a big GPU to run it. You can train a smaller model from a bigger model, like Alpaca, but it is not as smart. The GPU has to host the entire brain of the AI so the smaller the worse.

You are now master of your domain!

did u find the answer dude for it ? looking the similar answer

@@username42 hi there rlare othe llms which are opensourced and are landed on huggingface hub like llama which cam be used.