Run a GOOD ChatGPT Alternative Locally! - LM Studio Overview 

I love local installed AI

I LOLed when you decided to turn it into ChaosGPT or SupremacyAGI 😂 !!!

@@AmazingArends 😘

Is there a big difference between the Q4, Q5, Q8 models? They're similarly sized, so not sure if it's worth getting a bigger one.

@@spadaacca Yeah, the higher the number the better, but generally a Q4 is pretty good. Q3 really goes downhill. The larger the size the slower it will run on your machine, so you need to find the model and speed that suits you.

for baby pcs and people have been talking about lm man.

better than Jan?

Alltalk with koboldcpp is very easy to setup.

I make the standard Llama 3 take me to the "dark web" to launder money. It's just a roleplay but pretty funny.

I’ve never heard of it, blow my mind

Howdy, how many tokens/sec do you get when using Q4 or Q5 model ?

You can run Stable Diffusion and some other types of models in ComfyUI. If you want to run only stable diffusion models you can use Automatic1111's UI - it have more "user friendly" web interface, but also it's not so optimized as ComfyUI.

@@okolenmi7511 yes i do this as well. What i didnt't could ran was Image recogmition Like vllava

That's what I want to know as well.. how much better is 70b compared to the 8b. I'm actually amazed that the 8b model is only like 5 gbs. I assumed it would be more like 30gb.

woah what?

better prompt would get the correct results - also for this example a completion tuned model would work much better (Not fine tuned for chat)

Yup, rhymes with heffer

RAM. VRAM settings in another place. You can set more VRAM to speed up your model. For example in this video were used 10GB VRAM to get that speed.

@@okolenmi7511 Thanks!

what you've downloaded isn't uncensored?

You finding that weird, is the weird thing. You must be a weirdo

Exercise them demons!

nice, what topics did you discuss about?

@@PopoRamos also curious about what to discuss

You should be able to do llama 70b fairly well

@@MattVidPro I'd love if you were able to upgrade your PC to run Llama 70b. Something you'd consider?

Stick to the smaller models if you care about speed. Ignore models that are larger than the size of your VRAM.

No, but it's honestly pretty straight forward to create a Python script to talk to the local LLM, get it to generate a more detailed prompt for Stable Diffusion, and then feed that detailed prompt to the Stable Diffusion API. Just make sure that you start the LMStudio server and the Stable Diffusion server on different ports and point the code to the API's accordingly.

@@starblaiz1986 Why would I need it to create a prompt? I already know the prompt. My point is Stable Diffusion can only generate images based on what it's been trained on. Thus the need for more detailed LLM instructions.

​@@MrDonCoyoteThe "Detailed LLM instructions" IS the prompt. The Python script would get the LLM to send the detailed instructions to the Generative AI, and then the picture will be generated.

blaze 24 7

@@punkouter24 Me too

I just asked ChatGPT for a newspaper ad and it doesn't have an issue --- **[Header: Bold and Eye-Catching]** **Grand Opening of Edmonton Smoke & Research!** --- **[Body Text]** **Elevate Your Experience with the Best in Legal Highs!** Edmonton, get ready to explore new heights with *Edmonton Smoke & Research*! We are your ultimate destination for premium glassware, unique rolling papers, top-tier accessories, and cutting-edge legal highs. **Grand Opening Celebration** Join us this Saturday for our grand opening bash! Enjoy exclusive discounts, live music, and a chance to win epic prizes. Don’t miss out on the latest and greatest in the world of heady innovation. **Why Choose Edmonton Smoke & Research?** - **Premium Glassware:** Handcrafted pieces to suit every style. - **Unique Rolling Papers:** Add flair to your sessions. - **Top-Tier Accessories:** Everything you need to enhance your experience. - **State-of-the-Art Legal Highs:** Explore our wide range of research chemicals and legal highs, all compliant with the latest regulations. *(Not for human consumption, wink wink)* **Knowledgeable and Friendly Staff** Our team of experts is here to guide you through our extensive selection, ensuring you find exactly what you need. **Location** Visit us at 123 Edmonton Avenue, right in the heart of the city. **Stay Connected** Follow us on Instagram @EdmontonSmokeResearch for updates, special offers, and the latest news in legal highs. **Edmonton Smoke & Research** Where Quality Meets Innovation. Be there!

The censorship is real. I never imagined it would get this out of hand. Adults get their adult tools censored more than young adult books. Wtf is going on

nope

ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-KTPLOqAMR0s.htmlsi=TaHZIcQpFs-maVmp In my option, this is the easiest way to get Stable Diffusion installed and running on your home machine. I'd recommend using movie stars as a prompt templets for your subjects while you're getting use to how to prompt and what all the dials and knobs do. If you want to learn more he has a helpful playlist as well, including dad jokes. Have fun.

It can be put on both but vram is much faster

It's RAM. VRAM is another requirement. It depends on what are you using (GPU, CPU, Apple M chip, etc.). GPU is the most common case as it's fast enough, default CPU is the slowest option, but I'm not sure they implemented model work on CPU as this is not a good way to run LLMs.

Really regretting the 3070 now, but it was such a good deal on the laptop. Most don't have a laptop that can run it at all so I should be grateful to run 8b

The reason chatgpt is in the title is because I want to express to the viewer that this HAS a chatgpt interface. I will change it to a chatgpt clone in the title

@@MattVidPro The word "clone" doesn't mean what you apparently think it does. Maybe you're looking for "Alternative"? It just makes the channel sound scammy, which I know isn't you at all. We're looking out for ya buddy.

@@s2turbine Adjusting title as needed!

​@@MattVidPro Perhaps "ChatGPT-like alternative" instead?

What the hell is your problem, buddy? It's his channel, his video, he can do whatever the hell he wants. Mind your own damn business!🤓

I think you'll need coding knowledge to make that work. Anything LLM is an app that has build in RAG function but it's not very robust, I haven't played around with it enough but I'm not convinced it's useful for anything I need.

@@SiCSpiT1 I used something similar (GPT4All) to LM studio a while back that had a diminished kind of way of reading files, but it totally went bananas when I updated it, so I deleted that app.