Hi very interesting indeed, one question what are the requirements to run the model? I’m asking because my goal will be to use flowiseai hosted locally , then host a vector database like supabase, ingest our technical document and create a chatbot for our needs completely local. At the moment I’m using OpenAI ChatGPT api but I want to do it completely offline for privacy reason
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
I'd like to know why you choose the older version (v2.2.1) instead of the newest one, the 2.6 ? the size of the dolphin-2.6-mistral-7b.Q5_K_M.gguf is almost the same ?
Does this mean i can run this Llm on my local desktop computer at home, and be able to access it from my laptop online? Sorry if it’s a dumb question im new to this
Yes very much possible to do without lm studio, but what lm studio brings to the table is one UI for all that you do in different terminal windows otherwise. It becomes very messy, with the terminals running, then you want to change some configurations, you want to jump from one model to another etc.,
Cool and very useful. . But I would appreciate videos on how to do this without being beholden to some company and its apparently closed source product. Government crackdowns are coming and I want as much of my toolchain on my own hardware and in my control as possible beforehand.
Can you explain a little bit more about what you mean by government crackdowns? Are you talking about the copyright issues with OpenAI and big industries like Hollywood and Newspapers suing them and potentially having them raided by FBI, CIA or some other corrupt agency?
Yup me too I downloaded that shit as much as I could to my local drives. 500GB+ so far... Gimme!! I wouldn't be surprised if they removed uncensored models from the web. Actually they will 100%, because it's a security threat to them. Prepare for the end folks be smart lol
Ugh still too involved for non techies like me. Cant someone just package all this up in an executable? I mean that’s the whole f-ing point of ai isn’t it? So we don’t have to bother with command line BS. Pfft!
