Getting Started on Ollama 

I just did all of this yesterday and still watched your video from start to finish. Very clear and concise. I look forward to your other videos.

Thank you, Matt! Please create more videos like this; they're really clear and simple.

Thank you for such a helpful explanation. I wish more tech explainers and presenters were this clear and structured.

If you can make a video about crew AI explaining it as simply as you did here, you'd be my hero.

This is gold. Thank you, Mr Williams!

I really like this channel! The presentation is great and understandable. It is easy to follow along. Thanks.

I have watched a few of your videos. I love the way you explain things simply and clearly. Keep it up. Thank you for your work to all of us.

Im so happy there's someone in the mix who actually has a career in AI/Dev. Seriously, really enjoying your content. Dont listen to any of these jerks.

Thank you, Matt! Your videos are awesome and already helped me a lot :)

thank you for you job Matt.

Thank you for the video

fascinating. thank you for these videos!

Great Overview Matt, your a star!

What a great tutorial, clear, concise and informative!!!

AMAZING!

Excellent introduction. Thanks for the help

Verry cool, thank you 🙏

You're a very smart person 👍👊

Hello from Brazil. I really liked your content ! thanks

Would have been good to cover what ollama is and what problems does it solve, for about 30sec-1min, before going into hardwarre requirements etc.

Excellent summary, thanks alot.

Nice video

Thanks! Just downloaded Ollama and was feeling a bit lost. Would really appreciate some guidance on integrating speech recognition and text to speech into the chatbot. But just about anything you say will probably be useful. Please keep 'em coming!

Thank you so much for your tutorials! :D I would like to suggest an idea for a future video that I would be really interested in watching: a more detailed exploration of the various models (such as the instruct/base/etc. ones you've mentioned). Again, thank you very much! You rock! ^^/

I successful run Ollama with llama 3 on Mac OS M1 8G, it runs better when you close other apps .

10 out of 10!

Great video, thank you for Ollama introduction! is there a way to add my own data to the model or shrink model to a particular topic? for example TailwindCSS, there is a sorce code, docs, library of the project, is there any way to train model to be able generate layouts and components based on a provided data?

You explained it perfectly, thank you

Thanks for this! I just setup Ollama with wizard-vicuna-uncensored:30b-q8_0. Do you know what's different in the fp16 models?

Great content

thanks for sharing, prune is something what I missed but very useful due to the fact of downloading large files and loosing them after each restart, was very annoying. I see ollama didn't documented it well or maybe I overlooked it

thank you

Thanks. I really learned a lot by watching your videos. I recently ran into an issue when writing a new template model for few shot learning. Most of the times it responds like expected but sometimes it responds to my prompt and then also inserts it's own command by adding [INST] some other prompt … and also answers it. I probably made some mistake but I cannot figure it out. That's why I would love to see you make a video on templates (if this isn't too much to ask).

Hi Matt, do you know what determines the length of a model's answer? How does the model 'know' when to stop? Is it hard coded into the model or is it controlled by Ollama? Thanks

thanks

I like your videos, always spot on and pedagogical! Why did you leave ollama?

Do the models return Markdown ...like lists? extended Markdown ...like tables and LaTeX? I have written my own desktop client that I put on all our machines to use OpenAI and their API (cheaper than $20 * 5/month). So I would like to have a network server for my home to run a local model. Can I set it up there and have everyone use it, or would there be performance issues? ...what about simultaneous usage?

Please create videos on how to fine tune these models 🙏

Does it phone "home" at all, or is the model I use locally, assuming the machine is connected to the Internet, shared publicly at all, and is it secure?

Great video. The costs are a bit unclear to me. Would a local ollama/llm be free to use?

Here’s a video request: can you do one on LMSys’s SGLang? Particularly using constrained decoding?

Do I need to know match, statistics, etc... apart from programming?

Thanks Matt, why does everyone use Mistral rather than Mixtral?

Sometimes your level is so high some others too simple. Cheers.

Subed ❤️ If only you taught maths too

FYI- My llama2 install is working reasonably fast without a GPU, just a ryzan 5600G CPU, which has some rudimentary graphics capacity built into it.

I just dont get any sort of CLI when i install Ollama , the app just shows "view logs" and "Quit Ollama"

I have a feeling Duncan Trussell is a subscriber : )

it would have been great to know how to install other models not mentioned in Ollama library with specific type of Low Vram and GGUF

arch and nix are system-d distros

great content, a telegram group would be great!

Ollama runs very well on a M3 Max

I wish there was an easier way to fill in template text, and parsing pdfs. I've seen the 'function calling' video's, but somehow it's still eluding me how do get this done as easily as possible (e.g. sending a pdf over api in a curl request from another machine, and rename it sensibly/according to content)

9:40 To have the same result you just need the same input, seed (and other parameters), no? Reason it's different every time is because the seed is random for every request, right? The seed used (and other parameters) make the result different because it takes a different path in the weight model.

Please, do more compatibility with GPUs. I have rx580. My processor is crying hehe

Hello! My video card is an RX580. Is there a way to make it work?

thanks for the informative video. some examples should be displayed in a video, rather than spoken, for example, to show how to use environment variables

Can Ollama be used in prod on Linux server?

Wait do I need to download anything or not? You say "Now the model should be downloaded, so you can run it with ollama run mistral" Why would it be downloaded? I just installed the Ollama software. Does it download all the models automatically? This seems very unclear

Booted up Ollama with the llama2 model and my M1 MBP just froze 💀

you should have more views and subscribers

First

My model file refuses to create an awkward silence at the end of its output 😡