Ollama-Run large language models Locally-Run Llama 2, Code Llama, and other models

Подписаться 978 тыс.

Просмотров 39 тыс.

50% 1

Get up and running with large language models, locally.
Run Llama 2, Code Llama, and other models. Customize and create your own.
url: ollama.com/
----------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

Опубликовано:

1 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 60

@vishalnagda7 3 месяца назад

I'm feeling lucky that I got this video in my suggestions.

@mehdi9771 4 месяца назад

We need a long versions videos like previously and thanks for your efforts ❤

@rajendarkatravath2207 4 месяца назад

Thanks krish! for sharing this knowledge . what an amazing model it is .....!

@computerauditor Месяц назад

Really insightful krish!!

@ankitshaw2011 3 месяца назад

Thankyou so much for these videos

@kenchang3456 4 месяца назад

Hey Krish, thanks for doing this video in Windows.

@AjaySharma-jv6qn 3 месяца назад

Content is helpful, thanks for your effort.🎉

@durgakorde3589 3 месяца назад

R u a data scientist?

@marcoaerlic2576 23 дня назад

Thanks for the video.

@divyaramesh3105 4 месяца назад

Thank you Krish sir. In Building RAG from scratch ,sunny sir showed about Ollama. Both of you were giving foundational knowledge and updates in GenAI. It was very useful sir.

@devanshgupta6064 4 месяца назад

please give sunny sirs youtube @

@divyaramesh3105 4 месяца назад

@@devanshgupta6064 @sunnysavita10

@sailikitha8502 4 месяца назад

Sunny Savita @sunnysavita10

@deekshad4774 3 месяца назад

You are the best!🤓

@BelhsanMohamed 2 месяца назад

as always thanks for the information

@roshanchandel7929 2 месяца назад

The heroes we need!!

@NISHANTKumar-ct3pb 4 месяца назад

Thanks , it's great video. Wanted to ask when we say local what is the configuration of local is it a cpu or GPU based system? Are models compressed / quantized or same as original ? Is there a model size limitation vs local system config?

@haritdey430 4 месяца назад

Nice video sir

@manjeshtiwari7434 3 месяца назад

Thank You so much for a such a great video , I have a query , I am getting very slow response does the speed of response depends on system config , I have chekced out system use and while running it isn't using much resource , can you tell how can we increase response speed

@nasiksami2351 4 месяца назад

Great tutorial! Can you please make a video on finetuning model on custom csv dataset and integration with Ollama. For instance, consider I have class imbalance problem in my dataset. Can I finetune a model, then ask it in Ollama, to generate more samples of minority class using the finetuned model?

@ranemghalion581 7 дней назад

thankyou

@usingsk Месяц назад

Thanks for Sharing knowledge. Can we fine tune with company domain content in downloaded model and the data is not shared. I mean it comply with IPR if we use locally

@velugucharan8096 4 месяца назад

Sir please complete the fine tuning llms playlist as much as possible sir

@jacobashwinmathew3763 3 месяца назад

Can you make a complete video of production ready open source LLM basically LLMOps

@krishnaprasadsheshadri6206 4 месяца назад

Can we get a video about reading tables using unstructured and such frameworks

@YashDeveloper-rq2yc 3 месяца назад

Bro using these techniques can I convert it as superb ai assistant? And what capabilities can use?

@lionelshaghlil1754 3 месяца назад

Thanks Krish, the briliant, innovative and master of the AI 😊, I have a question please related to the hosting, so assume I'd like to implement my solution on a server, will I need to have both, OLAMA and my app in two seperate dockers? they would communicate together? or they could be implemented in one single docker?

@krishnaik06 3 месяца назад

It can be implemented in one docker

@ayushmishra5861 Месяц назад

Have you got clarity on the same, can you please share.

@omarnahdi3380 4 месяца назад

Hey sir😄, please make a video on BioMistral( a LLM trained on Medical and Scientific Data). It would perfectly fit your AI Nutriationist. Thanks for your daily dose of GenAI

@user-lq7sx8qw5t 4 месяца назад

Great content Krish...Need these coding files kindly share those

@tharunps8048 4 месяца назад

Since it is running locally, using this model with organization's data doesn't expose it right ?

@shashank046 21 день назад

Hi, how do I use gpu on open web ui? My model response is really slow and is not using gpu even though is used the command for using gpu for installing as mentioned on the open web ui GitHub page ..

@kashishvarshney2225 3 месяца назад

hello sir, what is the minimum system configuration for ollama

@susnatakanjilal703 4 месяца назад

Sir I need to create a custom text data set from common crawl.for Bengali language....and train llama2 using that...can you plz demonstrate similar project!?

@AjayYadav-xi9sj 3 месяца назад

Make a video on Python framework of ollama. Make a end to end project and also host it somewhere where real people can use it

@KumR 4 месяца назад

Do we need to download the entire 7gb llama2 locally to use with ollama

@copilotcoder 4 месяца назад

Sir please create a codebase understanding model using ollama and test it on a opensource codebase

@pssab8 3 месяца назад

Excellent videos. I set up mistral model locally on ubuntu20.04 and found that it is taking more than a minute for every response .Running in cpu mode only.Can you suggest me to improve the performance.

@amazingedits9298 3 месяца назад

This models are running on your computer hardware.So it requires a good hardware like gpu or something for creating quicker responses

@starkgaming1425 3 месяца назад

Please release a step by step guide on how to fine tune Gemini API in Python.....I tried by refering to documents but encountered a lot of errors with OAuth Setup please...........!!!

@rishiraj2548 4 месяца назад

🙏💯👍

@nagasudha6928 3 месяца назад

Hi Krish This is Sudha from ISRO Hyderabad, I would like to know the documents to be provided for ollama and get the answers from it

@manasjohri2495 3 месяца назад

Can you please tell me how we can run this ollama on GPU right now it is working on CPU?

@VishalTank-vk5ju 19 дней назад

Hello, krish, I am facing an issue with the Ollama service. I have an RTX 4090 GPU with 80GB of RAM and 24GB of VRAM. When I run the Llama 3 70B model and ask it a question, it initially loads on the GPU, but after 5-10 seconds, it shifts entirely to the CPU. This causes the response time to be slow. Please provide me with a solution for this. Thank you in advance. Note:- GPU load is 6-12 % and CPU load is 70% .

@sanjaynt7434 3 месяца назад

Can this read a document and answer my questions on that document can it.

@hassanahmad1483 2 месяца назад

How to deploy these custom gpts...?

@SomethingSpiritual 2 месяца назад

why ollama not taking full gpu? its taking full cpu only, pls guide

@rajarshidey424 Месяц назад

How can we get the code?

@DeadJDona 4 месяца назад

please finish that Chrome update 😢

@ashishdayal172 Месяц назад

hii krish, i am facing error creating modelfile .Please help

@naveenkumarmaurya3182 4 месяца назад

hi krsih i m getting this error Ollama run codella! 🐰💨 (Note: I'm just an AI, I don't have personal preferences or the ability to run code, but I can certainly help you with any questions or tasks you may have!)