No video :(

Local AI models! Code with Ollama and Phi3.

Подписаться 3,6 тыс.

Просмотров 1 тыс.

50% 1

Learn to use Ollama and the Phi3 model to setup and code against a fully local, offline AI environment. This video acts a simple introduction to these powerful tools that can transform your AI development practices. Local AI models are powerful and under-utilized tools that more devs should be using.
00:00 Intro
00:55 Setup Ollama
03:30 Setup the AI model
05:53 Semantic Kernel overview
06:26 Connect to the AI model via code
09:12 Real world use cases
12:11 Why use local AI models?
GitHub repo for ollama starter app:
github.com/ale...
GitHub repo for database chat app:
github.com/ale...
My other AI videos:
Learn to use AI to chat with your own data: • Learn Azure OpenAI - C...
Use AI to chat with a NoSQL database: • Use AI to chat with a ...
Learn to code a simple AI powered app: • Learn Azure OpenAI - B...
Learn Azure OpenAI fundamentals: • Learn Azure OpenAI - G...
Learn how to authenticate to Azure OpenAI the RIGHT way: • Authenticate to Azure ...

Опубликовано:

16 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 20

@user-fqlt 2 месяца назад

Thanks for the very good content. You channel is underrated and you deserve a million subs.

@alexthecodewolf 2 месяца назад

Thank you, that really means a lot. Really trying to grow this channel into something big and deliver content that simplifies convoluted topics.

@TellaTrix 2 месяца назад

I would love to learn more about AI with dotnet things + local LLMS my fev one.

@AbhinavKumar-tx5er Месяц назад

Hi, a very helpful video .Can you hit the URL of the video here where you have created the dashboard for this.

@alexthecodewolf Месяц назад

Hey, thank you - are you referring to the video that shows you how to chat with a database? ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-hw6oTjw9_Ro.html

@Ajmal_Yazdani 2 месяца назад

Hi Thanks @The Code Wolf. Is function calling supported with Phi3 or any other local LLM?

@alexthecodewolf 2 месяца назад

Yep, local ai models support function calling.

@Ajmal_Yazdani 2 месяца назад

@@alexthecodewolf Thanks, Can you showcase something or share any code article.

@alexthecodewolf 2 месяца назад

@@Ajmal_Yazdani You can find some examples in the semantic kernel docs at learn.microsoft.com/en-us/semantic-kernel/agents/plugins/using-the-kernelfunction-decorator?tabs=Csharp I would recommend using semantic kernel for local AI dev. Semantic kernel and more involved AI flows with local functions, plugins, services etc is a topic I plan on covering here in the near future. Semantic kernel is a big topic so I'm working on the best way to present tthat.

@goodtimeforever2035 2 месяца назад

Hi @Thecodewolf, Could you please explain how to set up a local laptop to run the .NET code? As I'm not a coding expert, any useful suggestions you can provide would be greatly appreciated. If you can outline the necessary steps, it would make it easier for us to follow along and perform the demo ourselves.

@alexthecodewolf 2 месяца назад

Hey, thanks for watching and providing feedback. This tutorial made some assumptions about coding knowledge with .NET or other languages, but I probably should have mentioned that up front. If you want to get started with .NET to recreate the code sample you can download visual studio here, which is the code editor I'm using that also installs .NET for you: visualstudio.microsoft.com/ You can then either clone the sample app from GitHub and just open it up in Visual Studio and follow along with the tutorial, or you can create a new project using Visual Studio and copy in the code. File -> New Project -> C# console app. Hope this helps a little bit!

@justinkrawczak4929 2 месяца назад

Have you tried to connect your local LLM to talk to an on-premise network database without providing the schema in the instructions? Im wondering how well it would function or if this is even feasible. Asking for a friend :)

@justinkrawczak4929 2 месяца назад

Also, I want to add that this is great content. Useful real-world examples like this will be golden as more people leverage AI in the enterprise landscape.

@alexthecodewolf 2 месяца назад

Thanks for the feedback! I'm not sure if I understand your original question though - are you asking about essentially just giving the AI a connection string or something so it can access the database directly?

@justinkrawczak4929 2 месяца назад

Yes, exactly that. @@alexthecodewolf

@alexthecodewolf 2 месяца назад

@@justinkrawczak4929 As far as I know it's not possible to just give an AI a connection string and have it understand/explore a database. I think the closest solution I've seen to this is to add some kind of layer between the AI and the database, such as using a RAG solution where you connect the AI to a search service that has crawled your database, or using vector search capabilities to provide the AI with database data. I have a couple videos on my channel that explore these types of topics, but I don't know of any "Direct access" solutions.

@AbhinavKumar-tx5er 14 дней назад

@@justinkrawczak4929 I have done the similar thing. In my case I have connected the tables with the Join statement (without giving the schema for the tables) and stored the output in the form of JSON and then asked the question from the JSON.I am getting 90% accurate result. Wondering how can I fine tune more

@AbhinavKumar-tx5er 14 дней назад

Hi , How can we setup the temperature here?

@alexthecodewolf 14 дней назад

Hey, you can find information on how to do that here: github.com/ollama/ollama/blob/main/README.md#customize-a-prompt

@AbhinavKumar-tx5er 14 дней назад

@@alexthecodewolf Thanks :)