Thank you, that means a lot!

It's difficult to estimate hallucinations due to so many varying factors. However I'll just say anecdotally that the results for me have either generally been correct or just not worked at all (the SQL query doesn't work) - I'd have to setup a more rigorous test plan to estimate hallucinations better.

@@alexthecodewolf I took one approach by first storing the table in the form of JSON and then asking the question from the JSON. but again the things didn't go well . Is it I have to do something with the prompt?

Thanks! Chat history does count towards token history - anything you pass to the AI generally counts as tokens. The larger your token limit for a given model, the more history you could send, for example GPT-4 32k runs out faster than GPT-4 128k. Luckily the chat history is just a standard list, so whenever you send a prompt you can update your history list to only include the X number of most recent messages, whatever you think will fit in the token limit for your model. I believe the AI model auto-truncates the tokens provided and just ignores the excess but I'd have to double check on that. You could also store all the messages in one list for the user and for display purposes, but then just take the X most recent number of messages to actually send to the AI.

@@alexthecodewolf Thanks for such detailed answer.

Thanks, Do you mean how to use this same app/scenario but connect to non-Azure OpenAI, or do you just mean a general OpenAI or Azure OpenAI intro?

@@alexthecodewolf I meant 'general OpenAI or Azure OpenAI intro', tnx!

Thank you for alerting me of these issues - I was able to reproduce them from the GitHub repo. For the Server Static and Server Interactive, the issue was that there's no images folder included in the project by default so the file path for the upload doesn't work - I've added that folder and committed it to the repository. For the webassembly page, there was a missing handler method in the version on GitHub, so I updated that with the latest. these should all work now.

Yes, it can definitely be done in Node, there's an Azure OpenAI SDK for node and plenty of JavaScript UI frameworks.

Thank you very much!

Thanks for the visit

Hey, thank you - are you referring to the video that shows you how to chat with a database? ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-hw6oTjw9_Ro.html

@@alexthecodewolf Well , I am looking as how you have connected database using ollama in this video which starts from 10:20 sec. Do you have a github repository for this

Well , I have used to similar kind of approach too. Did you get any luck on this? Did your AI responded with the correct answer?

@@AbhinavKumar-tx5er Hi, yes! I've getting some pretty good results with the GPT-4o. I followed this tutorial to adapt to my case: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-9ccl1_Wu24Q.html

Thank you!

Thank you for the reminder, I remembered right after I published it 😆

Thanks for letting me know!

I believe current gpt models are limited to 128k tokens - I would recommend either breaking apart your schema to only the tables you need if possible, or searching for an AI model with higher token limits. There might also be local or self hosted models for code generation that support higher token inputs. I have some other videos about local ai models that show this database connection scenario

​@@alexthecodewolf​ Thank you sir

I don't have this video yet, but I'm planning to make one!

@@alexthecodewolf Thanks. Can you please give me some pointers on how to do it? All the chatbots deals with indexer and cognitive services.

Hey, I probably should have mentioned you have to apply for openai access, but it's fairly easy to get approved. If you can't get access you can also substitute the AI service with gpt-4 similar alternatives like standard openai instead of azure openai, or even local ai models that are specifically trained for code generation

Yep, local ai models support function calling.

@@alexthecodewolf Thanks, Can you showcase something or share any code article.

@@Ajmal_Yazdani You can find some examples in the semantic kernel docs at learn.microsoft.com/en-us/semantic-kernel/agents/plugins/using-the-kernelfunction-decorator?tabs=Csharp I would recommend using semantic kernel for local AI dev. Semantic kernel and more involved AI flows with local functions, plugins, services etc is a topic I plan on covering here in the near future. Semantic kernel is a big topic so I'm working on the best way to present tthat.

Thanks for the feedback and view!

Hey, thanks for the comment, there's already complete blazor courses on pluralsight by another author so I wouldn't be eligible to do that. I have thought about making one on RU-vid here of some sort but full courses are very time consuming and already exist on here as well, maybe at some point

@alexthecodewolf Yeah. But you don't get to learn all of it. Learning bit by bit on different RU-vid channels is difficult. Also, bootcams are way out of budget. I am from India, and platforms like Pluralsight help us with the volume of courses and also our pockets. I think this dilema will always remain. Thank you for your reply.

@@JtendraShahani Hey, you are correct that this is an ongoing challenge. As a self taught developer, I can relate. Many of the videos on this channel are oriented towards learners who already know the basics but are looking for guidance around new or specific topics so they don't have to watch additional courses, they can just supplement their knowledge on specific topics in shorter form content. However, I would like to get to the point where I have the time or incentives to create full courses on RU-vid. Thanks for sharing your thoughts on this!

Hey, yes it can work with local DB and on prem. You would just replace the connection string placeholders in the demo app with localdb connection strings. You could then use the same Azure AI service or you could use a local AI model - I just posted a couple videos explaining how to setup and connect to local AI if that's what you're looking for.

Also, I want to add that this is great content. Useful real-world examples like this will be golden as more people leverage AI in the enterprise landscape.

Thanks for the feedback! I'm not sure if I understand your original question though - are you asking about essentially just giving the AI a connection string or something so it can access the database directly?

Yes, exactly that. ​@@alexthecodewolf

@@justinkrawczak4929 As far as I know it's not possible to just give an AI a connection string and have it understand/explore a database. I think the closest solution I've seen to this is to add some kind of layer between the AI and the database, such as using a RAG solution where you connect the AI to a search service that has crawled your database, or using vector search capabilities to provide the AI with database data. I have a couple videos on my channel that explore these types of topics, but I don't know of any "Direct access" solutions.

Thank you, that really means a lot. Really trying to grow this channel into something big and deliver content that simplifies convoluted topics.

Hey, thanks for watching and providing feedback. This tutorial made some assumptions about coding knowledge with .NET or other languages, but I probably should have mentioned that up front. If you want to get started with .NET to recreate the code sample you can download visual studio here, which is the code editor I'm using that also installs .NET for you: visualstudio.microsoft.com/ You can then either clone the sample app from GitHub and just open it up in Visual Studio and follow along with the tutorial, or you can create a new project using Visual Studio and copy in the code. File -> New Project -> C# console app. Hope this helps a little bit!

I actually just made a video about this using Ollama, hah. It shows this same setup at the end using codellama ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-177qX6mpyMg.html The concepts in this video should work with any model that is skilled at text to code (such as code llama) and a SQL database of some sort. You'll have to experiment with different models and prompts to see which works best.

Hey, this should work using any powerful large language model and SQL based database, did you have a specific scenario in mind?

Thanks for this specific feedback - this is actually why I made the video. There was actually a good amount of .NET content at Build but it was sort of overshadowed by all of the AI, Azure, and tooling integration (copilots/analytics) news.