No video :(

Chat with Your SQL Data Using ChatGPT

Подписаться 11 тыс.

Просмотров 81 тыс.

50% 1

In this video, we will use Open AI to chat with our SQL/Tabular data without writing any SQL query. We can ask any question about our database using conversation and the results will be retrieved and explained again without any coding.
☎️ Do you need any career or technical help? Book a call with me: calendly.com/m...
Part 1 - Chat With Your Data:
• Use Open AI (ChatGPT) ...
Part 2 - Chat With Your Data:
• Use ChatGPT On Your Ow...
Open AI+ Azure = Revolutionize the Way You Do Business
• Open AI+ Azure = Revol...
ChatGPT Came To Azure:
• ChatGPT Came To Azure!
Repo used in this video:
github.com/MG-...
*******************
LET'S CONNECT!
*******************
Join Discord Channel: / discord
✅ You can contact me at:
LinkedIn: / mohammad-ghodratigohar
Email: mo.ghodrati95@gmail.com
Twitter: / mg_cafe01
🔔 Subscribe for more cloud computing, data, and AI analytics videos
by clicking on the subscribe button so you don't miss anything.
#ChatGPT #OpenAI #SQL #GPT3 #GPT4 #machinelearning #cloudcomputing #chatbot #virtualassistant #customerservice #developers #technews #innovation #Microsoft #CognitiveServices #BotService #naturalanguageprocessing #NLP #conversationalAI #videotutorial #tutorial #learningAI #AIchatbot #AIassistant #AzureAPI #AzureTools #MG #Azure #LangChain

Опубликовано:

10 апр 2023

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 103

@funkedelic_bob Год назад

Really cool to see MG. However, I was hoping this was going to be more of an expansion on Part 2 and showing how to hook up a SQL server to Azure Cognitive Search. Would love to see a video on that :)

@blahblahblahblah8425 Год назад

This is gonna change the whole job of a data analyst to another LEVEL... Will try this and get back with doubts...👍 cool video

@80211Denver Год назад

I think I'm echoing what others are asking for: I have SQL 2016,2019 servers with multiple DBs. I would like an interface application similar to what you're using, I think. That interface can process the schemas of the databases and then help me form new queries and retune existing queries as required. As I see it, your python interface application is producing a local .db file as source material for your questions. I'm hoping the interface can leave the data in place -due to its size. I imagine with the schemas, ChatGPT or some other AI engine can loosely understand the goals and produce, test, refine queries for me to QA and work with. Perhaps this is not possible yet? I suppose another issue is privacy and how I can use the engine without exposing my private data.

@maciejgowacki5020 Год назад

Hi "MG", it would be good to see a film about basic Azure ML configurations. The problem I see is that Azure ML provides so many possibilities for teams working on a business solution that it can be confusing for beginners. Basically, Microsoft does not introduce a "standard"; you can use everything that is available in any way, for example, Databricks cluster, MLflow, bamboolib - a GUI for pandas - here you go, GitLab plus Databricks - no problem, ONNX, Feast, OpenAI - why not. In my opinion, this is a big drawback because at the "start," I have to choose tools myself (know the pros and cons of these solutions), and I have to have a solution architecture established. For example, should I use the Run class and methods (log, log_accuracy_table, log_list, log_predictions) or maybe MLflow?

@user-jt2nd4hq9i Месяц назад

Thanks MG for making such high quality content!

@somilmehta5929 Год назад

Hi MG, Can you please make a tutorial on how to connect it with SQL server as well.

@yusufkemaldemir9393 Год назад

@MG, how can you connect to existing server? Having SSMS, server name and lots of database in it. Without using/creating sqlite, can i directly connect langchain to existing SSMS? Thanks

@creneemugo94 Год назад

You can run a stored procedure that brings back only the data you want and just place the data in a collections object.

@dvenkatnath Год назад

Hey bro !, Amazing video and very clear explanation. Very clear and comprehensive. I tried and understood the works. Thank you.

@igorlaktic8891 Год назад

Hi, thanks for cool stuff. The shown example has tables with names that match the purpose, the same applies to the columns in the tables. In reality, tables can have names that are meaningful to the programmer, but that do not tell what data is in the table. The same applies to columns. Do you have a suggestion on how to install and in which place a translator that would instruct the AI what the purpose of the table is (what the data in it describes) and the same for each column in the corresponding table.

@ashishlogin Год назад

I am also looking for an answer. Great question! The solution can unlock many possibilities. I am a newbie here but I read there could be several langchain agents that can work together. In that case, we may feed all the logic in a vector db. Fire the LLM model, ask it to read the definition from a vector db and LLM will generate the sql query , and finally hit the sql db and return result to the LLM model. Not sure, but just an educated guess. waiting for an expert to reply. :)

@Elve11e 7 месяцев назад

That’s exactly what I was looking for thanks so much

@bitcoinjc 2 месяца назад

Can you maybe do a video where you show one of these models one can download, that is very good in SQL query creations and stuff like the video, that can also talk to a MS SQL database that is big. In other words, do something similar but not using ChatGPT where you have to pay for every large promnpt/result? This would be awesome.

@ChristianGUIDIBI Год назад

This I great thanks for sharing. Will try it and see if I can have it generate sql query to build complex report joining those tables

@sunny13sohom Год назад

Excellent video MG. Love the content. Only one query. If the data inside the table changes while we are conversing with ChatGPT, does the change reflect in the model's output ?

@olanrewajuadagba955 Год назад

How do i setup set-up MySQL in Visual Studio Code. Thank you for the video.

@TheOntheskies 6 месяцев назад

Thankyou MG, for the amazing video. A couple of questions 1. It appears that you need to send a list of all the table names to chatgpt for each query which will cost money. Is there a way to avoid sending it each time let ChatGPT remember at least for that session if not permanent 2. If I migrate my RDBMS data into a vector database, would it be an overkill? any chatGPT cost minimization pro/cons?

@CaribouDataScience 9 месяцев назад

Speaking of talking with you DB. What are you chances of you making a video on using the AskYourDatabase plugin for ChatpgtPlus.

@vijayakannanr2543 Год назад

Great Video, Is there a way to implement CRUD operations in the DB using Langchain and GPT? If the user types "I want to add a new artist", then the app should ask for the necessary details. Once the user enters the necessary details, it should create a new record in the Artist table.

@sagnikc3 10 месяцев назад

Hi @MG, thanks a million for the wonderful video. I am trying this on my SQL DB and I get the token limit error. Can you please share any solution on how to handle the issue when applying it on a large DB?

@djblstampdjblstamp5159 10 месяцев назад

Wow that’s an intro ☝️

@placement8059 7 месяцев назад

Can you please make a video on a multiple PDF Chatbot where the answers contain texts,images,tables from the pdfs and also tell the PDFs from where the answer is taken(citation)

@AmandeepSingh-lc9wh Год назад

Hi Thank you for the video. Can you please explain something on Database testing using OpenAI normal Language

@felipe.arce96 10 месяцев назад

Best intro ever!

@vinitmodi1 Год назад

Hi, Can we connect this to a MySQL database directly? Also can OpenAI help us in modifying the data?

@rameshh3821 3 месяца назад

Is it possible to get pie charts/bar charts using the chatbot? Basically, it should query data from SQL and plot graphs

@pramodhb2881 9 месяцев назад

Hi MG, Can we try something in the reverse direction. Example, given a query with lots of joins and aliases, can OpenAI figure out all the columns (both alias and real names) used in the query? Want to know which tables and columns are used in the query.

@scottwolfe6029 Год назад

Great video thanks. Question: What if your SQL schema has table names that are not intuitive. My ERP uses table names such as ABXXXXX for the payables...etc.

@hansalas Год назад

I would think if they have unintuitive names. Then the person has to type those unintuitive names in his input query as well.

@SiyaMedia Год назад

I wonder whether the model can use views since with a view you can rename the weird named columns

@younuskhan2841 Год назад

Why I'm getting this error after run this code: db = SQLDatabase.from_uri("sqlite:///./Chinook.db") toolkit = SQLDatabaseToolkit(db=db) agent_executor = create_sql_agent( llm=OpenAI(temperature=0), toolkit=toolkit, verbose=True ) ValidationError: 1 validation error for SQLDatabaseToolkit llm field required (type=value_error.missing)

@jjordalope Год назад

me too 😭

@nachopascual9085 Год назад

Excellent video!!! Is it possible to add memory to the agent so that it remembers the questions and reduce the number of tokens used in them?

@user-zi9cn9fx8m 11 месяцев назад

how can you connect to own sql server?

@user-tg8rt4us7i Год назад

This is amazing content MG. Thanks alot for sharing this!

@_megazz Год назад

I tried using this in a large database schema and I always go over the limit of 4096 tokens for any request. I guess this works in a small schema like this and where tables and columns have very descriptive names, but this is not the case for an enterprise database.

@Monsieurbungle Год назад

A data dictionary / catalogue which explains the tables and columns can be used to speed it up and reduce errors, I think.

@creneemugo94 Год назад

Use the embeddings api to narrow down the most relevant data. Search for youtube videos that explain embedding.

@SanjayRoy-vz5ih 11 месяцев назад

@@creneemugo94freecodecamp recently released a whole tutorial on vector embedding...fyi

@swetareddy8786 Год назад

Hi MG! The video was really helpful. Can I know in details about the same scenario if we have the column's content of the data table in the jsonb that is "key-value pair" format?

@Kabirsaxena-d7e Месяц назад

hi, thanks for this video. Can you suggest me how should i for it if i am using mongodb?

@dhemant859 Год назад

Hi MG, Is there any way to do this in dotnet (c#) with SQL Server. May be using Azure Cognitive Services with database. I tried a lot but did not find anything. Thanks

@bitcoinjc 2 месяца назад

Yes please I would like to know too.

@esamelkandro1542 Год назад

Thanks a lot MG!... Do you know how to connect Mongo DB with ChatGPT?

@bhaelen 10 месяцев назад

Really great video..! Question: I have an Azure SQL database. I had to use SQL Alchemy to connect to it from OpenAI, and it is working fine, albeit a bit slow. Is SQL Alchemy still the only way to connect from OpenAI or is there a way to connect directly? Thank you!

@kylecheung9302 Год назад

How would you go about building nuance so that GPT knows which tables to pull to answer the question? Say if my database is a fake bike database with 100+ tables and I ask show me all customers who bought mountain bikes, how would you tell GPT that it should actually use type = Mountain Bike and to use the right table?

@TheBigStride 8 месяцев назад

This is interesting, but when I actually implemented this on an active MySQL database that has any complexity to it, I was very disappointed in the output. This is still in its infancy unless you have a very simple database and need very little information out of it. From a cost perspective, it was definitely not worth it.

@farexBaby-ur8ns 5 месяцев назад

missing something..is there a sql agent loaded locally that you interact with which in turn accesses db? Do conv go outside local, to openai servers or are all this local (if not I dont like chatgpt learning my data and database structure)

@shriyasathish3422 7 месяцев назад

I know chatgpt doesn't have direct access to the database, it just generates sql query based on the input given, but does it save this information. Can I integrate this with organizational data. Does it raise privacy concerns ?

@Sachin-kk3np Год назад

Amazing!! I have a Doubt... Let's say I have created an environment where a user can log in, enter their query into the chat box, and ChatGPT will fetch the results from the database and provide them to the user, as shown in your video. Let's assume that my database contains income data, and since ChatGPT has access to data from all over the world, I use the income data from my database to fetch and do some analysis or reporting based on the tax policies of a particular country. The concern here is whether the data in the database can be leaked or put at risk in the open world While using ChatGPT.??

@abhinavSin Год назад

Same doubt!! @MG please explainnnnnnnnnnnnnn

@Prakash-oq5ke Год назад

Amazing. The code worked perfectly!

@micaelakulesz9387 Год назад

Hi! How can I retrain the model as to reduce the error in the translation natural language to query? Retraining is I guess almost absurd, but would you have any suggestion on how to correct these queries? For instance, I sometimes ask for an average and the query doesn't add a GROUP BY cluase.

@TheOntheskies 6 месяцев назад

Would we get better outputs if i move my RDBMS data to a db like Elastic Search?

@avicool08 Год назад

wow, this is really cool which will really help many of our scenario. Please share more of these kind of videos. Here you've linked with local SQLite, is there a way we can connect to external source in SQL Serverless in Synapse? (which has like GBs of data)

@AnuragKhareOracle Год назад

Hi MG, wondering if you have tested sequence of prompts (sql) one feed to others as part of analysis.

@akarkabkarim Год назад

The video I amazing but I have a question about chat GDP can replace the developers.

@ali57555 Год назад

very nice, thank you

@mombadj4486 Год назад

This is safe for our database? have risk to drop o changes database? How connect my db of Databricks to OpenAI?

@coolrock3733 Год назад

I believe that chatGPT doesn directly interact with your database. It just checks the meta information of your database, makes a query, and returns the query to you. From there you run the query on your device/server. In the example case, I believe the LangChain package is doing it for us. Correct me if I'm wrong though.

@dhayford92 Год назад

So I wanted to know how one can make AI response into json format . So let say I have an AI assistant which the user can ask it to help him to figure out some item for a party . I want the result to be like { “Ai_message”: “something here”, “Items”: [ #list of items here ] } And the Ai will get the results from SQLite database using Django framework or just python

@davidmichaelcomfort Год назад

This looks great. I would assume you do this thru Azure OpenAI too? Also, it would be great to see ChatGPT interact with tabular data in form of a CSV, pandas or pyspark dataframe

@LoneRanger.801 Год назад

Love your videos.

@inspiredteaching4468 Год назад

When I use Langchain to connect my sql database to Openai api do my private data becomes accessible to OpenAI? I am asking this in context to data security. Suppose I am building a chatbot for my client and use this architecture then is there a possibility that the data is exposed to OpenAI no matter they use it or not to train their models?

@thelist8850 Год назад

Brilliant! I love it.

@papariding5865 Год назад

Amazing, Thanks MG.

@user-vv5oh6fy2d Год назад

Hi MG! Nice video, that;s what I was looking for. Just one question, I am working in a company that make intranet system, so we have our own database and I guess servers. Can you please tell me what's the cost to setup this sort of system? Do you need to pay just openAI ? Would be great if you include pricing you need to set up the system! Btw +1 Subscribed ! :)

@user-xv1tz3ox6b Год назад

Hey, I have a question the gpt model has token problems you know we can use a limited number of tokens I mean we can not train a model with a large amount of data. Just we will need to divide it into smaller chunks. So does sql solve this issues I mean if I have a table of thousands of data and I ask question gpt to tell me about specific entry in database does I will get sane error or I can do that . Please answer . Thanks in advance

@CaribouDataScience 10 месяцев назад

Say, where did you get these spiffy jumpers?

@BREx1000 Год назад

Great video. Can I teach chatgpt to generate code in some custom script which it didn't see before?

@gnosisdg8497 Год назад

can you do it for gpt4all local installation to communicate with an sql like the example? if yes how ?

@inquizityofficial3272 Год назад

what is the privacy that we get from this. lets say we use this for company data then is this query / database accessible to others?

@TimYeyuqing Год назад

does this sql tables have to be relational tables? Can I use nosql for langchain?

@shivrajpurohit8632 Год назад

Hi MG! Nice video! Could you please help me with multiple tables? the problem is I am not able to read the data from multiple tables so please help me.

@101RealTalker Год назад

Is anyone familiar with Chris Harrison and the graph he achieved representing the dense cross references of the Bible? (I would include a link here but some people are weary of such clickables, but if you Google it it comes right up)... I am looking to achieve a similar output, from an input of 2 million words directed to a single project, anyone know how this could be achieved?

@121ashwani Год назад

how can I achieve this is MSSQL database

@MuhammadUsman-ix6jo Год назад

Hi there, Is that Possible using PHP and MySQL?

@maciejgowacki5020 Год назад

Microsoft does not support MySQL, and honestly, I don't know why. For example, Dataset only supports SQL Server. I have to load data using CSV or JSON files.

@coolrock3733 Год назад

hahaha same question, leaving this reply here in case someone answers.

@gunjanprajapati6435 Год назад

Do we have an example with Angular?

@jdoejdoe6161 Год назад

Please how can we connect with data on AWS dynamodb?

@Aidev7876 7 месяцев назад

is it possible to add memory to the agent?

@MehebubMukut Год назад

3:32 , But you shouldn't miss the starting, trust me. 🤣🤣

@LifeTravelerAmmu Год назад

Hello "MG" , great thanks !!!!......please make a video for connecting database (any database ) to huggingface model using langchain or anything .....THANK YOU 😊 without OPENAI_KEY

@Quenosoyyoo Год назад

is there a way to connect it to a SQL Server Management Studio database?

@adilmajeed8439 Год назад

Getting the following after cloning the repository locally " 1 validation error for SQLDatabaseToolkit llm field required (type=value_error.missing)", what i am missing here? This issue was raising by the interpreter at "----> 2 toolkit = SQLDatabaseToolkit(db=db)" line

@adilmajeed8439 Год назад

It was resolved by enhancing the following statement; " dburi = SQLDatabase.from_uri("sqlite:///Chinook.db") llm = OpenAI(temperature=0) toolkit = SQLDatabaseToolkit(db=dburi, llm=llm) agent_executor = create_sql_agent( llm=llm, toolkit=toolkit, verbose=True ) "

@amanshaikh7413 Год назад

@@adilmajeed8439 KeyError: 'tools' I'm getting this error after applying the above solution

@ProgrammerAaron Год назад

@@adilmajeed8439 Thanks, solved by your reply and saved me some time.

@faroukkassebi8414 Год назад

is there a way to connect it to a PosgreSQl DB?

@user-sj1mr4ug3s Год назад

How I can create multiple chats like the ChatGPT where every Chat have own chat history? Please anyone who can help me.

@therav2007 Год назад

Hi MG I want to do natural language prompts against IoT data that's stored in timescaledb (postgres)

@wakeeltalk8380 2 месяца назад

did you figure it out?

@pylanookesh8227 Год назад

Can we connect this to KUSTO databases ?

@azeezullasheriff7746 Год назад

How to connect the sql server to chatgpt,

@younuskhan2841 Год назад

Can you please help me from out of this below error: ValidationError: 1 validation error for SQLDatabaseToolkit llm field required (type=value_error.missing)

@vasubabujinagam5977 Год назад

Change to this: llm = OpenAI(temperature=0) db = SQLDatabase.from_uri("sqlite:///./Chinook.db") toolkit = SQLDatabaseToolkit(db=db, llm=llm) agent_executor = create_sql_agent( llm=llm, toolkit=toolkit, verbose=True ) instead of db = SQLDatabase.from_uri("sqlite:///./Chinook.db") toolkit = SQLDatabaseToolkit(db=db) agent_executor = create_sql_agent( llm=OpenAI(temperature=0), toolkit=toolkit, verbose=True )

@Jonathan-ih9sm Год назад

@@vasubabujinagam5977 god bless u bro I was so annoyed and this worked

@Charango123quena Год назад

I can't see this working .. There's no way any company will ever open its data to Chatgpt

@didieranastaseleon8146 11 месяцев назад

i worry about him

@stephenpeters4590 Год назад

This sure looks pretty neat, but I'm running into an error. Ubuntu 22.04, Python 3.10.6, langchain 0.0.198 In cell 8 of the notebook: agent_executor.run("Describe the playlisttrack table") Error in on_chain_start callback: 'name' --------------------------------------------------------------------------- AuthenticationError Traceback (most recent call last) Cell In[8], line 1 ----> 1 agent_executor.run("Describe the playlisttrack table") ...and then many, many more lines in the error message. Anyone know what's going on here?

@failure__is__my__hobby Год назад

Hello "MG" , great thanks !!!!......please make a video for connecting database (any database ) to huggingface model using langchain or anything .....THANK YOU 😊 without OPENAI_KEY