Create ChatBot Based On The Data Feed By You - GPT-Index | OpenAI | Python 

This tutorial truly stands out from the rest! After struggling with coding along other RU-vid tutorials on GPT-index and langchain, I finally stumbled upon this gem, and behold, my code worked like a charm. Thanks for sharing your expertise and making it easy to follow. You're a lifesaver!

Thank you, Shweta. I was able to get something working based on your code. Please note that lots of libraries are now outdated (gpt_index is now llama_index). My complete code (works 100%!): from langchain import OpenAI import sys import os from llama_index import SimpleDirectoryReader,GPTListIndex,GPTVectorStoreIndex,LLMPredictor,PromptHelper,ServiceContext from llama_index import StorageContext, load_index_from_storage def create_index(path): max_input = 4096 tokens = 200 chunk_size = 600 #for LLM, we need to define chunk size max_chunk_overlap = 20 prompt_helper = PromptHelper(max_input,tokens,max_chunk_overlap,chunk_size_limit=chunk_size) #define prompt llm_predictor = LLMPredictor(llm=OpenAI(temperature=0, model_name="text-ada-001",max_tokens=tokens)) #define LLM docs = SimpleDirectoryReader(path).load_data() #load data service_context = ServiceContext.from_defaults(llm_predictor=llm_predictor, prompt_helper=prompt_helper) vectorIndex = GPTVectorStoreIndex.from_documents( docs, service_context=service_context ) vectorIndex.storage_context.persist(persist_dir="storage") return vectorIndex def answerMe(): storage_context = StorageContext.from_defaults(persist_dir="storage") index = load_index_from_storage(storage_context) query_engine = index.as_query_engine() q = "What is the best plan?" print(q) print('------------') response = query_engine.query(q) print(response) #create_index('data') answerMe()

Hii, I am facing this error RetryError: RetryError[] while calling answerMe function, can you please help me out .

Please cover UI part as well in one of the coming video. Thank you so much in advance.

Hi, thank you for the video! I have tried this code to answer questions based on data about a very specific product. It answers well, however, it answers general questions as well (such as "What is Earth?") having no information at all about this in the files provided. How can I make this code answer based on the information that I provided only?

ImportError Traceback (most recent call last) Cell In[29], line 1 ----> 1 from gpt_index import SimpleDirectoryReader, GPTListIndex, GPTSimpleVectorIndex, LLMPredictor, PromptHelper 2 from langchain import OpenAI 3 import sys What should I do for this error???

Thank you. Is there a way to capture user inputs like contact details (email, name etc)? That would be really useful.

Hello, this tutorial is really amazing but i was trying to replicate the same work but got an error when executing the function createVectorIndex saying that the function __init__() in GPTSimpleVectorIndex got an unexpected keyword argument 'documents' did anyone get the same issue ?

Question about execution flow: Hi Sweta - Thanks for a very helpful tutorial. Trying to wrap my head around the execution flow. For example, createvectorIndex probably sends the document to openAI servers, the servers return embeddings that are then stored locally. During answerMe - is the prompt sent back to openAI for embeddings? Does answerMe again send document embeddings back to openAI servers? How much is done in the local process (on PC) vs how much is done by openAI servers? Thanks.

GPTIndex Medium link : medium.com/@shweta-lodha/create-chatbot-based-on-the-data-feed-by-you-gpt-index-openai-python-772291576bee LlamaIndex Medium link: shweta-lodha.medium.com/create-chatbot-based-on-the-data-feed-by-you-gpt-index-llamaindex-openai-3efd7abe3ed9 For PromptHelper and documents error: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-E6Fi2ZVkO1U.html

Hi Mam, Does this work today also? Gpt_index does not have any function?

Hi Shweta - I am planning to follow this tutorial, it looks amazing, I was wondering if you know if the local data we used is kept and is local only or if any of the data gets make public or goes back to OpenAI?

This Is old version so please update it getting many errors @sweta

Thank you so much for this! You made something very intimidating to me super easy to understand. I am very grateful for the time and effort your put into this video. Thanks a lot!

Hi Shweta, Awesome video, great learning. Thanks. Just one concern - when we grant access to ChatGpt to our custom data stored in our machine, then is there a risk that the data can be copied/ used by users of ChatGPT or Open AI or otherwise?

What is the token for? Is it limited to ask the bot? Is there a way it can be unlimited?

def _initialize_persistent_process(prompt: str) -> pexpect.spawn: ^^^^^^^^^^^^^ AttributeError: module 'pexpect' has no attribute 'spawn'...getting this error while importing the packages..please help

having data in a file and real time embeddings vs embeddings in a db for chatbot for an application (provides information about an application)?

@shweta-lodha, wonderful video and article. Thank You. Please keep up the good work. One qs: is there a way to implement the same solution using a web based solution - angular, react etc.

For me, this code was throwing an error. If you update the code by first importing ServiceContext from gpt_index (along with the other stuff you were already importing) and then update the code by adding the following lines, '-----#load data docs = SimpleDirectoryReader(path).load_data() service_context=ServiceContext.from_defaults(llm_predictor=llmPredictor,prompt_helper=PromptHelper) #create vector index vectorIndex=GPTSimpleVectorIndex.from_documents(documents=docs,service_context=service_context) --- it should solve your issue. P.S: I used this code from another one of your videos :))

I have implemented code, works perfectly, Thanks for that, I have question, it is just providing answer from context, Is gpt_index is all about context ? can not get general information like, who is trump or any other information? if there is way please help me with in this code

Hi Shweta, Very useful tutorial and I followed the same but m always getting the response None for any question, However I kept the document at same place where you have mentioned. Could you please help me out, what could be the reason for the same.

Hi, thanks for the great video. I'm a beginner. How do I proceed now that gpt_index has been replaced by llama_index? I'm getting the error "No module named 'gpt_index'

This looks like a brilliant tutorial thank you. Please excuse the silly question, but where are you editing your code, I opened IDLE but it must be some other editor/console? Thank you again.

Very good tutorial, one question if have some logs which contains sensitive data like ip etc, if I feed the logs to the llm will my data move out of my system to the llm model provider's server. If so is there a security threat. I have a presentation to make on using llm to my company and for sure this question will rise, any feedback will be appreciated

Hi Shweta, You did a great job. Can you please help me how to set that environment on which your are doing code.

i am getting this error while running code: Output exceeds the size limit. Open the full output data in a text editor--------------------------------------------------------------------------- TypeError Traceback (most recent call last) Cell In[17], line 1 ----> 1 vectorIndex = createVectorIndex('Chatbot') Cell In[14], line 16, in createVectorIndex(path) 13 docs = SimpleDirectoryReader(path).load_data() 15 #create vector index ---> 16 vectorIndex = GPTSimpleVectorIndex(documents=docs,llmPredictor=llmPredictor,prompt_helper=prompt_helper) 17 vectorIndex.save_to_disk('vectorIndex.json') 18 return vectorIndex

hi shweta your tutorial is really helpful and your knowledge on open Ai. i have also emailed you please reply

Thank you for this wonderful video🎉. I have a question when I was trying it. I run the codes to create vector index,but I cannot find it in the OSDisk. There is no error😂

@Shweta this is brilliant! as usual top notch like any of your other videos, thank you so much for taking time doing this. One question here, can you please provide the differences in the parameter if the same had to be achieved through Azure Open AI with openai.api_base, openai.api_type, openai.api_version, deployment_name - I have been trying to meddle with this but no luck so far..

Hi Shweta, that was a great tutorial! However, I have a question. Just like you used the custom data from the local disk here, How can we use the data from aws/elasticsearch?. I have a huge database (About 20 million records) which our employees access via querying on elasticsearch, and If I wish to create a custom chatbot trained on that data, how would one achieve that?

i got this error "TypeError: BaseGPTIndex.__init__() got an unexpected keyword argument 'documents'". dont know if i will get any assistance what the heck.

ImportError: cannot import name 'GPTSimpleVectorIndex' from 'llama_index'

Thanks a lot . Can we use llama_index instead of gpt_index ?

getting this error on line PromptHelper(): chunk_overlap_ratio must be a float between - and 1

could this learn from new unlabeled questions provided by the user ? Is this a trainable chatbot which could learn new things every time user asks a new question

Can u help in making similar bot for providing solution to accounts questions in step by step manner accurately!!!

HI Shweta Lodha! First... Thanks a lot for the tutorial! :) I have a problem with an error. Can You help me? I wrote the same code and use the same data. But when I try to run the code, this error appear: TypeError: __init__() got an unexpected keyword argument 'documents'. I Printed the variable and it contains the book text... The error is on the line: vectorIndex = GPTSimpleVectorIndex(documents=docs,llm_predictor=llmPredictor,prompt_helper=prompt_helper) I looked for it on internet but I didn't understand why there's a problem with the arg "documents"... :/

Hello Shweta Lodha, I have a couple of questions. Firstly, do you have any ideas on how we can reduce the cost of tokens? It would be really helpful if you could make a video explaining any potential solutions. Additionally, as a learner, I'm facing issues with expired APIs. Do you have any suggestions on how I can resolve this problem? Thank you in advance for your help.

ValueError: One of documents or index_struct must be provided. what i need to do with this error?

As someone just learned how to use GPT-4o Mini to write python code, your explanations are well done.

thanks for your contribution, it's easy to understand for a beginner like me. You can continue to make the next video to guide the question and answer continuously like chatgpt.

there is no longer GPTKeywordVectorIndex. There is GPTSImpleKeywordTableIndex() are they the same?

Hlo mam i have used the new Llam_Index but it also not working

Can I create a chat bot without Openai API key because my free trial is expired in OpenAi

Could you please provide me GitHub link for this project ?

Is my own data imported to openai system in this case? I don't want to breach the company's data confidentiality code.

Thank you so much Shweta! You got me so passionate on the topic. After completing your tutorial how do I move this into a chatbot that I can bring to my app? I’m stuck

I noticed that in the implementation shown in the video, the GPT model is being called every time a user prompt is received, and this can be expensive in a real-world scenario where the application is serving multiple users concurrently. Each request to the GPT model requires a certain number of OpenAI tokens, and this can quickly add up and become expensive.

Ma'am, will this code work offline. I mean not connecting to internet?

I got error gpt_index not found when I import it

HI! This is a very helpful tutorial. I have a question: How would you bring this to a website? I mean, creating a chat website where you can ask questions and the bot answers based on your custom data. Is it possible? Thanks in advance :)

hi Shweta, i tried this code on my end but in { vectorIndex.save_to_disk('vectorIndex.json') } is giving me an error so i tried { index.storage_context.persist('vectorIndex') } this is not creating a vectorIndex.json file on my system its creating a folder name vectorIndex.json inside which i has 4 json file docsstore, graph_store, index_store and vector_store.. can you pls tell me where i am going wrong

That's a great video thanks for sharing this. I have a question if you don't mind. How different is this method rather than using Open AI APIs for chat completion, embedding and completion? Thanks.

Hi when i run this code it is showing that the documents argument is unexpected

How to add this to a website

Thank you Swetha. It can’t get any better than your explanation with show and tell 👍

Hi Shweta, amazing job, hope you can help me: when running vectorIndex = create_index('Knowledge'), I get an error message: Output exceeds the size limit. Open the full output data in a text editor. maybe you know why?

Hi Shweta, this tutorial is amazing! I have one question after running the bot, on my OpenAI usage I am getting text-davinci requests as well as text-embedding-ada-002-v2. Any thoughts on why I am getting the davinci requests?

Hello, Shweta Lodha! Great job. I really love your videos. And I have a quick question: Do I have to have a paid GPT plan in order for the code to work?

Outstanding preparation and presentation. Thanks so much!

appreciate for your work, just wonder if this method works for extracting specific number ? like i want to extract some price for mutilple products

vectorIndex = GPTSimpleVectorIndex(documents = docs, llm_predictor = llm_predictor, prompt_helper=prompt_helper) This is not recognizing documents argument. vectorIndex = GPTSimpleVectorIndex(documents = docs, llm_predictor = llm_predictor, prompt_helper=prompt_helper) TypeError: __init__() got an unexpected keyword argument 'documents'

Thanks a lot great video , just want to know if all my data is stored in sharepoint how can i take them all into the same mechanizm u did thanks again for this great tutorial

hi shweta, does this take structured data like csv or excel for manipulate any data?

Please how to use ChatGPT code in wix

Hii need your help. I have followed exact same steps but facing below issue. I have given pip install gpt_index and got response same as shown in your video then when I am giving from gpt_index import SinpleDirectoryReader code then I am getting error Module not found “gpt_index” I tried uninstalling, re-installing and checking on chatgpt but failed for everything. Plz plz plz plz help

Hi, it seems I can’t find VectorSimpleIndex, has it been replaced by VectorStoreIndex?

Can you feed it more than 1 files?

Instead of files can we feed data from db?

people that use light mode scare me...

This is helpful, but how will I get it to the openai version, is there any way to upload my knowledge base to open ai, so that it will give me answer according to my needs?

Hi shweta, this is very helpful tutorial. I tried this code but after asking question, it is not responding...I waited for 15 minutes...still no response.

Hi @shweta Lodha - I followed all the steps mentioned in your videos. Also, followed this ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-E6Fi2ZVkO1U.html to fix errors but whenever I run the code to index the document i get rate limiting error. I have checked my openAI dashboard and I do not see any rate-limiting violations there

Thanks for the video but I have problem with the code After typeing: vectorIndex = createVectorIndex('Knowledge') it shows an error: --------------------------------------------------------------------------- NameError Traceback (most recent call last) Cell In[16], line 1 ----> 1 vectorIndex = createVectorIndex('Knowledge') may I know what to do?

madam, I am from India, after doing tons of research on ChatGPT API ,this is the best! I am working on Linux platform and have Jupyter notebook, will it work in that env?

I am having issues installing gpt_index. I install it using pip install but when I do a pip list I see gpt-index (note the hyphen). I then cannot import gpt-index. Has anyone faced this problem? Thank you.

This is really useful, Shweta! Thank you so much for making such an awesome content.

Hi, I done it with sucess! really thank you! However its possible to start one chat as the last part of the video and save where it stop and come back in other moment?

INFO:openai:error_code=None error_message='You exceeded your current quota, please check your plan and billing details.' error_param=None error_type=insufficient_quota message='OpenAI API error received' stream_error=False what if my new email account new API key free trial usage shown like this means what can I do am using newly by seeing your video but while executing it showing like this I tried other openai API key's also

@Shweta, Awesome video and Thanks for sharing.. I have data in CSV which has many text columns and many rows. I want to build chat application based on the data. Can you please let me know how can i implement this .

Mam it is use this without inter ah mam

Hi @shweta, can this bot integrate with any database..?

How to store the coversation history

I try to run this line but I got the error line vectorIndex = createVectorIndex('knowledge') --------------------------------------------------------------------------- NameError Traceback (most recent call last) Cell In[5], line 1 ----> 1 vectorIndex = createVectorIndex('knowledge') NameError: name 'createVectorIndex' is not defined

I am a beginner When using gpt chat, do I have to get the API from it, or can I get it from anywhere?

The code snippet that you have shared is not working. It always gives RateLimitError. Do you mind to have a look at it?

Post, llama-index replaced by gpt-index, I am getting the error during creation of vector index. Wondering if anyone else was also facing the same. INFO:openai:error_code=404 error_message='Resource not found' error_param=None error_type=None message='OpenAI API error received' stream_error=False

Hello and thanks for the video. Very useful. Is it possible to use a sphinx generated website (essentially a handful of html pages) as the resource documents instead of a plan txt file?

Hello, how to insert into new knowledge into json file?

can we access the api for free?

hey, any tips on how to fine tune a model based on a very large pdf document without the " " to split prompt/resolution? I thought maybe have a script break down in every question mark? Or is there some other way?

Hi, just want to ask if the data that I will feed will be exposed to public or to openAI? Is this safe for business? Thank you.

Hey so im wondering How I can create a interface once I have made my language model.

Can we add memory to this?

Hi shweta please tell which extensions you have used in VS code for this video

I have not found such a detailed explanation of Open AI based Chat bot, Thankyou for Sharing. Can you please make a video about how i can feed my NLP based ML model to create a Chat bot based on ChatGPT.

How do we load multiple data, and will the script and OpenAI remember the prior conversation?

thank you for this video. i keep getting the error: NameError: name 'createVectorIndex' is not defined. what am i doing wrong please

also getting this as well Output exceeds the size limit. Open the full output data in a text editor