Here is my little 2 cents', can you do an end-to-end tutorial on how you do this, including creating Azure AI Service, Azure Storage as well as the coding part? 😅😅😅
Amazing video! One question, if you have the data source a blob storage, if you delete a pdf file from that blob storage, when you run the indexer is the reference and information about this deleted document deleted from the index as well? thanks!
The data is stored in the Azure AI Search index. Please note that if we have to remove a document from the index, we have to delete it from the index. Please also note that in the file upload_docs.ipynb, the function remove_from_index can remove documents from the index
@ankan54 . Please have a look at the video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-qJl3IdCKfvE.html where we discuss the following RAG with Azure AI Search with Azure OpenAI with different search techniques and Langchain with Conversation Chain, Prompt Template and Conversation Buffer 📍 Vector Search 📍 Hybrid Search 📍 Exhaustive KNN Search 📍 Hybrid Search with Semantic reranking 📍 RAG with Azure AI Search with Azure OpenAI 📍 Use Langchain with Conversation Chain 📍 Use Langchain with Prompt Template 📍 Use Langchain with Conversation Buffer
Sir I have one doubt, like we are using Azure Cognitive search and the index updates everyday midnight. So we have both new content and old content with us. Now what I want is to retrieve the most recent content first and than old content. How can I implement it?
Please watch the following for VECTORS 1. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-BOPVh-0NM8U.html - Vector , Hybrid, Semantic search with Azure AI Search in 11 minutes 2. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-qJl3IdCKfvE.html -RAG With Azure AI Search using Vector/ Hybrid / Exhaustive KNN / Semantic Reranker in 15 minutes
Thanks for such a detailed content. Is the uploaded data going to private ? will that data be trained with open source LLM's . How to add extra layer of security to make sure that the uploaded data is within my private GPT
Hi Ambarish, thank you for the very helpful video! I have an enquiry and I hope you could help me with it. So, on the Azure Platform, I have created a a Search Service and an OpenAI Service and connected both in order to be able to ask questions about the data stored on an index. The data is in a Blob Storage container that has multiple folders in it. What I want to do when searching for information, is to filter the folders; I want to choose the folder (either by name or path), so that the search service only returns the content of that folder, and then the openAI service uses that content as a reference to generate an answer to my question. Do you know how I could do that?
In the code we have added metadata while putting data into the search index. Please add your customized metadata while putting the data into the search index. While doing the Search on Azure AI , we should provide the filter with the proper metadata and it should filter accordingly. Hope this helps. May be I should so a followup video explaining this in detail. Thanks again for your questions.
@@ambarishg Thank you so muh for your reply! IT would be perfect if you could show us how to do it. If you can, please show us how to do it on Azure and through code. (I use either Python or C#) Thanks again!
1:01 Is Azure search is or acts like a vector database that keeps the knowledge? Please clarify I have seen several videos but confused on this question.
Great video! Very helpful. Instead of azure AI search, if I wanted my retriever to be Qdrant, would it be possible? I have a few files in Qdrant and would like to use Azure open AI to get the output from Qdrant and give the result to the user. If possible, how could I do it?
Yes you can! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE--53xYR6yQAY.html This shows RAG with QDRANT [ RAG with Opensource Tools - Qdrant and Mistral in 6 minutes ]. You may please modify this for Azure Open AI
