How to use Azure OpenAI on your Data with Copilot Studio 

Connect with me: ☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie 🦉 Learn more about AI: aka.ms/learnwithlisa 🖇 LinkedIn: www.linkedin.com/in/lisa-crosbie/ 📼 TikTok: www.tiktok.com/@lisa.crosbie 🐦 X (Twitter): twitter.com/LisaCrosbie 📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps www.linkedin.com/learning/microsoft-power-platform-fundamentals-pl-900-cert-prep-power-apps/

This is one of the best Copilot Studio + OpenAI integration demos I've seen so far! Even better that what the official MSFT documentation has to offer. Thank you so much Lisa for putting this amazing content together.

Hey Lisa! Thanks a bunch for this, it's quite painful to go through all this with just documentation haha. Your videos have been super helpful and informative!

Very informative, thank you for that video! The most thing that I learn from you, not only Copilot Studio and Azure AI Studio, but how to simplify sophisticated scenarios and use cases to link between business world and technical world, very appreciated.

Fantastic tutorial. I'm going to try implement copilot. I made a chat in the PVA, as you said, I had to build all topics manually in previous version. But now it seems so easy to create and more effective. Thank you for teaching.

Thank you Lisa!! Fantastic video and exactly what I have been looking for

Thank you for this! I'd love to see more on taking things to the next level!!

Thanks for the video. I am a dev myself and i'm trying to learn low code RAG stack. This is wonderful and helped me consolidate my ideas.

Fantastic video thank you, waiting for the SPO one :)

Thanks @lisa! I need to get to learning Copilot Studio!! I'd love to learn what this fabric thing is too!!

Thank you Lisa, your videos makes me learn things faster than going through documentation. And as you mentioned I'm interested in detailed videos on copilot studio with azure studio.

This video describes a game changer! Thank you!

Great video and it can be used in many organization. Thanks for sharing.

Very good Lisa! Yes more content please, especially around pdf uploads

Great content. Learnt alot in 15 minutes!

This is great: a low-code RAG setup combining Azure OpenAI, AI/Cognitive Search, Sharepoint or Blob Storage. No more rolling your own by gluing together different vector databases, embedding models and large language models and hoping it all works.

Nice and chill explaination.

How can we test this. How to setup formal tests. How to evaluate the quality of a specific setup and choose the best solution quality/cost. Great video. Very inspiring

Hello Lisa, the video content is wonderful. I was looking for this solution, but it's hard to find even in English, let alone in Portuguese, my language. I work in a multi-family office with process management, and AI is breaking the paradigm. I've done some things with AI Builder, but there are certain limitations. Thank you very much for the content, and I would love to delve deeper. I'm building a model where employees will insert the descriptions of their processes via Power Apps in a structured way, and AI will unify it into a single content, being the brain of the company. From this point, we will have an unimaginable gain in business management, knowledge, and change... and much more. I'm very excited about all this. Thank you very much.

Awesome!

Good demo

Hi it was Great video loved it. Does the create generative answer return only maximum of 3 references.

Great video!!! what I want to know is when you ask an AI question, how do you know whether he is using his own connected Azure OpenAI model or a built-in model?

Thanks Lisa, very illustrative, can I integrate the new Copilot created from Powerapps or from a Web Application, or can I only use it from Copiloit Studio?

Thank you for the video, Lisa! Is it fairly straightforward to then host this copilot on a Sharepoint site?

Great video. Is it possible to connect to a data model that is in Fabric?

Super clear and concise! Just one question though, wouldn't be better to have a centralize place for a Copilot design? It's super confusing which tools are the right ones to develop a simple copilot: - Copilot studio - Open AI studio - Power apps - .. azure AI resources. I think it would be amazing to have a simple, centralized place for all AI experience. If you can make a video explaining each tool, that would be super helpful! Thank you!

Thanks for sharing the valuable topic, I am definitely going to try the hands on it as I have the use case ready and was waiting for client approval :D

This was so informative, thank you Lisa. I'd love to see a video with Sharepoint as the data source, and perhaps using Power Automate and the Graph API to extract the data and push it forward into Generative Answers. I'm hoping that something like this would "get around" the two levels down search limitation for Sharepoint. Thoughts??

Great demo @LisaCrosbie. My AI Studio only has a "Export to as Web App". Am I doing something wrong?

Hi, thanks for the great video! I've been testing Azure OpenAI on your Data, as well as 365 Copilot (mainly 365 Chat) and comparing the performance for the purpose of getting quick answers to information contained in PDFs (and other types of documents as well). 365 Copilot Chat does okay with general questions ("Summarize this document", "What are the main takeaways of this contract?"), but really struggles with more precise questions ("What is the agreed bonus on this contract?", "What are the special clauses pertaining to confidentiality in this document?"). FYI, I use it mainly with PDFs stored on a SharePoint team site. In comparison, Azure OpenAI on your Data is much better. It is able to answer with great precision on even the most specific questions. Why do you think that is? I was under the assumption that Microsoft would use the capabilities present in "Azure OpenAI on your Data" for their 365 Copilot. Do you think it might improve with time, until we actually get the same performance on both? Thanks !

Excellent Lisa! So, we can say that you connected a GTP-4 model to your copilot, right? in that case, if you ask something that is not in the data source, for example: "what is the number of countries in Asia ?" the chatbot will be able to answer that? I´m interesting in creating a chatbot in Copilot Studio that uses GPT-3.5 turbo model enhanced with some data, so if I ask the chatbot about the data it will give some references but if I ask the chatbot about a general question, like the example above, it will be able to answer that too

Thank you for the great explanation. I have question here. I am working at a cloud billing position and hope i can use azureAI and copilot studio instantly for my tasks.(overview each subscription's monthly and annual cost / automatically make an esimate) Is it possible for now or impossible since it says it's only preview version?

The room details are not showing up in the mapping field. Is it because its a complex type?

Would be great to see a video where multiple copilots created in this form can work cooperatively.

That's a great video, Lisa. However, can Microsoft Copilot Studio chatbot both use custom data for specific info like order tracking and be conversational (using an LLM or GPT)? For instance, offering choices like: "Your order is damaged. Would you prefer a refund or a replacement?

Thank you for this insightful video! It's been just as helpful as your previous ones. However, I'm encountering an issue that I can't seem to pinpoint the source of. In Azure Open AI Studio, there are two possible ways to deploy your chatbot with your own data : through the web application or using the Copilot studio. Yet, I'm facing some confusion. It's my understanding that the Copilot studio utilizes a connection with Azure Open AI. So, why are the responses different between these two methods? The index that was created from the indexer that point to a blob starage with documents, deployment model, and all parameters remain consistent. What could be the reason behind these differing responses, or even worse, the lack of response to certain prompts?

what is the significance of Azure bot service now ? when and how it can be used in conjunction with copilot studio ?

Thank you for the great tutorial. However, how to build a Copilot chatbot in Power BI that can answer questions based on the data we use in the Power BI report? Because the copilot currently available in Power BI can only answer simple questions and create simple summaries based on existing visualizations. Thanks in advance, Lisa!

is there any way to skip the OpenAI resource here? Could I directly connect an Azure AI Search resource with Copilot Studio?

Brilliant video. I'm getting my license to Copilot studio this week and I'm very excited to test it out. For this video, what other licenses did you need to achieve this? I thought I saw Visual Studio Enterprise on screen at one point. Thanks!

Thank you. How can we publish it as rest API so we can connect it through own web not in copilot studio?

we need to integrate the questions and answers to be voice to your created system workflow

I have a content website that has multiple layers of subpages which have content on webpage. How do I ensure that the right subpage is picked based on the chat context. For example - country details with pages by country and based on the chat how can I ensure it determines the right country and accesses the right page?

Hi Lisa, Do you have any information on the additional costs of the Azure Open AI integration to Copilot Studio?

it would be great to see an implementation with data from PowerBI or Where the PVA uses Flow as a skill to complete an action

Hi Lisa, Can you work video also for SharePoint source only and please focus on API permission . especially Sites. Selected Permissions.

Hello, thanks for the video. I am currently working on a project and i am finding a big issue. I would like to know from your expertise to see if there is a possible solution. I have documents with sensitive data that i have to extract, however it seems that the new security features do not allow to extract names, dni, nif, etc. Some months ago this solution worked but now, not anymore. Do you know if there is any way to fix it? Thank you so much, i hope you or someone can help me.

Hi Lisa, thanks for the video. If I use a excel file or JSON or CSV file as my data in the method you mentioned, would copilot be able to do accurate calculations on the data. I'm asking this because, I uploaded my excel data as knowledge to copilot and its replies were all wrong when I asked it questions. Would Indexing the data and then passing it to copilot improve the results? Thanks for replying.

How I can integrate on prem. Confluence site with copilot studio chat bot? Is there any easy solution?

Great video, Lisa. I am new to your content and really enjoyed the knowledge. Could you zoom in next time so that we can see what you are working on more clearly? You know, for us 40-year-olds, lol!

Fantastic video; it would be amazing if you could do a video using Sharepoint as your data source.

Nice 😊 Can we use the Azure AI search for multiple bots or one AI search per bot?

Hey @LisaCrosbie. I am trying to implement it but I do not get Azure OpenAI option when I deploy my OpenAI model to Copilot Studio and add Conversational Boosting Topic. Would you please guide me? Thanks in advance

How do you create an index with multiple tables? The Azure Search Service only allows you to select a single table or view, but in your demo you have multiple tables in the index. How did you manage that? I would like to build something similar so that I can compare sales over years for our artists/products and compare sales to budgets, etc..

Hi thanks for the tutorial - it is really useful. somehow I am not able to add OpenAI connection in copilot - are you entering it manually (14.35 frame) ? there must be connection

Does this work with relational database ?

„No more darkmode, I’m afraid“ 😎

Hi Lisa, thanks for the video. I tested it for myself and somehow the topic "conversational boosting" is not created automatically when i deploy it from Azure OpenAI Studio. Do you have any tips to get it working?

Hi Lisa, Great content as always!! For some reason I am unable to get the Connection to register in Copilot Studio after completing all the other steps. I know that it goes to Default and have seen ways to get past that (unsuccessfully though). Can you point me in a direction here, video or any other points I might be missing?

Hey Lisa! I noticed that for you the connection was automatically made, when my copilot is created nothing is automatically made, do you know why this is the case?

If you have an existing Copilot studio chatbot...is it possible to connect to Azure OpenAI + your grounding data (located in Azure AI Search) from Copilot Studio rather than using the Deploy to CoPilot feature?

Lisa, what tool(s) do you use to make your videos?

i want to make copilot studio make learn how is it possible

Hello Lisa, I tried to do the exaxt same steps as you did in te video, but the copilot doesnt work properly, the system topic about conversational bossting does not appeard and when i tried to do the topic manually the conecction doesnt work as is should, because all the details like the Deployment are in blank, could it be because im in Europe? thanks in advance

Would you please export conversational boosting topic as it is no longer available for me in my Environment

Thanks for the video, very helpful. However, after I publish to Copilto Studio from OpenAI portal, the OpenAI connection isn't appearing under the data sources. Additionally, when I attempt to add the connection manually, it displays "No connection to show." . Any idea what might be the reason?

Kindly provide a video for sharepoint online as datasource please

Found one issue in this. It seems having access to Azure OpenAI Studio is beyond the limits of most of us mere mortals. 🙂 Those of us not coming through an org or being an MVP/RD Will have to wait for it to become truly publicly available.

Just giving a heads up to anyone trying to follow this tutorial. Using the exact steps in the video the responses are very poor outside of the one shown in the video. Asking about different states and cities returns Hotels from wrong states, and none of the data outside of the descriptions are accessible by the model, making almost all the data in the table useless.

Good bye data scientist!. You know what?. Thanks for training our ai. Now you can be an ordinary worker. Ups here come tesla robots. Well maybe a youtuber... Ups geminy, sorry

Awesome !