How to use Azure OpenAI on your Data with Copilot Studio
ฝัง
- เผยแพร่เมื่อ 18 ก.พ. 2024
- You can use Azure OpenAI on your data to add sophisticated AI search capabilities, and then deploy that into Copilot Studio, connecting up your low copilot with Azure AI resources and the latest GPT large language models.
This video takes you end to end through how to set this up:
- Deploy your Azure resources
- Add and index your data using Azure AI Search
- Deploy a model in Azure OpenAI Studio and connect your data
- Deploy your model to Microsoft Copilot Studio
-------------------------------------------------------
Connect with me:
☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie
🦉 Learn more about AI: aka.ms/learnwithlisa
🖇 LinkedIn: / lisa-crosbie
📼 TikTok: / lisa.crosbie
🐦 X (Twitter): / lisacrosbie
📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps / microsoft-power-platfo... - วิทยาศาสตร์และเทคโนโลยี
![CAMPปลิ้น | EP.75[1/2] ชวนแร็ปเปอร์เที่ยวประแสแบบไม่ต้องตามกระแส](http://i.ytimg.com/vi/J5ds2AxDp24/mqdefault.jpg)
Connect with me:
☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie
🦉 Learn more about AI: aka.ms/learnwithlisa
🖇 LinkedIn: www.linkedin.com/in/lisa-crosbie/
📼 TikTok: www.tiktok.com/@lisa.crosbie
🐦 X (Twitter): twitter.com/LisaCrosbie
📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps www.linkedin.com/learning/microsoft-power-platform-fundamentals-pl-900-cert-prep-power-apps/
This is one of the best Copilot Studio + OpenAI integration demos I've seen so far! Even better that what the official MSFT documentation has to offer. Thank you so much Lisa for putting this amazing content together.
Hey Lisa! Thanks a bunch for this, it's quite painful to go through all this with just documentation haha. Your videos have been super helpful and informative!
Fantastic tutorial. I'm going to try implement copilot. I made a chat in the PVA, as you said, I had to build all topics manually in previous version. But now it seems so easy to create and more effective. Thank you for teaching.
Thank you Lisa!! Fantastic video and exactly what I have been looking for
Thank you for this! I'd love to see more on taking things to the next level!!
Thank you Lisa, your videos makes me learn things faster than going through documentation. And as you mentioned I'm interested in detailed videos on copilot studio with azure studio.
Thanks for the video. I am a dev myself and i'm trying to learn low code RAG stack. This is wonderful and helped me consolidate my ideas.
Very good Lisa! Yes more content please, especially around pdf uploads
Great video and it can be used in many organization. Thanks for sharing.
Thanks @lisa! I need to get to learning Copilot Studio!! I'd love to learn what this fabric thing is too!!
Hello Lisa, the video content is wonderful. I was looking for this solution, but it's hard to find even in English, let alone in Portuguese, my language. I work in a multi-family office with process management, and AI is breaking the paradigm. I've done some things with AI Builder, but there are certain limitations. Thank you very much for the content, and I would love to delve deeper. I'm building a model where employees will insert the descriptions of their processes via Power Apps in a structured way, and AI will unify it into a single content, being the brain of the company. From this point, we will have an unimaginable gain in business management, knowledge, and change... and much more. I'm very excited about all this. Thank you very much.
This video describes a game changer! Thank you!
This is great: a low-code RAG setup combining Azure OpenAI, AI/Cognitive Search, Sharepoint or Blob Storage. No more rolling your own by gluing together different vector databases, embedding models and large language models and hoping it all works.
That tech is so 2023! 😆
Fantastic video thank you, waiting for the SPO one :)
Great content. Learnt alot in 15 minutes!
Thank you for the video, Lisa! Is it fairly straightforward to then host this copilot on a Sharepoint site?
Thanks Lisa, very illustrative, can I integrate the new Copilot created from Powerapps or from a Web Application, or can I only use it from Copiloit Studio?
Hi it was Great video loved it. Does the create generative answer return only maximum of 3 references.
Hi, thanks for the great video!
I've been testing Azure OpenAI on your Data, as well as 365 Copilot (mainly 365 Chat) and comparing the performance for the purpose of getting quick answers to information contained in PDFs (and other types of documents as well).
365 Copilot Chat does okay with general questions ("Summarize this document", "What are the main takeaways of this contract?"), but really struggles with more precise questions ("What is the agreed bonus on this contract?", "What are the special clauses pertaining to confidentiality in this document?"). FYI, I use it mainly with PDFs stored on a SharePoint team site.
In comparison, Azure OpenAI on your Data is much better. It is able to answer with great precision on even the most specific questions.
Why do you think that is? I was under the assumption that Microsoft would use the capabilities present in "Azure OpenAI on your Data" for their 365 Copilot. Do you think it might improve with time, until we actually get the same performance on both?
Thanks !
Great video. Is it possible to connect to a data model that is in Fabric?
Good demo
This was so informative, thank you Lisa. I'd love to see a video with Sharepoint as the data source, and perhaps using Power Automate and the Graph API to extract the data and push it forward into Generative Answers. I'm hoping that something like this would "get around" the two levels down search limitation for Sharepoint. Thoughts??
Awesome !
Excellent Lisa! So, we can say that you connected a GTP-4 model to your copilot, right? in that case, if you ask something that is not in the data source, for example: "what is the number of countries in Asia ?" the chatbot will be able to answer that? I´m interesting in creating a chatbot in Copilot Studio that uses GPT-3.5 turbo model enhanced with some data, so if I ask the chatbot about the data it will give some references but if I ask the chatbot about a general question, like the example above, it will be able to answer that too
Super clear and concise! Just one question though, wouldn't be better to have a centralize place for a Copilot design? It's super confusing which tools are the right ones to develop a simple copilot:
- Copilot studio
- Open AI studio
- Power apps
- .. azure AI resources.
I think it would be amazing to have a simple, centralized place for all AI experience. If you can make a video explaining each tool, that would be super helpful!
Thank you!
Great demo @LisaCrosbie. My AI Studio only has a "Export to as Web App". Am I doing something wrong?
Great video, Lisa. I am new to your content and really enjoyed the knowledge. Could you zoom in next time so that we can see what you are working on more clearly? You know, for us 40-year-olds, lol!
Oh, i feel that pain too - noted for future, thanks.
That's a great video, Lisa. However, can Microsoft Copilot Studio chatbot both use custom data for specific info like order tracking and be conversational (using an LLM or GPT)? For instance, offering choices like: "Your order is damaged. Would you prefer a refund or a replacement?
Brilliant video. I'm getting my license to Copilot studio this week and I'm very excited to test it out. For this video, what other licenses did you need to achieve this? I thought I saw Visual Studio Enterprise on screen at one point. Thanks!
No other Power Platform licenses, but you would need Azure credits or pay for Azure consumption against the Azure resources you deployed.
Yes, you need an Azure Subscription (mine is called Visual Studio Enterprise), and then you pay for whatever yo consume, the Azure AI Search resource here has varying prices depending on how complex your data and search needs to be. Then you pay for the usage of whatever model you deploy in OpenAI Studio.
What is the pricing like?? Any realistic numbers given a scenario where u use it the whole month?
Thank you for the great explanation.
I have question here. I am working at a cloud billing position and hope i can use azureAI and copilot studio instantly for my tasks.(overview each subscription's monthly and annual cost / automatically make an esimate)
Is it possible for now or impossible since it says it's only preview version?
Thank you for this insightful video! It's been just as helpful as your previous ones. However, I'm encountering an issue that I can't seem to pinpoint the source of.
In Azure Open AI Studio, there are two possible ways to deploy your chatbot with your own data : through the web application or using the Copilot studio. Yet, I'm facing some confusion. It's my understanding that the Copilot studio utilizes a connection with Azure Open AI. So, why are the responses different between these two methods? The index that was created from the indexer that point to a blob starage with documents, deployment model, and all parameters remain consistent. What could be the reason behind these differing responses, or even worse, the lack of response to certain prompts?
Would be great to see a video where multiple copilots created in this form can work cooperatively.
Thanks for sharing the valuable topic, I am definitely going to try the hands on it as I have the use case ready and was waiting for client approval :D
Awesome, good luck!
Thank you for the great tutorial.
However, how to build a Copilot chatbot in Power BI that can answer questions based on the data we use in the Power BI report? Because the copilot currently available in Power BI can only answer simple questions and create simple summaries based on existing visualizations. Thanks in advance, Lisa!
it would be great to see an implementation with data from PowerBI or Where the PVA uses Flow as a skill to complete an action
Getting data from Power BI would require AI to be good at writing DAX (unless you’re pre-baking all the queries). Maybe we will get there soon. 😅
Power BI has its own natural language/Copilot experience, i'd be looking at that rather than trying to build it. Or else connect this (PVA) Copilot to the original data source underneath Power BI.
Hi Lisa, Do you have any information on the additional costs of the Azure Open AI integration to Copilot Studio?
Here's the pricing azure.microsoft.com/en-au/pricing/details/cognitive-services/openai-service/
Fantastic video; it would be amazing if you could do a video using Sharepoint as your data source.
Working on it! Thanks.
Nice 😊
Can we use the Azure AI search for multiple bots or one AI search per bot?
It should work to add the same AI search to multiple bots. In each bot go into the Conversation Boost topic and edit the data source and select your Azure OpenAI deployment.
Hi Lisa,
Great content as always!!
For some reason I am unable to get the Connection to register in Copilot Studio after completing all the other steps. I know that it goes to Default and have seen ways to get past that (unsuccessfully though).
Can you point me in a direction here, video or any other points I might be missing?
BTW, I am unable to create a new Azure Open AI Connection in Power Plat
At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413
what is the significance of Azure bot service now ? when and how it can be used in conjunction with copilot studio ?
Hi thanks for the tutorial - it is really useful. somehow I am not able to add OpenAI connection in copilot - are you entering it manually (14.35 frame) ? there must be connection
At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413
The room details are not showing up in the mapping field. Is it because its a complex type?
Hey @LisaCrosbie. I am trying to implement it but I do not get Azure OpenAI option when I deploy my OpenAI model to Copilot Studio and add Conversational Boosting Topic. Would you please guide me? Thanks in advance
Hello, thanks for the video. I am currently working on a project and i am finding a big issue. I would like to know from your expertise to see if there is a possible solution. I have documents with sensitive data that i have to extract, however it seems that the new security features do not allow to extract names, dni, nif, etc. Some months ago this solution worked but now, not anymore. Do you know if there is any way to fix it?
Thank you so much, i hope you or someone can help me.
I have a content website that has multiple layers of subpages which have content on webpage. How do I ensure that the right subpage is picked based on the chat context. For example - country details with pages by country and based on the chat how can I ensure it determines the right country and accesses the right page?
is there any way to skip the OpenAI resource here? Could I directly connect an Azure AI Search resource with Copilot Studio?
Hi Lisa, thanks for the video. I tested it for myself and somehow the topic "conversational boosting" is not created automatically when i deploy it from Azure OpenAI Studio. Do you have any tips to get it working?
At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413
@@LisaCrosbie thanks for the link. yeah I'm outside the US. When clicking on the deploy to Copilot Studio button it is directing me to the correct environment and a connection is automatically created. Just the automatically created chatbot is not getting the "conversational boosting" topic automatically. I can enable the conversational boosting in the chatbot settings, then it gets created. In the create generative answer activity I can select the azure open connection, but it is not working. I always get an empty response back. Do you have any advice for that?
Lisa, what tool(s) do you use to make your videos?
I have a Shure M7 microphone, Elgato Facecam, one Elgato key light, Camtasia for recording and editing. The microphone and webcam are recent upgrades, I did everything for the first 3 years with a Logitech C920 webcam and blue yeti microphone. Nothing fancy.
@@LisaCrosbie Excellent. Thank you. Seems Camtasia has come a long way since the last time I looked at it. Well done.
How I can integrate on prem. Confluence site with copilot studio chat bot? Is there any easy solution?
Hey Lisa!
I noticed that for you the connection was automatically made, when my copilot is created nothing is automatically made, do you know why this is the case?
At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413
Hey @@LisaCrosbie
Thanks for the reply! I took a look at the article and it still does not work as expected in the france central env. It also specifically states: "as of now, only environments located in the US region can have that feature)"
Did you also deploy your Copilot on an EU env or an US one?
we need to integrate the questions and answers to be voice to your created system workflow
Thanks for the video, very helpful. However, after I publish to Copilto Studio from OpenAI portal, the OpenAI connection isn't appearing under the data sources. Additionally, when I attempt to add the connection manually, it displays "No connection to show." . Any idea what might be the reason?
I also have a similar problem. I can see the connection and select it but it doesn't fill the other fields automatically. Have you found a solution?
Same problem too@@pooneh1894
@@pooneh1894 No, I can't even find the connection in the first place :/
„No more darkmode, I’m afraid“ 😎
Would you please export conversational boosting topic as it is no longer available for me in my Environment
Check that in settings - Generative AI - you have generative answers switched on. If that doesn't solve it, I'd suggest posting in the Copilot studio community forum for help. powerusers.microsoft.com/t5/Copilot-Studio-Community/ct-p/PVACommunity
Hello Lisa, I tried to do the exaxt same steps as you did in te video, but the copilot doesnt work properly, the system topic about conversational bossting does not appeard and when i tried to do the topic manually the conecction doesnt work as is should, because all the details like the Deployment are in blank, could it be because im in Europe? thanks in advance
Yes, it is because you're in Europe. This only works on a US environment at the moment - here's the workaround for now. powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413
@@LisaCrosbie does this integration between Copilot Studio and Azure Open AI works in Europe now?
Kindly provide a video for sharepoint online as datasource please
It’s on my (very long!) list, thanks for upvoting it ☺️
@@LisaCrosbie Cant wait to see that video. Thanks
i want to make copilot studio make learn how is it possible
Found one issue in this. It seems having access to Azure OpenAI Studio is beyond the limits of most of us mere mortals. 🙂 Those of us not coming through an org or being an MVP/RD Will have to wait for it to become truly publicly available.
At this stage yes, you do have to apply for access if you have a use case.
I got into the preview. Not sure how that happened. :-)
Just giving a heads up to anyone trying to follow this tutorial. Using the exact steps in the video the responses are very poor outside of the one shown in the video. Asking about different states and cities returns Hotels from wrong states, and none of the data outside of the descriptions are accessible by the model, making almost all the data in the table useless.
Can you give me the exact questions you’re using and I’ll give it a try.
Good bye data scientist!. You know what?. Thanks for training our ai.
Now you can be an ordinary worker. Ups here come tesla robots. Well maybe a youtuber... Ups geminy, sorry
Awesome!