hi thanks for the video! you explain very good !, in the end you say its getting better over time, you mean the chatbot, which is learning from the interaction? can that gpt be used as a LLM to answer more in a human way? thanks!
Suggestion: We have so many videos like this Can't you try showing how to get both video and text as answer for questions based on pdf document (which have mixed pics and text like websites)
Thanks, Dan! Your explanation was very clear. I have a follow-up question: How can we configure AI search to utilize the text data stored in our relational database, rather than relying on individual document files?
Great video. Is there any possibilty of adding more documents via API? It's not very useful if the documents are the same all the time. The goal is that the user can provide their own documents and ask them questions.
Thank you so much Dan for the video. When I use the chat feature it gives me an error - "The extensions chat completions operation must have at least one extension." Any suggestion what may be happening?
How can you get back to that chatbot with your index/files if you leave that screen and didn't deploy it? Say for instance that I want to tweak it without having to re-index all of my PDFs each time.
Hi Dan, can I use Azure OpenAI BYOD without uploading any of my data to a cloud. I have sensitive data that needs to remain on my computer. Will Azue OpenAI work just on my laptop or desktop and do its search? Please let me know.
How much would this roughly cost per month? thinking whether to use it personally in the meantime for work purposes, then once its refined, to introduce it to the workplace?
หลายเดือนก่อน
Example Monthly Cost: Assuming the company has 10 GB of data to store and generates 1,000,000 tokens per month: Azure OpenAI Resource: GPT-3.5 Turbo: 1,000,000 tokens x $0.0024 = $2.40 Ada: 1,000,000 tokens x $0.0008 = $0.80 Data Storage: 10 GB x $0.0184 = $0.184 Azure Cognitive Search: $100 per month Vector Search: 1,000,000 tokens x $0.0008 = $0.80 Generating and Hosting the Web Application: Estimated $50 per month Total Monthly Cost: $2.40 (GPT-3.5 Turbo) + $0.80 (Ada) + $0.184 (Blob Storage) + $100 (Cognitive Search) + $0.80 (Vector Search) + $50 (Application Hosting) = $154.184
Thanks , Nice Video, Few questions , what is the limitation of the data i can upload ? Also if i have to upload documents continuously with an interval of every 10 hours , shall i remove the resources after injestion. ?
I'd love to see how to do all this without the GUI just using command line. Allow me to create all these items, upload data from a blob storage, and generate the API. The Chat UI is weird in that it only allows you to interact with 1 DataSource at a time?
Dan, at thge Cognitive Search Resource your selection creates $200+ monthly cost - is that correct?
หลายเดือนก่อน
Example Monthly Cost (not so small): Assuming the company has 10 GB of data to store and generates 1,000,000 tokens per month: Azure OpenAI Resource: GPT-3.5 Turbo: 1,000,000 tokens x $0.0024 = $2.40 Ada: 1,000,000 tokens x $0.0008 = $0.80 Data Storage: 10 GB x $0.0184 = $0.184 Azure Cognitive Search: $100 per month Vector Search: 1,000,000 tokens x $0.0008 = $0.80 Generating and Hosting the Web Application: Estimated $50 per month Total Monthly Cost: $2.40 (GPT-3.5 Turbo) + $0.80 (Ada) + $0.184 (Blob Storage) + $100 (Cognitive Search) + $0.80 (Vector Search) + $50 (Application Hosting) = $154.184
I have been watching this upload your own files, but what I would like to accomplish is to be able to use the api's to upload documents from my application uI into he storage blob and reindex or ingest the files so openAI will be able to use the latest information. I have not figured that out yet. The use case is to let my clients be able to upload company documents.
How about searching for something in the web app (after turning off "Limit responses to your data") that's not in you're uploaded files... something like "what color is the sky"... doesn't work, does it...
I have built an app based on that, but used a blob container instaed of manual uploading documents. After that I have added a few more documents to the blob container, tried re-indexing, still serach is not showing latest added documents. Do you know why it is not working, any methods to follow? Thanks
Hi Dan, I appreciate the video, but I have a question. What if I want to modify the theme, add a title to the web app (chatbot), or make some cosmetic changes? Is that possible?
@Dan Wahlin, Thanks for the video. Does OpenAI back up and able to see what document I upload? Who is able to see/read the document I upload? How to deal with confidential data and not willing to let OpenAI or Azure to store/read it? Thanks
I have been engaged in a writing project with Chat GPT4o which stopped three days ago. Whenever I add new text, it disappears, which means my work, of over 700 pages, has come to an end. Do you have any idea how I might retrieve our missing work, on the same thread, so that we can continue?
Hi Dan, how do i enable the GPT able to answer even the information is not in the uploaded document? for example, my document is about World War 2 history, but the GTP can answer Math question based on it general knowledge?
That is a very good question. Also I wanted to add that like he mentioned in his example of how to do a refund and the openAI responded with what is there already. Now if I ask it how to improve the refund process would it be able to suggest improvements? To pay more than 200USD just to ask what is there in a document does not make sense, instead it should be of use to us as a way like using our data and try to improve our processes or reporting.
Hey Dan, new to your channel and have to say... thank you so much for simplifying this process for beginners. Question though, when I go to generate the query I'm getting an unsupported model error. Saying that gpt-35-turbo-0613 isn't supported. So I change it to gpt-35-turbo and it never completes the query. Returning a 'requested information is not found in the retrieved data'. But its there. Not that you can trouble shoot for me, just looking for a suggestion as to where the issue could be. Thanks again!
Actually found that that model has a known issue. I was able to add the 16k and it worked. Guess this comment can serve incase anyone else runs into this issue. Still love the content... now we just need more:)
While trying this out, I have found that most of the features you see are only available for the east (US) region. Is it true that Microsoft first releases everything for that region and then for others?
Hello, nice video! I haven't had any contact with Azure until now. If I want to test the same as you in the video, is it completely free if it is under 1000 massages? And do you know how many pdfs for example could be uploaded? Thanks!
I have learned more from you in 15 minutes than following the entire AI-102 Microsoft Training, new subscriber here
Glad to hear it was helpful! Thanks.
Well done Dan. Please keep them coming. Have a great thanksgiving.
Thanks!
You just made me look like a rockstar at my job today. Thank you so goddamn much.
That's awesome! So cool to hear that.
Dan, you're the man. Answered some questions I had about the semantic search error perfectly. Subbed and liked!
Really helpful video how we handle ai to learn from our data and give us what we expected
Great explanation and pretty straightforward, that's all I need. Thanks man
Awesome video, lots of condensed value, thanks!
Thanks, Dan. This was exactly the information I was looking for.
Fantastic. You describe it so well.
A+ Sir!!! Saved me lots of time... Thanks
It's a great video very helpful, Thanks for sharing.
I'd like to chat against 12 separate SQL databases. 😁😁
That may involve a bit more code. :-)
hi thanks for the video! you explain very good !, in the end you say its getting better over time, you mean the chatbot, which is learning from the interaction?
can that gpt be used as a LLM to answer more in a human way?
thanks!
Suggestion: We have so many videos like this
Can't you try showing how to get both video and text as answer for questions based on pdf document (which have mixed pics and text like websites)
So cool, Thanks for introduce !
Thank you for this video. 🤝
Thanks, Dan! Your explanation was very clear. I have a follow-up question: How can we configure AI search to utilize the text data stored in our relational database, rather than relying on individual document files?
It doesn't support that as of today unfortunately. Hopefully in the future.
Great video. Is there any possibilty of adding more documents via API? It's not very useful if the documents are the same all the time. The goal is that the user can provide their own documents and ask them questions.
Thank you so much Dan for the video. When I use the chat feature it gives me an error - "The extensions chat completions operation must have at least one extension." Any suggestion what may be happening?
Is it possible to use files in csv or xlsx format to produce the chatbot?
What would be the necessary requirements?
How can you get back to that chatbot with your index/files if you leave that screen and didn't deploy it? Say for instance that I want to tweak it without having to re-index all of my PDFs each time.
Hi Dan, can I use Azure OpenAI BYOD without uploading any of my data to a cloud. I have sensitive data that needs to remain on my computer. Will Azue OpenAI work just on my laptop or desktop and do its search? Please let me know.
Great video!
How do I change or add some data after deployment? Looks like once deployed there´s no chance to edit the data source anymore, correct?
Great video thanks a lot
Do you have a guide on how to get the API Management to discover your BYOD?
thank you very much for this video, I have question: what did you use the gpt3 for? I mean I saw you use ada model only, right?
GPT is still used behind the scenes for the prompts. When you ask a question to a document GPT3 kicks in.
I tried to follow your steps but Azure OpenAI Services request to send a form to Microsoft to have access to it. Did you have to do the same?
Yes, you need to fill form first to gain the access.
Most of my documents are on Sharepoint. Instead of manually uploading them, is it possible to just link them?
Thanks for sharing.
How much would this roughly cost per month? thinking whether to use it personally in the meantime for work purposes, then once its refined, to introduce it to the workplace?
Example Monthly Cost:
Assuming the company has 10 GB of data to store and generates 1,000,000 tokens per month:
Azure OpenAI Resource:
GPT-3.5 Turbo: 1,000,000 tokens x $0.0024 = $2.40
Ada: 1,000,000 tokens x $0.0008 = $0.80
Data Storage:
10 GB x $0.0184 = $0.184
Azure Cognitive Search:
$100 per month
Vector Search:
1,000,000 tokens x $0.0008 = $0.80
Generating and Hosting the Web Application:
Estimated $50 per month
Total Monthly Cost:
$2.40 (GPT-3.5 Turbo)
+ $0.80 (Ada)
+ $0.184 (Blob Storage)
+ $100 (Cognitive Search)
+ $0.80 (Vector Search)
+ $50 (Application Hosting)
= $154.184
Have you done any versions/videos where you layer Python in for context and to help the model understand your data better?
I haven't but that's something I'll keep in mind for the future. Thanks for the suggestion.
Thanks , Nice Video, Few questions , what is the limitation of the data i can upload ? Also if i have to upload documents continuously with an interval of every 10 hours , shall i remove the resources after injestion. ?
I'd love to see how to do all this without the GUI just using command line. Allow me to create all these items, upload data from a blob storage, and generate the API. The Chat UI is weird in that it only allows you to interact with 1 DataSource at a time?
So simple. How do I add another document? Doesn’t seem you can add additional documents from the playground UI.
Dan, at thge Cognitive Search Resource your selection creates $200+ monthly cost - is that correct?
Example Monthly Cost (not so small):
Assuming the company has 10 GB of data to store and generates 1,000,000 tokens per month:
Azure OpenAI Resource:
GPT-3.5 Turbo: 1,000,000 tokens x $0.0024 = $2.40
Ada: 1,000,000 tokens x $0.0008 = $0.80
Data Storage:
10 GB x $0.0184 = $0.184
Azure Cognitive Search:
$100 per month
Vector Search:
1,000,000 tokens x $0.0008 = $0.80
Generating and Hosting the Web Application:
Estimated $50 per month
Total Monthly Cost:
$2.40 (GPT-3.5 Turbo)
+ $0.80 (Ada)
+ $0.184 (Blob Storage)
+ $100 (Cognitive Search)
+ $0.80 (Vector Search)
+ $50 (Application Hosting)
= $154.184
Hi, everything worked fine for me, but when I came next day my uploaded file was missing, do you know anything about it? Thanks.
I have been watching this upload your own files, but what I would like to accomplish is to be able to use the api's to upload documents from my application uI into he storage blob and reindex or ingest the files so openAI will be able to use the latest information. I have not figured that out yet.
The use case is to let my clients be able to upload company documents.
Great video. Did anyone find out how do I add another document?
How about searching for something in the web app (after turning off "Limit responses to your data") that's not in you're uploaded files... something like "what color is the sky"... doesn't work, does it...
I have built an app based on that, but used a blob container instaed of manual uploading documents. After that I have added a few more documents to the blob container, tried re-indexing, still serach is not showing latest added documents. Do you know why it is not working, any methods to follow? Thanks
it is amazing! is there any way to add some azure ad sso authentication to the chat that you show in the end?
Hi Dan, I appreciate the video, but I have a question. What if I want to modify the theme, add a title to the web app (chatbot), or make some cosmetic changes? Is that possible?
Thank you, I have a question, how safe is my data which is related complex engineering drawings. How do i secure it as its on azure tenant.
can you show a video of how to deploy a web app for an enterprise and not in the web?
@Dan Wahlin, Thanks for the video. Does OpenAI back up and able to see what document I upload? Who is able to see/read the document I upload? How to deal with confidential data and not willing to let OpenAI or Azure to store/read it? Thanks
I have been engaged in a writing project with Chat GPT4o which stopped three days ago. Whenever I add new text, it disappears, which means my work, of over 700 pages, has come to an end. Do you have any idea how I might retrieve our missing work, on the same thread, so that we can continue?
I found there is a vetting process. Is this required for everyone to use OpenAI?
how can we export thhis rag application?
Sir what's the max size of the pdf i can add and is they a way to call this through an api lets say i want the chat feature to my website
Hi Dan, how do i enable the GPT able to answer even the information is not in the uploaded document? for example, my document is about World War 2 history, but the GTP can answer Math question based on it general knowledge?
Hi. I am facing the same issue. If you have solved it, please let me know how you achieved it?
Thanks!
That is a very good question. Also I wanted to add that like he mentioned in his example of how to do a refund and the openAI responded with what is there already. Now if I ask it how to improve the refund process would it be able to suggest improvements? To pay more than 200USD just to ask what is there in a document does not make sense, instead it should be of use to us as a way like using our data and try to improve our processes or reporting.
🎉 Great video, how about document size greater than 16MB?
Hello,
Can you help me how can I publish my web app to ms teams?
So without deploying the chat as web app, I can still use it via Api if I want to build my own Chat UI, correct Dan ?
I have the same question, did you find out how to create an API endpoint connecting to the chat model ?
Hi! I found this example using api: th-cam.com/video/itbTh5Sqmbw/w-d-xo.htmlsi=_ykWyC2nMxngnEzJ
Hey Dan, new to your channel and have to say... thank you so much for simplifying this process for beginners. Question though, when I go to generate the query I'm getting an unsupported model error. Saying that gpt-35-turbo-0613 isn't supported. So I change it to gpt-35-turbo and it never completes the query. Returning a 'requested information is not found in the retrieved data'. But its there.
Not that you can trouble shoot for me, just looking for a suggestion as to where the issue could be. Thanks again!
Actually found that that model has a known issue. I was able to add the 16k and it worked. Guess this comment can serve incase anyone else runs into this issue. Still love the content... now we just need more:)
@@AudraCarpenterSome of the models don’t work with the playground unfortunately (as you discovered). Glad you got it going though!
While trying this out, I have found that most of the features you see are only available for the east (US) region. Is it true that Microsoft first releases everything for that region and then for others?
Hi Robbert. I'm not involved with the rollout to different regions, so I don't have any information about that process unfortunately.
good video~
My POC was completed in less than 30 minutes, thanks to you.
Hello, nice video! I haven't had any contact with Azure until now. If I want to test the same as you in the video, is it completely free if it is under 1000 massages? And do you know how many pdfs for example could be uploaded? Thanks!
How about going against a good ole SQL database?