Microsoft AI Builder Tutorial - Extract Data from PDF
ฝัง
- เผยแพร่เมื่อ 5 ก.ค. 2024
- In this step-by-step tutorial, learn how to use Microsoft AI Builder to extract data from a PDF document. Along with extracting text fields, tables, and text boxes, you can use AI Builder to determine text sentiment, identify objects in images, and much more. Once we extract data from the PDF you can automatically insert the data into a spreadsheet, Microsoft Teams, or any other connector. You can leverage your new AI model in Power Automate and Power Apps.
We begin by entering the fields we want to extract from the PDF. Next, we upload sample documents into a collection. With the documents uploaded, we tag the documents to teach the computer what data is contained within and where the data is located. We then train our model based on the sample documents and tagging. We then upload a sample document to ensure that the model works as we expect. Lastly, we create a Power Automate flow that leverages the model. At the end, you'll be able to automatically extract data from a PDF document.
👋 Additional resources
- Microsoft AI Builder License details: powerapps.microsoft.com/en-us...
- Get to AI Builder using Office.com: www.office.com
- Introduction to Power Automate video: • Power Automate Tutoria...
- Introduction to Power Apps video: • How to use Microsoft P...
⌚ Timestamps
0:00 Introduction
1:02 Caveats
1:25 Get to AI Builder
2:17 AI Builder overview
2:42 Choose info to extract
3:38 Create collection
4:22 Tag documents
5:06 Train & publish model
6:04 Use model in Power Automate
8:26 Run test
9:15 Wrap up
📃 Watch related playlists
- Playlist with all my videos on Power Automate: • Power Automate
- Playlist with all my videos on Power Apps: • Power Apps
🚩 Connect with me on social
- LinkedIn: / kevinstratvert
- Twitter: / kevstrat
- Facebook: / kevin-stratvert-101912...
- TikTok: / kevinstratvert
- Instagram: / kevinstratvert
🔔 Subscribe to my TH-cam channel
th-cam.com/users/kevlers?...
🎬 Want to watch again? Navigate back to my TH-cam channel quickly
www.kevinstratvert.com
🛍 Support me with your Amazon purchases: amzn.to/3kCP2yz
⚖ As full disclosure, I use affiliate links above. Purchasing through these links gives me a small commission to support videos on this channel -- the price to you is the same.
#stratvert - วิทยาศาสตร์และเทคโนโลยี
Ce frumos e sa te avem aici... Asa învățăm programare...
You’re amazing. Your voice is soothing. Your flow is perfect. I can’t stand watching anyone else explain things to me. They suck lol.
Awesome video as always. Learning a lot from you. Keep it up!
This is ABSOLUTELY FANTASTIC! I really like the lighting you used in this video. Your improving in no time Kevin! You're having Better Audio, Better Video, Better lighting every once now and then! That's really great. Keep producing these amazing videos!
Thanks Vendanth! I’m using a three point lighting system for this. I like the outcome 👍
@@KevinStratvert How are you recording your audio? sounds really good!
@Satvik Garg he does not reply to all comments
Wow, what an exiting topic! Please more on automatisation and Power Automate! Or maybe web scraping, data visualisation etc..
Looks pretty useful gotta check this out Kevin I really like your vids you explain so well if someone else was in your place I never would have understood it or checked it out. You don't deserve a million you deserve more keep up the hard work.
Content creator, thank you for uploading.
Greetings to all the respected viewers here.
Really useful stuff! Your channel is helping me a lot at work.
Kevin is the man! Such great videos
Great videos Kevin, definitely gave me some great ideas for my work, thanks and please keep the videos coming :-)
Felicitări, eu m-am uitat și la programare în Python. Te felicit, Kevin.
It is really cool for accountant who deals with tons of PDA Invoices from different companies in different layout. And it looks like Bluebeam Revu for construction users to identify the specific location to extract key drawing title and reference number.
Hi 919pang, I'm a construction user of Bluebeam Revu trying to extract Specification pages relating to Acoustical Ceilings and ACT types from the Architectural drawings. Is this something that can be done?
Thank you sir, finally i understood the purpose of power automate ❤️
i just finished watching your tutorial on the cbk bread maker then got this AI video suggestion. What a variety lol. keep it up👍
This is a powerful but EXPENSIVE software!
$500/month for 1 million credits. Anyone in your org can use it. It’s steep, but when you consider people no longer will spend time on these manual tasks and can instead focus on more value adding activities, it’s likely worthwhile. It’d be nice if there was also a basic free tier for just a few credits each month to experiment with.
@@excelrobot very true! Especially if you compare it to existing solution (having someone manually do the work).
@@KevinStratvert the pricing model makes it hard to start of in small scale though. Otherwise I agree, once scaled up its super affordable.
@@qaazz you get a 30 day trial and I believe you can extend it a few times if necessary. That can help jump start things while keeping costs low.
Wow this is highly impressive Kevin! I started an LLC, can you sign up using a tax ID? Thank you for this practical video.
Many thanks Kevin! It would also be helpful if you have a series videos of this AI builder (i.e. beginner to medium or advanced) 👏
Are you sure he doesn't have that already?
New subscriber here! I was searching YT for some Teams tips & tricks and your channel was one of the recommendations! I'm so glad I chose to watch your videos because right now I can't wait for my next Teams presentation and flex everything I learned from you! haha! Thank you for all the great content, I am looking forward for more!
the one and only thing to identify if this cool man is real its " Tooodaaaay"
Am glad that am not the only one who noticed it
😂
I love his voice vibes and “TODAY!”
Just blew my mind. 👏👏👏👏
Crack! Excelente video, seguro que lo implemento en la empresa!
Thanks for the help!
There's a lot more to getting setup with a business account and all the services connected to get to the point of creating a model. I appreciate your video for showing me what's possible though.
This is great. The MS Power Plattform is so mighty. So many possibilities. It's just started to roll put in our company. Please do more videos about it.🙏
More to come!
@Satvik Garg what does that have to so with my comment? 😅
Awesome Video; thank you for sharing!
Loved the topic. I built an automated pdf for performance appraisal and was wondering how to get all those data into an excel in a single click of button. I think I got the answer.
This is amazing!
Gr8 man! Gonna try 2 use it.
very nice and informative video :) thanks for your efforts
Super Kevin awesome tutorial as always.
Thanks for the note Edson!
You have very talent
very useful, thank you
Great video thanks
That was epic, thank u sir!
That Manager of yours looked like a real tough guy. Must be real hard to work with this guy?
Thank you......
Wow now this is an interesting feature....
Tooodayyy.
Happy start of every video
excellent tutorial, relevant and timely tutorial. Please create a video on process advisor
I found this very usefull
This is amazing Kevin, I was thinking Can you please make a JavaScript crashcourse Thanks a lot
I would really appreciate some JavaScript course from you Kevin
You are the best
0:00 - Hi Kevin. 👋 9:20 - 766th thumbs up from me to the formidable video for sure. 👍 Cheers.
Thanks
Hey Kevin, I follow your content from Nigeria. Great content! please let's have another video for using AI Builder in Power Apps
Great 👍
beautiful
Hmmm. Interesting topic. Gotta test this out. Thanks for the walk-through.
Great
Very nice very good
Hi Kevin thanks a lot for this video, it's amazing and really useful. I wanna know, if can i combine the AI Builder with Power Automate Desktop?
It's very useful . It seems you are very tired or something wrong with you because your eyes seem not more energetic Try to sleep and take a rest more if U do not wanna stay in bed . Thanks for all your Vids
I love you bro
Hello Kevin..!! I love the way you teach something. I love the photos app of windows 11. Can you please check that and let us know, if the default photos apps of windows 11 can be installed in Windows 10 OS?
Nice Todayyy Kevin!! But make videos on Coding with Html css js
Amazing your tutorials are so easy to follow. Could you possibly do a tutorial on krita?
I have Krita on my list. Stay tuned!
Thanks for this amazing video. I have one question. How do we put the extracted data in to excel directly? Is there any way to directly feed the pdf to the model and get the output?
Hm Power Automate is not an option for you?
I cried on you 1m special video
Good vedio
the thumbs up SHINED WHAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAT
hi Kevin, in your 5:09, do you need to tag manually for all 5 document?
I hope another form tagging method is developed - Maybe with default field boxes for forms 2-5. If you have complex forms with 50+ fields, you have to enter the tags 250+ times- Very time consuming.
From some demos I watched, it looks like based on your input from the first form, you’ll be able to simply confirm any subsequent fields on the remaining forms. However, I didn’t see that when I walked through this. My guess is they’re working on this feature for the exact reason you call out.
cool
Mr kevin please prepare video for data anlysis
More to come!
I already trained one model, very useful..but sustainability is difficult, for a mere of budget..
can this do a linear, area and volume measurements? currently i can only summarize my measured data from pdf to excel...
Hello, thank you for the video. Is there a way redact the text from PDF using AI and power automate?
The Subject Filter is just what you’re telling it to look for, you don’t need it to be AI filter as the next step has no idea what that filter is. If all the emails with the attachment have something similar in the subject line, use that. If it’s a single purpose mailbox where it ONLY receives these emails then don’t use a filter, just make sure you select Require Attachment
Wow!!!
Hi Kevin, would be nice if you could do a video on MS Syntex and highlight the difference between the two products. Ms Syntex also uses AI.
I’ll add to my list. Here’s a good article: www.withum.com/resources/is-ai-builder-enough-or-do-i-need-sharepoint-syntex/
Love your vids Kevin! Quick question; can this only pull info from PDFs that are sent with Outlook, or does it work with Gmail? I've finally gotten around to saving & sorting all my financial statements but my accounts are with Gmail.. 🤔 thanks much!!
Power automate also connects with Gmail, so it’ll work there as well 👍
0:08 No waay!🤖 0:14 How can it be complex with you here?😎 0:40 Not him again! Do you even have a manager?🤷♂️ 0:48 Apparently no.😂 9:15 I learnt something new and obviously enjoyed :) 9:19 Liked even before watching👍 9:22 Who hasn't subbed. I think your boss hasn't 🙄! Kevin this was an amazing tutorial! Your walk-through is always amazing and you explain very well!!
You forgot: "delivery method: pigeon" 9:05 😀
How could I miss such a funny element? Thanks for filling the gap.
Do u think I could use it to generate an invoice from a spreadsheet when info is filled in?
Mail merge can help you to fill in an invoice with data from a spreadsheet. You can also pull it off using Power Automate.
OCR tools does all of that already 15 years ago, without any AI. I really don't know where AI or learning is needed to automate the recognition of fixed text parts on PDF documents...
Agree. "AI" in this case is just branding for modern OCR features, then tied to a flow.
Can you suggest a C# IDE for a low end PC?🤔
Can we extarct signature and do a match?
Kevin can you try making a storage partition video ?
That would be so useful for the people who have low c drive storage..
Hi, you should upload a video on how to add chapters to your video.
I have a field that appears multiple times on a page, but AI Builder only allows me to tag it once. It also doesn't recognize the range as a PDF table.
Kevin which screen recorder you're using?
Which app you are using to edit video?
Obs studio for screen recording and davinci resolve for editing.
Hey Kevin, what do you use to do screen recordings? Camtasia, OBS, something else?
OBS Studio
@@KevinStratvert How do you do that Zoom in thing so well?
@@Tim-Shows key frames using davinci resolve.
wow this is great. Can i do this with a document that lays out a table with product information and order numbers
for example at my shop i have someone write down manually onto a piece of paper the product in column A and the number of that product they want to order in column B.
can i take this manual hardcopy piece of paper, scan it and upload the information directly into excel? any help on this will be amazing
What if you have multiple formats of PDFs, but same set of output data your want to extract? Can you train them in one model?
You can set up multiple collections. Each collection contains a different format / layout. You can then train one model.
can you make an example on how would you process this info into Microsoft GP for business ?
Hey Kevin, do you know how to remove the background from a photo in power automate?
Is there any open source maybe AI LLM powered project after two years?
Hi Kevin, I have a requirement like I need to extract the data from Resume one and need to import the data to Resume 2, Can we do this by implementing Power Automate, if yes let me know how can we do this? Thank you
Nice video, I´ll give it a try. I have a little diferent story. Do you think this case is also possible: Extraction of Advertisements from PDFs:
The most complex and crucial aspect for us involves extracting advertisements from various publications such as brochures, city maps, senior guides, or official bulletins. These are often published online in PDF format. We want to extract the ads from these PDFs and directly store them in a CRM for the respective companies, making them accessible to our sales staff. It is essential not only to export the data from the advertisement but also to see the image.
This process should be automated, as manual effort is not feasible. Is there a tool that can identify, highlight, and extract advertisements in PDFs, and also offers integration that reads these ads and assigns them to the respective companies?
Do you think that´s possible?
How to insert the youtube video in power point?because its been updated the power point?
Kevin, if i wanted to take the pdf info and have it input into an online portal what option do i choose?
Firstttt 🥇
Kevin in your previous video you told us that you can add an animated background for windows 11 can this also work on windows 10 and/or mobile/tablet. Also if you upgrade to windows 11 remove the version. Please create more videos on simple coding or programming. Also, I just discovered something called Microsoft editor can you explain that to me too. Other than that, all is good. So I'd recommend keeping up the hard.
Animated background works on win 10 as well. More to come on coding. I have a video on Microsoft Editor. It’s similar to Grammarly.
@@KevinStratvert ok thanks
Kevin
Can you make tutorial for Visual Basic studio sir
Hi, Can we duplicate the text after tagging the one already in table. For example i have taken a table, in that my first row first cell is having the data like "Test-1", can i duplicate this and use it in same table? If yes, please suggest me the process.
Can I extract info like this from websites? Or is it limited to PDF documents?
Does this still work if the forms are always in different formats, that aren't super similar?
Hey Kevin, can you make a full detailed course on Microsoft Excel and how we can use it to make good income.
"Crate"? As in build a box around? Or "create"? As in make something new?
Hey can this AI builder open a pdf which is available on share point with a link.Clink on the link (pdf will open ) and then identify what is needed and put it in excel?
Hi do you have any info on how to save mhtml from browser to desktop folder
Is this also applicable in foreign language? I'm an English speaker that receives invoices in Japanese and would like to automate my process like this. Thank you in advance, Kevin :)