Advanced Invoice Processing with AI Builder in Power Automate Desktop

Подписаться 64 тыс.

Просмотров 18 тыс.

50% 1

Learn how to use the AI Builder with Microsoft Power Automate Desktop. In the advanced use case, we do PDF invoice processing, where we call the AI Builder in Power Automate Cloud with a REST API Call, aka HTTP Request. The response is sent back to us in Power Automate Desktop, where we save the extracted data.
VIDEOS FOR YOU:
🔹 Extract data from ID Documents with AI Builder: • Extract Data from ID D...
🔹 You Describe It - AI Builds It: • Power Automate BREAKIN...
POWER AUTOMATE DESKTOP GROUPS:
👨‍👩‍👧‍👦 Discord: / discord
- Join my network with 4300+ Automation/RPA developers, where we solve Automation/RPA problems, network and help each other upgrade our careers. It's free!
👩🏻‍🎓 LinkedIn: / 12566435
👨🏻‍💻 Facebook: / 754059285247921
FOLLOW ME:
💼 LinkedIn: / andersjensenorg
📸 Instagram: / andersjensenorg
👨 Facebook: / andersjensenorg
🐦 Twitter: / andersjensenorg
💌 Email Newsletter: andersjensen.org/email-newsle...
0:00 Configure Power Automate Cloud
We need to set up a connection to Power Automate Cloud to use the AI Builder in Microsoft Power Automate Desktop. First, we use the When an HTTP Request is received trigger. Then, with a Response action, we can send data back. When we receive and send data, it's in JSON format. Finally, we get a URL to start the Power Automate Cloud flow from Desktop when we save.
3:26 Configure Power Automate Desktop
Now we can call Power Automate Cloud with a REST API Call (Invoke web service). The method is POST, and the format is JSON.
5:29 Invoice Processing with AI Builder in Power Automate Desktop
In Power Automate Desktop, we can read any folder, but when we want the AI Builder in the cloud to process our PDF invoice documents, we need them to be available in OneDrive, SharePoint, or DropBox. So either you should store them there or move them temporarily. Therefore, before sending the file path to the cloud, we do a little text manipulation to match the standards needed: The path should be relative to the OneDrive root and needs forward instead of backward slashes. Then, before we extract the invoice data in Power Automate cloud, we read the invoice data with the two OneDrive activities: Get file metadata using path and Get file content.
#powerautomate #powerplatform #office365

Наука

Опубликовано:

30 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 51

@andersjensenorg Год назад

Thanks for all your support 🙌🔥 I've prepared these Advanced Power Automate Desktop Use Cases for you: ru-vid.com/group/PLXXz88_TPiHqbQENjPjBkO3DSro06cAcb

@ammadkhan4687 Год назад

This is the exact solution I was looking for. Many thanks for your effort

@andersjensenorg Год назад

Hey Ammad - thanks a lot for letting me know, highly appreciated 🙌💪 Kind regards, Anders

@nathangoel8894 3 месяца назад

thanks Anders, your content is awesome

@andersjensenorg 3 месяца назад

I'm so happy to hear 😊 Thanks a lot, kind regards, Anders

@edtignor4235 Год назад

If you have to tell PA (Power Automate) where the files are in the cloud, why not just create a PA flow that runs when it detects a new file in the folder. That's my current setup. I save the PDF to the OneDrive folder on my desktop, it uploads to the cloud, the PA flow is triggered, AI bot extracts my info, then it calls a PAD (Desktop), flow on my laptop and sends the extracted information as input variables for my PAD flow. I also have a sub flow in PAD which creates a new folder on my laptop for the PDF and removes it from the OneDrive folder. The PDF is a real estate contract, so each PDF needs its own file for other information that is needed with a real estate closing.

@andersjensenorg Год назад

Hey Ed. Great question. Because the process is used with Windows Legacy apps, which Cloud can't use 🙂 Kind regards, Anders

@indeotelsonline 6 месяцев назад

Hi Anders , Thanks for wonderful video , i implemented in same way what you explained me , could you help how we can get line item details from AI Builder table , it is showing Line Item variables but how we can pass in JSON ?

@andersjensenorg 6 месяцев назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@dadicam 9 месяцев назад

Nice video! I got a question, do you know when Microsoft team will add "signature detection" field type in ai builder form recognition custom model creation?

@andersjensenorg 9 месяцев назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@wamiqsattar 9 месяцев назад

@wamiqsattar 0 seconds ago I am using Power Automate Desktop and want to execute "GPUPDATE /FORCE" on the CMD Prompt window. This will send the command to regular CMD prompt window, but not to the Admin CMD prompt window. So, how can I invoke CMD prompt window with Admin rights and do the "GPUPDATE /FORCE". Most of my work will require Power Automate Desktop to operate in CMD Prompt window with ADMIN RIGHTS? Thank you.

@andersjensenorg 8 месяцев назад

@calvinjeng Год назад

If my files are stored in the C:\users\desktop\invoice folder, not in the cloud Which steps should be omitted? Thank you

@brijendraydv Год назад

@@anjugunakar what's his server name or how to find on discord?

@andersjensenorg Год назад

Hey calvinjeng Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my Microsoft Power Automate Groups, where we all can post and solve problems or hang out around our favorite tool, Power Automate. So you're very welcome. Get the addresses here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-_QRI-Yo2h8U.html Have a great day. Kind regards, Anders

@nguyentrunganhtrung.anh.ng2070 Год назад

Hi! Thanks for the video. Can I apply this on Power Automate cloud? Thanks

@andersjensenorg Год назад

Hey Nguyen, yes it's already integrated in PA Cloud 🙂

@nickvanoort9609 Год назад

Nice and helpfull video! I do have one question: Is there a workaround to only pick one file from sharepoint? If I upload only one file then I cannot use %Invoice.Path% in the 'Invoke web service' action. The reason I am asking this is because of the data my AI Builder model extracts from the documents. It contains data insides tables which are put into collections. Therefore I cannot select them in the 'Response' action in de Cloud flow. I get this error: "The output you selected is inside a collection and needs to be looped over to be accessed. This action cannot be inside a foreach." So, I need to find a way to workaround the foreach. I am stuck at this point as I need all the data extracted by the AI Builder. Hopefully you have a idea :)

@andersjensenorg Год назад

Hey Nick van Oort Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my Microsoft Power Automate Groups, where we all can post and solve problems or hang out around our favorite tool, Power Automate. So you're very welcome. Get the addresses here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-_QRI-Yo2h8U.html Have a great day. Kind regards, Anders

@myousefi6600 10 месяцев назад

Hey Lovee your work, I have a question and haven't been able to find an answer. How can I retrieve items from descriptions that aren't unique, such as quantity, item description, etc.? I suspect they need to be iterated over, assigned to a variable, and then passed to the JSON object. However, I've had difficulty implementing this

@andersjensenorg 7 месяцев назад

@chavvasrilatha9980 Год назад

i am not able to get an option "extract information from invoices". i can use ai builder in my account. but in the middle of the flow not able to access ai builder operations. do i need to get any permissions.

@andersjensenorg Год назад

Hey Chavva Srilatha Thanks for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone (I try my best). I've created my Microsoft Power Automate Groups, where we all can post and solve problems or hang out around our favorite tool, Power Automate. So you're very welcome. Get the addresses here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-_QRI-Yo2h8U.html Have a great day. Kind regards, Anders

@user-zh4id3df8l 9 месяцев назад

hii Anders ,do you know how to get filename to excel dynamically in cloud power automate

@andersjensenorg 9 месяцев назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@user-tw2un7fy5m 8 месяцев назад

HI, thank you for this video. I wanted to know do I need a Power Automate Premium Plan to try this Advanced Invoice Processing or is there a any free plan for developers to try this.

@andersjensenorg 8 месяцев назад

@vygintasgrinis3913 4 месяца назад

Great videos, Anders!!! Everything works for me, I get a response that FileName was processed. However after adding "Get file metadata using path" and running the flow I get an error. {"error":{"code":"NoResponse","message":"The server did not receive a response from an upstream server. Request tracking id '08584905007209957731683973228CU99'."}} Anyone ran into the same issue?

@vygintasgrinis3913 4 месяца назад

when i check power automate cloud the error i get is: { "status": 404, "message": "The resource could not be found.", "source": "api.connectorp.svc.ms" } i thougt maybe it is related with one drive, but it gives response when i dont use "get file metadata using path"

@andersjensenorg 3 месяца назад

@maleenonline 3 месяца назад

Is there a way to collect QR code data into a Excel spreadsheet?

@andersjensenorg 2 месяца назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@zoriktoz7464 Год назад

Is it a paid service (AI invoice recognition)? How much for how many runs?

@andersjensenorg Год назад

Hey Zorikto. Yes, but for private use we can have it for free (my version is a trial). Kind regards, Anders

@MsKaryn Год назад

For some reason, I can't get past the flow error "Not Found". The path name is correct as it shows up the way I want it in the Display. The files are PDFs and do exist in the folder path I'm sending. The files are just never found. Does file type matter? I watched this video over and over following it to a T and still can't get it to work. The error coming back in Result and WebServiceResponse = {"error":{"code":"NoResponse","message":"The server did not receive a response from an upstream server. Request tracking id '08585209595401517484192995827CU103'."}}

@andersjensenorg Год назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 6000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@datalevi Год назад

Do you have other resources to start learning about AI?

@andersjensenorg Год назад

Great question and sorry about the late reply. In regard to RPA and Power Automate, I would focus heavily on Document Processing (text processing), and here the AI Builder is the number one approach. Kind regards, Anders

@MUHAMMADSOHAIL-cx2rl Год назад

Dear , i am getting below error: error":{"code":"NoResponse","message":"The server did not receive a response from an upstream server.

@andersjensenorg Год назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 7000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@roshanmk007 8 дней назад

How to extract line items like QTY

@andersjensenorg 8 дней назад

Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 13,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-xWFz-S96XGo.html Kind regards, Anders

@baldeepsinghnagi8943 Месяц назад

Getting this error: {"error":{"code":"DirectApiAuthorizationRequired","message":"The OAuth authorization scheme is required. Please add authentication scheme and try again."}}

@andersjensenorg 28 дней назад

@baldeepsinghnagi8943 28 дней назад

@@andersjensenorg i also posted this question on Discord channel but i havent receive any response

@sempaxbolong6259 Год назад

Cons : - Need to install onedrive app in pc, file input rely on sync. - Consume api rate limit everytime you execute invoke webrequest from PAD, because this method using on http request received action trigger from cloud flow. - Not good for processing thousand of documents. (api rate limit/slowness) - Invoke webrequest does not upload the file directly, its just supplying the file name from one drive All of this cons will be eliminated if we are using azure form recognizer api.

@andersjensenorg Год назад

@aswathyk2419 Год назад

while am doing the same step i get this error {"error":{"code":"WorkflowTriggerIsNotEnabled","message":"Could not execute workflow 'b39ff62e-9c57-4594-a35d-4cdde7b2a5dc' trigger 'manual' with state 'Disabled': trigger is not enabled."}} help me pls how can i solve this error

@andersjensenorg Год назад

@user-tw2un7fy5m 8 месяцев назад

I am also having the same issue.. to resolve it I even purchase the monthly Power Automate Premium license $15 per month BUT STILL I am getting "Your premium flows are turned off"