Extract Multiple Web Pages with Power Automate Desktop - Full Tutorial

แชร์
ฝัง
  • เผยแพร่เมื่อ 20 ก.ย. 2024

ความคิดเห็น • 93

  • @andersjensenorg
    @andersjensenorg  ปีที่แล้ว +3

    Thanks for all your questions and comments 🥰
    I've created a Discord, where we can help each other with RPA and network around our careers: discord.gg/iloveautomation

    • @wallyrogers7501
      @wallyrogers7501 6 หลายเดือนก่อน

      I joined. Easy to get lost in there. Need an AI to find the right topic.

  • @VitorReis-rn8ho
    @VitorReis-rn8ho ปีที่แล้ว +1

    I have struggled a lot, but, thanks to your instructions, I managed to adapt small parts of the script to my needs.
    I already knew your work teaching autohotkey. Your teaching is fantastic!!! Thank you very much!

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey VitorReis, thanks a lot - Have you seen my discord (link in the description)? We're 8000 RPA developers helping each other, and it's of course free. Kind regards, Anders

  • @kaushik9gohil
    @kaushik9gohil ปีที่แล้ว +3

    I learned something new, was able implement in actual real life requirement. Thank you very much for making it so easy and simple.

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey @kaushik9gohil. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 8000+ RPA developers networking and solving problems: th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @glennganey6217
    @glennganey6217 ปีที่แล้ว +1

    Thanks for another great tutorial. The dynamic selector was elegant.
    I am still scratching my head over doing a google search for a refrigerator part (DA47-00322B). I go through the standard selector UI assignments for the results title and for the body of text, sometimes the part number will not appear in the title but does appear in the body of text. When I run PAD it picks up only nine of the thirteen results. Using your tip (F-12) I look at the code, but I am no web programmer, and do see a significant number of differences between some of the results.
    The object of the exercise is to write a URL & part number if the part number is explicitly found in either the title of body of text and of course save the results in excel. I do believe this would make for a good tutorial since so many people use google searches. Thanks for any incite you can shed.

  • @sergiobarros5541
    @sergiobarros5541 10 หลายเดือนก่อน +1

    Mr. Jensen, you rock! Thank you for this wonderful tutorial. Greetings from Brazil!

    • @andersjensenorg
      @andersjensenorg  10 หลายเดือนก่อน +1

      My pleasure, thanks for the nice comment 🥰 Kind regards, Anders

  • @chandermohanaggarwal2838
    @chandermohanaggarwal2838 3 วันที่ผ่านมา +1

    Thank you for wonderdful video

  • @sujitbhowmick9517
    @sujitbhowmick9517 ปีที่แล้ว +2

    Love from India ❣️👌

  • @adenilsonx.franco5287
    @adenilsonx.franco5287 ปีที่แล้ว +1

    Thank you very much for the tutorial that prepared Mr. Anders Jensen, it will help me a lot, I will use it in other researches, because I can use your techniques.

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks a lot, Adenilson 😊 I'm so happy, that I could help you - have a great day. Kind regards, Anders

  • @missnlahi
    @missnlahi 11 หลายเดือนก่อน +1

    Thanks I'll try it. I think this addresses why my script was only working for the 1st page of data

    • @andersjensenorg
      @andersjensenorg  11 หลายเดือนก่อน

      Nice to hear, please let me know if it worked 🙂

  • @agamenon1953
    @agamenon1953 ปีที่แล้ว +1

    Thank you for such a great video Anders. I wonder if you can post a video explaining how to scrape web pages with infinite scroll.

  • @thehspace
    @thehspace ปีที่แล้ว +1

    Very helpful. Thank you!

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey @thehspace. Thanks a lot 😊 Have a great day. You're more than welcome at my Discord, where we're 8000+ RPA developers networking and solving problems: th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @Chime-In-CelebQuotes
    @Chime-In-CelebQuotes ปีที่แล้ว +1

    Thank you Anders !! this is very helpful :)

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      You're very welcome, Neha Puri - your support helps me a lot 😍 You're more than welcome at my Discord, where we're 6000+ RPA developers networking and solving problems: th-cam.com/video/xWFz-S96XGo/w-d-xo.html

  • @Taxita
    @Taxita ปีที่แล้ว +1

    Thanks for doing this. I was wondering how to do that.

  • @dDse7en
    @dDse7en 8 หลายเดือนก่อน +1

    thank you very much for this video, but i have a question, why is your data in excel is separate nicely from value scrap from web into each individual cell, meanwhile mine is all the data scrap from the web is lump into a single cell

    • @andersjensenorg
      @andersjensenorg  8 หลายเดือนก่อน

      Thanks a lot 👍😊 How does your DataTable with the scraped data look like? If one cell, you scraped wrong. You're more than welcome to post the problem on my discord :) It's 100% free and the link is in the video description. Kind regards, Anders

  • @matusklubica1256
    @matusklubica1256 6 หลายเดือนก่อน +1

    Hello im struggling with the third part of your video, i cant make it work, my source code looks different and I cant deal with it, i would really like to master it, thank you for your help, love your videos :)

    • @andersjensenorg
      @andersjensenorg  5 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @happy9955
    @happy9955 ปีที่แล้ว +1

    great teaching

  • @suraj_singh321
    @suraj_singh321 ปีที่แล้ว

    Kudos Anders Sir Make a video on Working with CMD Sessions operations from basic to advance in Power Automate Desktop

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว +1

      Hey RPA_Enthusiast Thanks a lot for writing. I'm getting more than 50 questions/comments every day and having difficulty answering everyone - but I try my best. I've created my Discord, where we're 4300+ RPA Developers networking and solving problems. You're very welcome: andersjensen.org/#community Kind regards, Anders

  • @manjunathreddy4320
    @manjunathreddy4320 9 หลายเดือนก่อน +1

    Thanks for awsome content!
    Could not see advanced settings option in add ui element in the Power automate desktop, and I am using latest vestion.

    • @andersjensenorg
      @andersjensenorg  9 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @Hungry_kitchen777
    @Hungry_kitchen777 ปีที่แล้ว +1

    Hi Anders thanks for the great video, may I know how to scroll down and extract the entire table from web page in PAD, Iam trying but able to get only the one's displayed on the screen, hope to see the repl soon😊

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4500+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @BrainUpp
    @BrainUpp ปีที่แล้ว +1

    Also scrape data from inside from every link multiple data upto multiple pages

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey Brain Up. Please check this: th-cam.com/video/4zmviNtOFwA/w-d-xo.html Kind regards, Anders

    • @BrainUpp
      @BrainUpp ปีที่แล้ว

      @@andersjensenorg yes i saw this you have extrated only one item i mean to say to scrape multiple items

  • @freeacademy701
    @freeacademy701 ปีที่แล้ว +1

    Great video, can power automate open multiple webpages or tabs at the same time and filling forms or performing clicks on every tab at the same time?

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey Free. Yes 100%, but not 100% at the same time, but right after each other. Kind regards, Anders

  • @fanisz5331
    @fanisz5331 8 หลายเดือนก่อน +1

    Mr Jensen thank you very much for you valuable support.
    I have a quick question about regex. If got the return value is lets say 1000,00 € and I want to retrieve only "1000", what regex should I type ?

    • @andersjensenorg
      @andersjensenorg  8 หลายเดือนก่อน

      My pleasure, you can try with this: \d+(?=,)
      Kind regards, Anders

    • @fanisz5331
      @fanisz5331 8 หลายเดือนก่อน

      @@andersjensenorg Thank you so much for you response. I forgot to mention that the data has a . . It's 1.000,00€ . I noticed that this regex does remove data after comma but it also removes data before dot. It returns 000 Is there a regex that returns 1.000 ?

    • @andersjensenorg
      @andersjensenorg  8 หลายเดือนก่อน +1

      @@fanisz5331 Oh, then you can try: [\d.]+(?=,) 🙂

    • @fanisz5331
      @fanisz5331 8 หลายเดือนก่อน

      @@andersjensenorg thank you so much! Works like a charm!!!

  • @none1615
    @none1615 ปีที่แล้ว +1

    after 30 seconds, I subscribed , What a wonderful channel and content , thanks for sharing with the community .. I am looking for a simple solution to copy all contents of OneDrive including Folders and subfolders and files beneath them and copy/move to sharepoint location .... That scenerio somehow not covered anywhere yet , all examples I've seen were based on file copy / move but none of them showing how to do deal with folder or subfolder creations .. If you read this message and think that would be valuable to the rest community and make short video , that would be greatly appreciated .:)

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4900+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @Palmakify
    @Palmakify ปีที่แล้ว +1

    Thank you for the video, always helpful.
    I have a question: When I try to extract the list of HRef from a website, I only get 2 results written into my excel, but on the preview extraction, it shows me more than 2 results. It's a bit strange that the preview results and the actual extracted results are different.

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks a ton, CP. Can you link to the site? 😊

  • @wallyrogers7501
    @wallyrogers7501 6 หลายเดือนก่อน

    I did pretty good until Create the Dynamic Selector. My code in Inspect properties looked nothing like yours. It would be great to add on the Power Automate version of that step in addition to the developer tools.

    • @andersjensenorg
      @andersjensenorg  5 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @TTtipsforlife
    @TTtipsforlife หลายเดือนก่อน

    hi there, is there a way i can download multiple PDF from a webpage? The challenge is that the PDF changes regularly but luckily on the same web page. I need the automation to be able to dynamically select the new PDF and download. Tried a number of searches but no success. Any support will be much appreciated

  • @suraj_singh321
    @suraj_singh321 ปีที่แล้ว +1

    Hii Anders Sir make a seperate video on Regex what is Regex how we can build Regex and use in uipath and power Automate desktop

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว +1

      Hey Suraj. I will do my best, but have you seen this: th-cam.com/video/TmeGaxksrUA/w-d-xo.html Kind regards, Anders

  • @suraj_singh321
    @suraj_singh321 ปีที่แล้ว +1

    Make a use case different challenging scenarios of Selectors to make Dynamic using power Automate Desktop

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      That's a great idea, thanks a lot, Suraj!

  • @user-og2hy5nc9s
    @user-og2hy5nc9s 10 หลายเดือนก่อน +1

    Hi, i am trying to gather data from a website that has further links on the page. So i need to click on the link extract that data, go back click on the next and so on. There are multiple pages as well. I cant seem loop it through correctly. Can someone provide a step by step guide on how to do this i am new to power automate.

    • @andersjensenorg
      @andersjensenorg  9 หลายเดือนก่อน

      Of course. Kindly see this: th-cam.com/users/live4zmviNtOFwA 😊 Anders

  • @revanth_kanteerava
    @revanth_kanteerava 4 หลายเดือนก่อน

    I want to extract removing the string : Your answer is correct I tried using below:
    (?

    • @andersjensenorg
      @andersjensenorg  4 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @stanTrX
    @stanTrX ปีที่แล้ว +1

    Thanks. There is also set pager property for the next pages, does that work as well?

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @ALVINMAN452
    @ALVINMAN452 7 หลายเดือนก่อน +1

    Very very important video for we all.
    You should made a video only about REGEX it will be nice .
    Many thanks Anders Jensen .
    Obrigado.
    👍👍👍👍👍👍👍👍👍👍👍

    • @andersjensenorg
      @andersjensenorg  7 หลายเดือนก่อน

      Hey Alvin, thank you so much and RegEx for PAD is on my to-do 😊 Kind regards, Anders

  • @billiedwong6982
    @billiedwong6982 ปีที่แล้ว

    great video and sharing! thanks! I tried to run multiple-pages based on your example, I got error: div[id="paginacao"]>div[class="paginationjs"]>div[class="paginationjs-pages"]>ul>li[data-num=16] or 6..not found. any advice?

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว +1

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 9000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @choiboix
    @choiboix ปีที่แล้ว +1

    Can you do a tutorial of scraping similar formatted tables from multiple PDF's to a excel data table? I know you did a powerAI one extracting fields and tables from PDF but that was kind of vague near the end and confusing with the coding stuff. Is there a simpler and more straight forward to set a flow?

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Hey Michael. Are they text or image PDFs? 😊

    • @choiboix
      @choiboix ปีที่แล้ว

      @@andersjensenorg Texts. I believe the PDF was converted from Excel as it has a table format like Excel.

  • @syedimtiaz3558
    @syedimtiaz3558 ปีที่แล้ว +1

    Hi Anders, Thanks for your video. What if you had to run an inner loop for each employee to get some info from his/her profile and then come to the root page which has pagination? Is there any workaround for a scenario this?

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว +1

      My pleasure, Syed. It's almost the approach I take here (just with cars): th-cam.com/users/live4zmviNtOFwA Kind regards, Anders

  • @hossameldinelsayed2689
    @hossameldinelsayed2689 4 หลายเดือนก่อน

    What if i need a scrapper to run everyday and extract html table, the thing is the page count changes every day, when i am trying the pager option it keeps triggering the next button and ends up with an error failed to extract the data

    • @andersjensenorg
      @andersjensenorg  4 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 12,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @JoelNove
    @JoelNove ปีที่แล้ว

    Thank you for your video. I'm creating a flow that extracts my banking information and saves the data to a SharePoint list. I was curious, do I need to keep Power Automate desktop open on my laptop at all times or can the flow be triggered and run on the cloud while laptop is shutdown? Trying to avoid going python rout. Thanks!

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @myworshipresources
    @myworshipresources ปีที่แล้ว

    I want to scrape for the scenario below:
    Scenario: A website has listed 10 articles' titles on each 1/50 pages. The full article can only be viewed when the article's title is clicked which would navigate to the full article page.
    Now, I want to perform this task.
    Step 1: Open the website page 1/50
    Step 2: Scrape the article title 1/10 of page 1/50
    Step 3: Click on the article title 1 to navigate to the full article page
    Step 4: Scrape the whole article from full article view page
    Step 5: Repeat Step 1 - 4 untill all data have been scraped from all 1/50 pages.
    Please solve this. This is very challenging.

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @Philbnyc
    @Philbnyc 8 หลายเดือนก่อน

    I want to take a screenshot for websites from an excel url list , and save the screenshots in a directory with the url name ..possible ?

    • @andersjensenorg
      @andersjensenorg  7 หลายเดือนก่อน +1

      Thanks a lot, @philborrero592 🤗 Your feedback helps me immensely. You're more than welcome at my Discord, where we're 11,000+ RPA developers networking and solving problems: th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @mariavlogs327
    @mariavlogs327 5 หลายเดือนก่อน

    Is there a way to do this on a "Load More" button?

    • @andersjensenorg
      @andersjensenorg  5 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 11,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @viveksview7901
    @viveksview7901 ปีที่แล้ว

    hi if we dont know the last page instead i could see next button on screen for mulitiple data extraction

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 5800+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @benfrankie6936
    @benfrankie6936 ปีที่แล้ว

    how can we automate scraping from sub/inner pages of each profile and scrape phone numbers or emails of each one if available?
    thanks

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 4500+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @aydika1
    @aydika1 ปีที่แล้ว

    Had anyone else had a problem that not all of the elements got selected and later transfered into excel? I only have 1 page but only first 21 names got into excel

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 8000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders

  • @shaolin60
    @shaolin60 ปีที่แล้ว +2

    Thank you for [0][0]

    • @andersjensenorg
      @andersjensenorg  ปีที่แล้ว +1

      A pleasure, Alex, happy to help 😊

  • @bandb1047
    @bandb1047 ปีที่แล้ว

    please can u see easy way?

    • @andersjensenorg
      @andersjensenorg  8 หลายเดือนก่อน

      Thanks for writing 😊 I'm getting more than 50 messages daily. While I read all of them, I can’t reply to everyone 😔 But I’ve created an RPA/Automation community where we’re 10,000+ RPA Developers helping each other with solutions and our careers. Here’s the video on how to join (the invitation link is in the video description): th-cam.com/video/xWFz-S96XGo/w-d-xo.html Kind regards, Anders