Excel - Scrape Weather Data from Weather Underground Webpages Using Power Query - Episode 2056

แชร์
ฝัง
  • เผยแพร่เมื่อ 25 ต.ค. 2024

ความคิดเห็น • 44

  • @kennethvela2784
    @kennethvela2784 4 ปีที่แล้ว +1

    Somebody left in my company, and I'm in charge to deliver information for 750 dayli records from the web, this totally simplified my work, just what I was looking for, thank you very much

  • @dougmphilly
    @dougmphilly ปีที่แล้ว

    somebody should be awarded a nobel prize for thinking of this.

  • @laviedandre
    @laviedandre 8 ปีที่แล้ว

    In the words of the great Mike "ExcelIsFun" Girvin - "You have GOT to be kidding me!" This was an amazing video - thank you!

  • @Mrdayz
    @Mrdayz 2 ปีที่แล้ว

    Thanks, this was super useful. Thank you.

  • @excelisfun
    @excelisfun 8 ปีที่แล้ว +1

    Thanks for the Power Query Radness!!! $74 bucks, that is a great deal!

  • @binhdo20
    @binhdo20 3 ปีที่แล้ว

    Amazing video!! This is what I am looking for

  • @sadinenim5360
    @sadinenim5360 2 ปีที่แล้ว

    Hi Bill in real time scenarios it will ask for a sign in page before opening any office portal. can you help me how we can do web scrapping in that cases.

  • @MySpreadsheetLab
    @MySpreadsheetLab 7 ปีที่แล้ว +2

    I was wondering if power query could do this easier than vba. Now I know! Thanks Bill !

    • @kennethvela2784
      @kennethvela2784 4 ปีที่แล้ว +1

      I was doing g the same thing, learning VBA to webscrap, but this is much better

  • @sheetsack3179
    @sheetsack3179 2 ปีที่แล้ว

    Any chance to scrap data from Vidiq or some sites that require login?

  • @TroyJScott
    @TroyJScott 6 ปีที่แล้ว

    Wow. Thank you.
    Thank you. Thank you
    Keep putting the good word out.
    From FTW, Troy

    • @MrXL
      @MrXL  6 ปีที่แล้ว

      Thank you Troy Scott.

  • @thomasmason4241
    @thomasmason4241 5 ปีที่แล้ว +1

    This is great, is there a way to combine 2 different queries into one table? For example there are 2 separate tables on each page that i want to extract data from. i Have been able to suceed using you method to get 1 table extracted over multple pages. (is there a way to join the second table?

  • @niuean22kid
    @niuean22kid 4 ปีที่แล้ว

    Fantastic !!!!! One question
    Why only 15 days ? I am so interested to know how you can work with dynamic months with different max min days

  • @krishnakishorepeddisetti4387
    @krishnakishorepeddisetti4387 4 ปีที่แล้ว

    Hi Bill,
    What if the last page is not known....how can i dynamically define the last page.
    Kindly help me with your inputs.
    Amazing video bill :)
    Thanks and Regards
    Kishore

  • @faisalshaikh7501
    @faisalshaikh7501 4 ปีที่แล้ว

    Please let me know ..how can I attend your seminars?

  • @FRANKWHITE1996
    @FRANKWHITE1996 4 ปีที่แล้ว

    It is amazing! 🤩🤩🤩🤩🤩🤩🤩🤩

  • @grossepioche
    @grossepioche 4 ปีที่แล้ว

    Great explanation Thanks, what if there is a LOG In to the weksite? Take care and thanks again!

    • @MrXL
      @MrXL  4 ปีที่แล้ว +1

      If you are using Office 365, there is now a way to specify the authentication method for the call to the website.

  • @josephdagostino9799
    @josephdagostino9799 8 ปีที่แล้ว

    absolutely incredible, great video.

  • @hariyantowidjaja6167
    @hariyantowidjaja6167 4 ปีที่แล้ว +1

    Hi, how if the website required user & password?

  • @grahambeyer6254
    @grahambeyer6254 2 ปีที่แล้ว

    What about Timeout error after 100 seconds?

  • @deepakagrawal465
    @deepakagrawal465 8 ปีที่แล้ว

    Amazing video!! Thanks!

  • @thomasmason4241
    @thomasmason4241 6 ปีที่แล้ว

    Thanks for this its fantastic just subscribed. one question,
    It works perfect when the table header of the original query is exactly the same as the new table in the different URL. My problem is the example I'm trying to do, the second URL sometimes changes the headers slightly depending on the site. Therefore when i run the query it comes up with the "[Expression.Error] The column 'xxxxxx' of the table wasn't found".
    I was wondering if there was was a way to have Power query search for a second header if there is an error on the first.
    It would be great if you could do a vid on this thanks

  • @wfbane
    @wfbane 8 ปีที่แล้ว

    This is very powerful. However I sometimes get a Power Query error "Operation is not valid due to the state of the object" (for whatever that's worth!)

  • @kevinlabore1726
    @kevinlabore1726 6 ปีที่แล้ว

    Thanks great video as always -- have you done any examples with "Scraping" data from Website that are note using tables? Cam you still use M / Power Query or do you have to use R-Script or similar?

    • @MrXL
      @MrXL  6 ปีที่แล้ว +2

      I don't have any videos using R-script. I want to learn R, but I haven't gotten there yet.

    • @kevinlabore1726
      @kevinlabore1726 6 ปีที่แล้ว

      So much to do -- so little time :) R-Script seems like it lots of things it can do -- thanks!

  • @kldpmishra
    @kldpmishra 2 ปีที่แล้ว

    Guruji 🙏

  • @vitaly7396
    @vitaly7396 5 ปีที่แล้ว

    Man, you so much helped me! THX YOU

  • @mohamedadjal8502
    @mohamedadjal8502 3 ปีที่แล้ว

    Hi, Professor, you have provided a lot of effort for these videos, thank you, I have a question in excel, if we have for example in cell "a1" the number 10.00 m, how to have this number in the same format in cell "b1 "using a text function or some other function, thank you very much.😃👍

    • @MrXL
      @MrXL  3 ปีที่แล้ว

      I am going to ask you two important questions:
      1) Go to cell B1. Type a formula of =A1 and press Enter. What do you get in B1? Are you getting something like 10? Can you try this: Copy A1. Select B1. Right-click B1. In the row of paste options, choose the 5th item (Formats). Does that correct the problem?
      2) With cell A1 visible, press Ctrl and the grave accent (`). What do you see in A1 now? Press Ctrl+` to go back to the normal display.

    • @mohamedadjal8502
      @mohamedadjal8502 3 ปีที่แล้ว

      Good morning, when we use the search functions in Excel, we do not get the
      cell formatting that we are looking for.
      I want to get the full cell format. Is that possible? I thank you for all the efforts you are making through these videos,
      thank you so much.😃👍

    • @MrXL
      @MrXL  3 ปีที่แล้ว

      @@mohamedadjal8502 Please watch this video: th-cam.com/video/h1xM8A_4v8U/w-d-xo.html
      As you can see, it is working for me. Let me know what part of this scenario is different for you.

    • @mohamedadjal8502
      @mohamedadjal8502 3 ปีที่แล้ว

      Good evening Professor, I thank you for the answers that you sent me on the Internet. May God protect you. Suppose we have in cell a1 = "excel", in cell a2 = "is", in cell a3 = "fun", in cell b1 = 12.00m, in cell b2 = 10.00gr, in cell b3 = 15.00kg, use the vlookup function: vlookup = ("is", $ a $ 1: $ b $ 3,2, false), the result is 10, which means that This function didn't give me the full format of the number in cell b2 (b2 = 10.00gr), but my goal is to get b2 = 10.00gr and not b2 = 10. thank you so much.😃👍

  • @jamesevins800
    @jamesevins800 4 ปีที่แล้ว

    Is your book available in a book store? Amazon is whack if they think I am paying $40+. Amazon ain't no bargain. I want your book but not at $40+. I will buy it for its asking price but their shipping cost is ridiculous.

  • @innerfire81
    @innerfire81 6 ปีที่แล้ว

    Thanks for this video. When I follow the instructions you provided for adding the column in Power Query, at 4:06, the resulting column is full of "error" values. When I drill down, I see the following error message:
    An error occurred in the ‘’ query. Expression.Error: The column 'Temperature (° F)' of the table wasn't found.
    Details:
    Temperature (° F)
    When I initially pulled in the data from the table from Weather Underground, I went to Power Query and removed the Temperature Column, or so I thought. Maybe I renamed it. In any case, I followed the steps exactly for adding the column into the query created from the daily weather data table. I'm not sure what I'm doing wrong.

    • @mathewbrianfisher
      @mathewbrianfisher 4 ปีที่แล้ว

      did you find a solution for this? Im having a similar issue scraping a different webpage.

  • @GokhanAcikgoz-f1d
    @GokhanAcikgoz-f1d ปีที่แล้ว

    hello teacher,
    I watched your videos on TH-cam and wanted to consult you about a difficult issue.
    We want to dump the websites and e-mail addresses of the brands we found on the internet into Excel. In other words, the company or brand name on the left line, the website and email taken from automatic google right next to it.

    As we find new brands, we will add them to the excel file and as the code runs, it will continue to find their website and emails.
    I would be very grateful if you could help with this, free or paid.
    Enjoy your work.