The hidden gem of TH-cam ! Andrew deserves millions of subscribers! So glad I found you. Please keep on providing awesome tutorials and spreading amazing knowledge to the world !!!
I have watched 2 times, the first time is typing the code when the video is proceeding and 2nd time is reviewing and digesting the code. Thanks for the valuable video.
@@WiseOwlTutorials Dear Valuable Content Creator, I have been following your content for a short while. I think your content is in the standards of training sets. By the way, I am trying to reach you from Turkey. English is not known enough in Turkey. For this reason, I would like to voice your content in Turkish and ensure that it is delivered to your followers in Turkey in a way that will be more beneficial. Of course, I will need your permission for this. I will redirect you to your youtube account and website for the original content link under each of your content that I voiced. As you know, it does not make a lot of money for its producers on youtube for such specific issues. The purpose of this proposal is for non-English speaking enthusiasts to get to know you and better understand what you are telling. I hope you welcome my offer. I wish you good work. Fuat Arslan
@@fuatarslan3359 Hi Fuat, many thanks for your kind offer! I'm only an employee of Wise Owl and all of the video content is owned by the company. I'm sorry but the company won't give permission for others to make copies of their content.
WiseOwl! Just wanted to take a minute to show my appreciation for this video. I've been following it for the last few days as I build my own web-scrapper to automate a rather lengthy procedure I do daily as part of my workflow. Originally I was planning on creating a separate web-scrapper with Python that I would then have to format using macros, but thanks to you, I'm able to store the whole process neatly into a single workbook! Plus, I learned a whole lot of new stuff about VBA along the way. You're a fantastic and incredibly engaging teacher, god bless!
Andrew, your videos are just priceless. I watched a lot of them and It gave me sooooo much when I started to study VBA. I am so grateful to you! May the Force be with you!
Thank you!! With this video you saved my 10 years work building a VBA automated scraper system based on IE. Over 10k lines of code! I look forward Microsoft great thinkers get what they deserve, as they got with Windows 8.
FYI - I was able to overcome the Chromedriver version error by saving the downloaded version, per the error message, to C:\Users\(username)\AppData\Local\Selenium Basic\Chromedriver.exe. I tried various other solutions to no avail. Thanks for a great video! I'm overdue updating my Internet Explorer web scrapers. This is a big help.
Your videos are the best. I love the way you teach 😊. I never felt that your videos are too long because of your teaching style. wise owl 🦉 Is One of my favorite channels on TH-cam. I can feel the hardwork, you put into every single video. Like adding chapter, or explaining code in simple words. I really like your efforts from my heart.
Your videos have been excellent. Although i have a finance background, your videos helped me automate my work for my team. I got tons of praise for it. The VBA for internet explorer used to work and since it's being decommissioned, i would need to amend the code for Chrome. I could not find any material elsewhere but the best place to find it is your channel. Thanks Andrew! & i made a donation as well
You have relieved me of a huge burden. In particular, it was easy to follow the flow of your lecture because it was explained using one web site and it could be applied immediately because you showed representative cases. Thanks
Hi Andrew, your videos have helped me so much, they have taken my career to another level :) Before I was being flooded by Excel reports, and now with Macros I do the same job with a couple of clicks, And this allows me to have time to learn even more, Thanks again,
Absolutely fantastic, these videos are so easy to understand and follow, already thinking of the many ways to utilise the skills and knowledge learned in this particular video. Big thanks!
I literally could not have asked for a more specifically relevant video needed than this one I have just watched and completed if I had actually paid for it. It was quite simply perfect. This is all thanks to (in my opinion) one of the very best tutors I could have ever wished for in Andrew Gould. You make me feel about VBA and coding as Yoda made Luke feel about being a Jedi. Do or do not. There is no try.
Ben, I love this comment! Genuinely happy that you found the video so useful and I'm grateful that you took the time to pass on your feedback. This channel would be nothing without an audience of enthusiastic people like yourself - happy to have you on board!
Hi Andrew, Thank you for posting this tutorial. This tutorial explains everything. Your videos are very educative and informative. Your video is the far most best video on web scraping with selenium and google chrome. I was looking something on this topic from a very long time.
Hello Andrew! I have been watching some of your content and decided to finally comment to say thank you for your awesome work. Your content is very high quality and you are amazing teacher. I wish you all the best from Hungary!
Wonderful, structured and very informative tutorial, sir I have seen your all 102 tutorials they are very good thank you for sharing you precious knowledge.
Thank you very much my tutor Andrew. Really amazing and awesome. I know a lot about selenium but I have enjoyed watching your video and the video added new points to me.
Hello Andrew, Your videos are fantastic, love the passion in your voice. Actually i have one question and hope that you will help me even though this video is 2y old. But when i put in vba the formula ....FindElementByClass(...).Click i have a debug which says "Run - time error "32" : Invalid selector Error invalid selector From java script error {"status":32 " value : "Compund class names not permitted"} (sessio info: Microsoft Edge = 126.0.2592.87) Driver info: msedgedriver = 126.0.2592.87 and some random numbers and letters.platform=Windows. Do you know maybe hot to repair it ? Thank you for the help
Hi! You might find this video helpful th-cam.com/video/lr7CFZEI2YA/w-d-xo.htmlfeature=shared I'm fairly certain I mention compound classes in there and it provides various other options for finding elements that you should find useful. I hope it helps!
I used the internet explorer browser to scrape from Google Maps, it does not load more than 10 results, after finishing my code with the conventional VBA libraries (not Selenium) , checked the same link in a chrome browser and discovered that it gathers all results possible, so searched for automation using Selenium and found this playlist, it is awsome and specially this video where you can check if the element is there or not as in Google maps results you may find a website or not, a phone number or not and so on, Awsome videos till now
@@WiseOwlTutorials hello and thanks for your answer, i have a big question and i need your help, who can work with popups when i need to click on this popup?
@@vicenteantoniomagallanesju5289 Hi Vicente! It depends on the type of popup. Here's an example of a simple popup to confirm cookies settings th-cam.com/video/-kjq_8i9buM/w-d-xo.html I hope it helps!
Hi Andrew, you are the best teacher. The way to describe small small point that so useful & I leaned all data skill from your channel . Thanks for that. I have one question can you please how to trigger the pop window that comes after downloading some file from web. I want to save download file to specify folder. Thanks for all your efforts on teaching.
Thanks so much Ravi! The downloading files topic with Selenium is on my list. We do already have a video which shows how to download files using a Windows API function and XML HTTP requests which you might find useful if you haven't already seen it www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/
Excellent tutorial as usual and I love referring people here. Your skill as a teacher is wonderful. Hopefully you will cover more on the power of using css and xpath e.g. 30:13 avoid loop with xpath e.g. "//h2[contains(text(), 'Video tutorials (')]" or "//h2[contains(text(), 'Video tutorials (')]/following-sibling::*//table" ; modern browsers are optimized for css selectors so it is an essential skill in the webscraper's toolbox. I appreciate it becomes a lot more in depth at that point but perhaps you do a couple of short videos just outlining those? FYI To get the links included you could instead transfer the outerHTML of the table element to clipboard and paste to sheet. Few more lines of code however. Very much looking forward to Dax measures videos!
Thank you so much! And yes, I'll be covering how to find by css and xpath later on (I thought this video was long enough already without including those!). Thanks for the tip about the clipboard, I'd forgotten about that. I appreciate all the comments and thanks for watching!
great video. I am still having trouble holding the Website up, its still closing down at the end of the routine, even though l put the private ch as Selenium. Chrome Driver
Thanks Ian! Strange that your browser closes. Providing the variable remains in scope at the end of the procedure and you haven't explicitly closed it, it should remain open.
Hello, thank you for the video. I need help, please What should we do? If the site requires you to log in first, then scrape the data from it after that
Thank you Andrew, just started my Selenium tour with your videos, but I've one question: is it possible to get the "xpath" by using contains.text function? I'm trying to retrieve all text from every post of facebook, looking for keywords and then capture all texts / links/ and the name of the poster, please help! Thank you!
Now that IE is retiring but you need the automation that IE offers. Fortunately, there's SeleniumBasic and can be used together with MSHTML, so all the things that I have learned to control IE from this channel over the years won't go to waste, which is a relief. Just a quick question, please: How to interact with browser's 'Save' dialog box after clicking on download button or link? Thank you very much, by the way for posting this helpful video..
Hi! I don't know how to interact with the Save dialog box. I'd just use the URLDownloadToFile function th-cam.com/video/JPezrWwvsJM/w-d-xo.html I hope it helps!
@@WiseOwlTutorials Thank you very much for the link. I believe, I've seen that video. Unfortunately, I don't have a download link, the 'href=' attribute only contains "#". But if you click it, a dialog box appears. On IE, it's the yellow banner at the bottom. There is a code on SO-StackOverflow on how to capture the handle of the window using Windows API, just like the one on the link that you shared although a different .dll file. But there, it's just a code with insufficient explanation. I will just connect the idea from the link you shared and the code from SO because I think both have the same approach, just different .dll files. Thank you so much. I appreciate it..
Andrew, this is an awesome video. However I am having difficulty with the current website and at 11:50, you are FindElementByName("what"). On the current website there is a question mark, and I cannot figure out how to navigate the input of "Excel VBA" to that dropdown. How do I do this with the current website? Many thanks
Indeed, the problem with websites is that they're constantly changing! You might be able to find an old version of the Wise Owl website on the Wayback Machine which you could use to practise - here's one that might work web.archive.org/web/20221228132939/www.wiseowl.co.uk/ Hope it helps!
If I design a macro-enabled Excel file using Selenium to do web scraping per your video, will the file work on another computer that only has Chrome installed? Essentially, I want the file to do automated work for folks in my organization that are not VBA- nor computer savvy. I started to create one using IE, but didn't know about the sunsetting to Microsoft Edge.... Thanks in advance! Best, Bill
Hi Bill! Unfortunately, you would need to install the SeleniumBasic library on the computers which run the code (and keep the ChromeDriver up to date on those machines as well). It's not an ideal solution but unfortunately there aren't any good solutions for distributing VBA-based web scraping projects.
Fantastic video! You mention towards the end that there are ways to speed the process up by switching a few things off. Is it possible to turn the browser visibility off like you can do with "IE.visible = false"?
Thanks! And yes, you certainly can run Chrome invisibly - I have a video recorded but not edited which demonstrates this which I'll upload hopefully some time this week. While you're waiting, you could try this: Sub GetTopFilms() Dim cd As Selenium.ChromeDriver Dim t As Selenium.WebElement Set cd = New Selenium.ChromeDriver cd.AddArgument "--headless" cd.Start cd.Get "en.wikipedia.org/wiki/List_of_highest-grossing_films" Set t = cd.FindElementsByCss("table")(1) t.AsTable.ToExcel Worksheets.Add.Range("A1") cd.Quit End Sub And for more information, see here developers.google.com/web/updates/2017/04/headless-chrome Hope it helps!
All is great but for me who is trying to print out a single element, I might have missed it, and see all built on extended functions instead. Have to search all over the place for a simple version.
Great video,How can I do when a link that we click by code returns a new page in another tab and we want to capture that new page to continue capturing information from that new. Thanks for any help
Nice videos. Is it possible to open multiple tabs, And later navigate between tabs, using Excel VBA. If so please help me with that, how to do it in excel. Thanks in advance.
Hi Jawahar! Yes you can open new tabs and navigate between them. It's probably easiest to point you to some examples which other people have written, I hope that it helps! stackoverflow.com/questions/53381891/create-new-tab-for-each-google-search-by-selenium-in-excel-vba stackoverflow.com/questions/55666348/open-new-chrome-tab stackoverflow.com/questions/56314471/selenium-basic-vba-focus-on-new-tab-that-is-opened-by-click
hi Andrew, Great edu again. Wonder if you could make one on popups, switch etc. i'm stucked there... after clicking to a new window/page but I can't acces the elements because i'm still in the page where I came from. Hope you understand Thanks
Hi Erik, thanks for the comment! Do you have the link to the page/pages you're having popup problems with? There are a few different types so it would be useful to see the exact one you're dealing with, thanks!
@@WiseOwlTutorials Thanks for reply. I allready foud the solution by finding the url of that new screen and followed that link I ended up in the right page and can access the elements.
Andrew, thanks so much for your tutorial! Do you perhaps know how to execute a print command after running ch.Get? With the old InternetExplorer object, this was simply done by running the line Explorer.ExecWB 6, 2, "", "" but for the life of me can't figure out how to do this with the ChromeDriver. Thanks again.
You're very welcome, glad you enjoyed it! I have a feeling that I'm missing an easier way to do this but the simplest method I could find was to disable Chrome's print preview and then send keystrokes to simulate pressing CTRL + P followed by ENTER Sub SeleniumPrintWithoutPreview() Set cd = New Selenium.ChromeDriver cd.AddArgument "--disable-print-preview" cd.Start cd.Get "www.wiseowl.co.uk" VBA.SendKeys "^p" Application.Wait Now + TimeValue("00:00:02") VBA.SendKeys "{Enter}" End Sub If you want to work with Chrome's print preview, that's a little trickier! The print preview runs in a separate window and contains a nested set of shadow DOMs (here's some background on what that means developers.google.com/web/fundamentals/web-components/shadowdom) Here's some very inelegant code to hit the print button in Chrome's print preview: Sub SeleniumPrintWithPreview() Dim ShadowHost As Selenium.WebElement Dim ShadowRoot As Selenium.WebElement Dim PrintButton As Selenium.WebElement Set cd = New Selenium.ChromeDriver cd.Start cd.Get "www.wiseowl.co.uk" VBA.SendKeys "^p" 'switch to the Print Preview window cd.SwitchToNextWindow 'Walk down the nested shadow DOMs to get to the print button Set ShadowHost = cd.FindElementByCss("print-preview-app") Set ShadowRoot = cd.ExecuteScript( _ Script:="return arguments[0].shadowRoot", _ arguments:=ShadowHost) Set ShadowHost = ShadowRoot.FindElementByCss("print-preview-sidebar") Set ShadowRoot = cd.ExecuteScript( _ Script:="return arguments[0].shadowRoot", _ arguments:=ShadowHost) Set ShadowHost = ShadowRoot.FindElementByCss("print-preview-button-strip") Set ShadowRoot = cd.ExecuteScript( _ Script:="return arguments[0].shadowRoot", _ arguments:=ShadowHost) Set PrintButton = ShadowRoot.FindElementByCss(".action-button") PrintButton.Click End Sub I'm not sure if there's a better way to do this (surely there must be!) but I'll have to spend some time investigating. I hope that helps in the meantime!
@@WiseOwlTutorials Wow, thank you SO much, Andrew! The no print preview seems to be working just fine for my purposes. I'm actually sending web pages to PDF, so no dialog is the preference. Is there an easy line of code that suppresses the Chrome browser altogether so it runs in the background? Thanks again!
@@dangre00 No worries! There certainly is a way to run Chrome hidden using Headless Chrome (background info here developers.google.com/web/updates/2017/04/headless-chrome). I have a video on this but it's not yet published so here's the basics: Sub GetHighestGrossingFilmsTable() Dim cd As Selenium.ChromeDriver Dim t As Selenium.WebElement
Superb well explained video. Many thanks! One question - is there any video where I can learn how to extract test and close alerts or pop-ups from a web page?
Thank you Rajiv! We don't have a specific video on closing alerts and pop-ups although I did cover one technique for pop-ups on Yahoo Finance as part of this video th-cam.com/video/_IlkdRwgIwg/w-d-xo.html Not every pop-up is the same however, so that technique may not work for every situation!
Amazing video Thank You.I want ask this. For example I was make application like in here sample for my friend.it must installed too Sellenium library in my friend's computer too? Again thank you for this amazing tutorial
@@WiseOwlTutorials Thank you for reply ? Could you make an video about automatic installation example for Selenium ? I mean VBA checking Chrome version and and copy suitable Chromedrive exe to suitable folder ? Also I want ask this How can make Turkish text reading application in VBA ? I mean exce (or any installed library etc ) can talking Turkish text ? Google Documents supporting to Turkish voice API Could you make this kind video ? (Sorry for my bad English, I hope undertand me )
@@Yorumcu63 Your English is much better than my Turkish! I don't think the automatic installation of Selenium would work - in order to open Chrome and check the version (I'm not certain if that's possible in VBA) you'd need to have Selenium installed already. You can perform basic text-to-speech in VBA using the Application.Speech.Speak method so for example: Application.Speech.Speak Range("A1").Value would speak the contents of cell A1 in the default voice assigned to the Text-To-Speech settings in Windows options. We have a video which covers the basics of this technique which you can see here th-cam.com/video/AD2nkTGkO4E/w-d-xo.html Microsoft's documentation says that there is a Turkish voice and speech pack (his name is Tolga!) and you can see how to install it here support.microsoft.com/en-us/topic/how-to-download-text-to-speech-languages-for-windows-10-d5a6b612-b3ae-423f-afa5-4f6caf1ec5d3?ui=en-us&rs=en-gb&ad=gb I hope that helps!
Hi tanks for fantastic tutorials i have some problem i install latest version of firefox and selenium but when i want to start firefox have this error:"firefox failed to open the listening port 127.0.0.1:58849 within 15s
Hi Hamid, unfortunately SeleniumBasic no longer works with FireFox. The SeleniumBasic library was last updated in 2016 and appears unlikely to be updated to work with the changes to FireFox.
Andrew - amazing work mate, question, how best to deal with a ElementNotVisibleError element not interactable, ? this is happening as i try to click on a sub menu that sits under a parent menu item. Thanks mate.
Thanks Fredy! There could several reasons for this - it's possible that adding a simple Wait between clicking the parent item and clicking the sub menu item could solve it. Do you have the specific example you're trying?
Very interesting chrome driver for VBA. How can I find a specific value inside a child "xxxx" where I know the parent tag TEXT I NEED Without it going all over the page tags. Thank you
Hi Marc! I'd check out part 57.4 which covers lots of techniques for referencing elements. I'd focus on CSS selectors or XPath to get what you need. I hope it helps!
Hi, How could I Press "ESCAPE" or "ESC" to close a popup when I Scrape using vba , chome and Selenium? I have tried with findElementby... but nothing work. I realized that when I press ESC all pop up closes and that could help. Thanks
Hi Henry! You could use the SendKeys method to do this learn.microsoft.com/en-us/office/vba/api/excel.application.sendkeys Application.SendKeys "{Esc}" I hope it helps!
I tried to search on this site : property-beta [dot] phila [dot] gov and there is a class name for input but it does not work to send the keys... Tried everything... There is an id but it is dynamic (it changes each time page loads). It does not work either without using selenium commands like you have shown in an old video. Can you please help?
Hi Aaron, the form which contains the input has a fixed ID so you can use that to locate the form and then find the Input element within, this works: Private cd As Selenium.ChromeDriver Sub PhillySearch() Set cd = New Selenium.ChromeDriver
cd.Start cd.Get "property-beta.phila.gov/#/"
Dim SearchInput As Selenium.WebElement
Set SearchInput = cd.FindElementByCss("#search-form input")
SearchInput.SendKeys "a house"
End Sub This video covers more on CSS locators if you're interested in how it works th-cam.com/video/lr7CFZEI2YA/w-d-xo.html
Hi! There's an example of referring to drop down list values in this video th-cam.com/video/_IlkdRwgIwg/w-d-xo.html You can find the list of chapters in the video description, it's around 26 minutes. I hope it helps!
@@WiseOwlTutorials Thank you. It worked. Now the issue is that after selecting the option on the list, the page starts loading the selection, but never finished.
Is there away to check if an element exists inside a collection of elements. For example: You have a div class ="phone number" tag that exists in each div class="result" tag, but all div class="result" may not have a div class="phone number" tag. this means as you loop through the collection of div class="phone number" in each div class="result", the company that does not have a phone number will be assigned a phone number from the div class="result" below it. What I want to do is either labeled that cell as "No phone number" or Null in the [Phone Number] field, so this company will not be assigned a phone number from another company below preventing that data from being assigned to the wrong record for that [Phone Number] field.
Hi there! We have a video which explains referencing elements in lots of detail which you might find useful th-cam.com/video/lr7CFZEI2YA/w-d-xo.html You can find the chapter list in the video description and you'll be interested in the sections on "Checking If an Element is Present" and the section beginning at "Narrowing Scope with CSS Selectors" I hope it helps!
Hi Fabian! It depends on the website you're using. If there's a convenient form on the page to enter your Username and Password you may be able to use Sendkeys to type your credentials and then Submit the form. If the site uses Windows security you might find this video useful th-cam.com/video/Oxx6t6BEJAw/w-d-xo.html (sorry it uses Internet Explorer!). If the site is more complicated than that you may find that you need to use a provided API and get involved with OAuth2 but I don't know enough about that to give you any good advice, sorry! stackoverflow.com/questions/55882439/vba-api-get-that-requires-request-token-authorizing-and-access-tokens
Hello and many tanks for this great tutorial. I found a problem during my test on the website I want to use with Excel. The problem is that at the las point of the order process, to confirm an submit the order I have a Pop-up message where I need to click OK. Unfortunately I don't now how to deal with it. Do you have a solution for this problem? Thank you in advance, Alin
Hi Alin, sorry I don't have a specific technique to use for this, which site are you using? If you post your code I might get chance to look at it but you might have more success posting a question at somewhere like StackOverflow.com (they have many people ready to answer questions!)
Yes you can write data to Access. Videos 31 and 32 in this playlist show you two different ways to do that th-cam.com/play/PLNIs-AWhQzclbRVLCZlsFvpz6fz2nPGbt.html I hope it helps!
The hidden gem of TH-cam ! Andrew deserves millions of subscribers! So glad I found you. Please keep on providing awesome tutorials and spreading amazing knowledge to the world !!!
Thank you! I really appreciate the support, thank you for taking the time to leave a comment!
I second this!!!
I have watched 2 times, the first time is typing the code when the video is proceeding and 2nd time is reviewing and digesting the code. Thanks for the valuable video.
You're very welcome! Happy to hear that you found it useful!
Honestly, I think you're the best instructor in TH-cam
Thank you so much, it's very kind of you to say!
👋
@@WiseOwlTutorials
Dear Valuable Content Creator,
I have been following your content for a short while. I think your content is in the standards of training sets.
By the way, I am trying to reach you from Turkey. English is not known enough in Turkey. For this reason, I would like to voice your content in Turkish and ensure that it is delivered to your followers in Turkey in a way that will be more beneficial.
Of course, I will need your permission for this. I will redirect you to your youtube account and website for the original content link under each of your content that I voiced.
As you know, it does not make a lot of money for its producers on youtube for such specific issues. The purpose of this proposal is for non-English speaking enthusiasts to get to know you and better understand what you are telling.
I hope you welcome my offer. I wish you good work.
Fuat Arslan
@@fuatarslan3359 Hi Fuat, many thanks for your kind offer! I'm only an employee of Wise Owl and all of the video content is owned by the company. I'm sorry but the company won't give permission for others to make copies of their content.
WOW! A Real Excel Máster!
I watch for 1 hour straight! Best Tutor!
Respect!
Thank you, glad you enjoyed it!
WiseOwl! Just wanted to take a minute to show my appreciation for this video. I've been following it for the last few days as I build my own web-scrapper to automate a rather lengthy procedure I do daily as part of my workflow. Originally I was planning on creating a separate web-scrapper with Python that I would then have to format using macros, but thanks to you, I'm able to store the whole process neatly into a single workbook! Plus, I learned a whole lot of new stuff about VBA along the way. You're a fantastic and incredibly engaging teacher, god bless!
Thanks for taking the time to write this, it's great to hear that the videos have been so useful!
Andrew, your videos are just priceless. I watched a lot of them and It gave me sooooo much when I started to study VBA. I am so grateful to you! May the Force be with you!
Very happy to hear that you've found the videos so useful! Thanks for the comment (and the SW reference!)
Thank you!! With this video you saved my 10 years work building a VBA automated scraper system based on IE. Over 10k lines of code! I look forward Microsoft great thinkers get what they deserve, as they got with Windows 8.
Happy to hear that it helped Italo! Your system sounds incredible!
FYI - I was able to overcome the Chromedriver version error by saving the downloaded version, per the error message, to C:\Users\(username)\AppData\Local\Selenium Basic\Chromedriver.exe. I tried various other solutions to no avail.
Thanks for a great video! I'm overdue updating my Internet Explorer web scrapers. This is a big help.
Happy to hear that you solved it Blake, thanks for taking the time to share your solution!
Your videos are the best. I love the way you teach 😊.
I never felt that your videos are too long because of your teaching style.
wise owl 🦉 Is One of my favorite channels on TH-cam.
I can feel the hardwork, you put into every single video. Like adding chapter, or explaining code in simple words.
I really like your efforts from my heart.
Thank you Gagan, I really appreciate the comments!
I don't want VBA to disappear 😭 Thank you Google for keeping VB alive
I must say this is the best web scrapping video for beginners. Thanks a lot
I'm really happy to hear that you found it useful, thank you for watching and for taking the time to leave a comment!
Your videos have been excellent. Although i have a finance background, your videos helped me automate my work for my team. I got tons of praise for it. The VBA for internet explorer used to work and since it's being decommissioned, i would need to amend the code for Chrome. I could not find any material elsewhere but the best place to find it is your channel. Thanks Andrew! & i made a donation as well
Thank you Arvinth! I appreciate the support and am happy to hear that the videos have helped you so much!
Wow! Thank you Andrew! This is by far the best tutorial I've come across online on this topic!!
Happy to hear that you found it useful! Thanks for watching and taking the time to leave a comment!
You have relieved me of a huge burden. In particular, it was easy to follow the flow of your lecture because it was explained using one web site and it could be applied immediately because you showed representative cases. Thanks
Happy to hear that the video helped you, thanks for watching!
the way you teach is AMAZING it’s so hard to find a good tutorial on vba thank u so much i hope u share more about vba :) i love u
Thanks so much!
Hi Andrew, your videos have helped me so much, they have taken my career to another level :)
Before I was being flooded by Excel reports, and now with Macros I do the same job with a couple of clicks,
And this allows me to have time to learn even more,
Thanks again,
Very happy to hear that Mauricio! Thank you for watching and for taking the time to leave such a nice comment!
best best best channel. It has increased my workflow and allow to develop tools for my department
That's great to hear Stephen! I'm happy that you've found the videos useful, thanks for taking the time to leave a comment!
Absolutely fantastic, these videos are so easy to understand and follow, already thinking of the many ways to utilise the skills and knowledge learned in this particular video. Big thanks!
Happy to hear you've found it useful, thanks for watching!
I literally could not have asked for a more specifically relevant video needed than this one I have just watched and completed if I had actually paid for it. It was quite simply perfect. This is all thanks to (in my opinion) one of the very best tutors I could have ever wished for in Andrew Gould. You make me feel about VBA and coding as Yoda made Luke feel about being a Jedi. Do or do not. There is no try.
Ben, I love this comment! Genuinely happy that you found the video so useful and I'm grateful that you took the time to pass on your feedback. This channel would be nothing without an audience of enthusiastic people like yourself - happy to have you on board!
Excel-lent video with easy to follow process logic. Thanks!!
😀 glad you enjoyed it!
Very well done. Thanks so much for sharing
You're welcome, thanks for watching!
Hi Andrew, Thank you for posting this tutorial. This tutorial explains everything. Your videos are very educative and informative. Your video is the far most best video on web scraping with selenium and google chrome. I was looking something on this topic from a very long time.
I'm so happy that you found it useful! Thank you for watching and for taking the time to leave a nice comment, we appreciate it!
Comprehensive tutorial as always. Thank you sir.
Thank you, glad you found it useful and thanks for watching!
Hello Andrew!
I have been watching some of your content and decided to finally comment to say thank you for your awesome work. Your content is very high quality and you are amazing teacher. I wish you all the best from Hungary!
Hello! Thanks for watching and for taking the time to write a comment!
I am extremely thankful for your helpful videos Andrew! You're the man!
Thanks Charlie!
Your videos are amazing, thanks, greetings from Costa Rica
Thank you Jorge!
You are great!
And I wish you the very best today!
Thank you! And all the best to you as well!
Wonderful, structured and very informative tutorial, sir I have seen your all 102 tutorials they are very good thank you for sharing you precious knowledge.
You are very welcome! Thank you for watching and taking the time to leave a comment!
Uff My poor little excel dedicated computer took a while to scrape all 130 results on "excel VBA"
Thank you so much! On to the Task!
I hope your computer survives!
Thanks. As usual a very clear explanation of a complicated topic. :)
Thanks Stephen, glad you found it useful and thanks for watching!
Your classes are amazings! Thanks for all
Thank you Marcelo!
WoW. What a detailed informative video. great helping content.
Thanks JK, glad you found it useful!
Very useful video.thanks, Looking forward for more advanced videos like ms access VBA, ms word VBA.👍
Thank you Vijaylakshmi!
brilliant! Thank you so much!
Thank you for watching!
This is at another level thanks.....
Thanks, glad you liked it!
Thanks Andrew. Great video.
You're welcome Kevin, thanks for watching!
Thank you so much for sharing With us that much informations
You're very welcome, thank you for watching!
Thank you Andrew, for great lesson, the best, Cheers
You're welcome Janez, happy to hear that you enjoyed it!
Thanks Andrew! This is the best!!!
Cheers phio, glad you liked it!
Thanks for a thousandth time!
You're very welcome, thanks for watching!
Thank you very much my tutor Andrew. Really amazing and awesome. I know a lot about selenium but I have enjoyed watching your video and the video added new points to me.
Thank you Yasser! Please feel free to point out any mistakes that you see!
@@WiseOwlTutorials No mistakes. You are simply PERFECT.
@@KhalilYasser :D thanks!
Simply fantastic!
Thanks Jim!
excellent as always! TY
You're welcome, thanks for watching!
Muchas gracias!! Saludos desde Chile
You're very welcome Ariel!
Thanks a lot for your efforts
Thanks for watching!
Hello Andrew,
Your videos are fantastic, love the passion in your voice. Actually i have one question and hope that you will help me even though this video is 2y old. But when i put in vba the formula ....FindElementByClass(...).Click i have a debug which says "Run - time error "32" : Invalid selector Error invalid selector From java script error {"status":32 " value : "Compund class names not permitted"} (sessio info: Microsoft Edge = 126.0.2592.87) Driver info: msedgedriver = 126.0.2592.87 and some random numbers and letters.platform=Windows. Do you know maybe hot to repair it ? Thank you for the help
Hi! You might find this video helpful th-cam.com/video/lr7CFZEI2YA/w-d-xo.htmlfeature=shared
I'm fairly certain I mention compound classes in there and it provides various other options for finding elements that you should find useful.
I hope it helps!
I used the internet explorer browser to scrape from Google Maps, it does not load more than 10 results, after finishing my code with the conventional VBA libraries (not Selenium) , checked the same link in a chrome browser and discovered that it gathers all results possible, so searched for automation using Selenium and found this playlist, it is awsome and specially this video where you can check if the element is there or not as in Google maps results you may find a website or not, a phone number or not and so on, Awsome videos till now
Thank you Andrew！
You're welcome, thank you for watching!
I am First..... Thank You Andrew Sir...
You're welcome!
Sir Andrew. He is British. 😀
THIS IS BEAUTIFUL I need to say this you are great hehehe you are the best at explaining this thanks for everything
Ahh thank you Vicente!
@@WiseOwlTutorials
hello and thanks for your answer, i have a big question and i need your help, who can work with popups when i need to click on this popup?
@@vicenteantoniomagallanesju5289 Hi Vicente! It depends on the type of popup. Here's an example of a simple popup to confirm cookies settings th-cam.com/video/-kjq_8i9buM/w-d-xo.html
I hope it helps!
@@WiseOwlTutorials Great thanks for you answer you are great teacher
Fantasti! very Good! compliment!
Thank you!
Hi Andrew, you are the best teacher. The way to describe small small point that so useful & I leaned all data skill from your channel . Thanks for that. I have one question can you please how to trigger the pop window that comes after downloading some file from web. I want to save download file to specify folder. Thanks for all your efforts on teaching.
Thanks so much Ravi! The downloading files topic with Selenium is on my list. We do already have a video which shows how to download files using a Windows API function and XML HTTP requests which you might find useful if you haven't already seen it www.wiseowl.co.uk/vba-macros/videos/vba-scrape-websites/downloading-files/
Oow. Very good. I like this video. I'm from Brazil 🇧🇷
Obrigado Daniel!
Thankyouu for making this video!!
You're very welcome, thank you for watching it!
Thank you for another great lesson! Any plans to continue C# series?
Thanks Piotr! I don't have immediate plans to continue the C# series I'm afraid but thank you for asking!
Excellent tutorial as usual and I love referring people here. Your skill as a teacher is wonderful. Hopefully you will cover more on the power of using css and xpath e.g. 30:13 avoid loop with xpath e.g. "//h2[contains(text(), 'Video tutorials (')]" or "//h2[contains(text(), 'Video tutorials (')]/following-sibling::*//table" ; modern browsers are optimized for css selectors so it is an essential skill in the webscraper's toolbox. I appreciate it becomes a lot more in depth at that point but perhaps you do a couple of short videos just outlining those? FYI To get the links included you could instead transfer the outerHTML of the table element to clipboard and paste to sheet. Few more lines of code however. Very much looking forward to Dax measures videos!
Thank you so much! And yes, I'll be covering how to find by css and xpath later on (I thought this video was long enough already without including those!).
Thanks for the tip about the clipboard, I'd forgotten about that.
I appreciate all the comments and thanks for watching!
@@WiseOwlTutorials Love your videos!
great video. I am still having trouble holding the Website up, its still closing down at the end of the routine, even though l put the private ch as Selenium. Chrome Driver
Thanks Ian! Strange that your browser closes. Providing the variable remains in scope at the end of the procedure and you haven't explicitly closed it, it should remain open.
Well done
Thanks Joshua!
Hello, thank you for the video. I need help, please
What should we do?
If the site requires you to log in first, then scrape the data from it after that
Thank you Andrew, just started my Selenium tour with your videos, but I've one question: is it possible to get the "xpath" by using contains.text function? I'm trying to retrieve all text from every post of facebook, looking for keywords and then capture all texts / links/ and the name of the poster, please help! Thank you!
Hi Jerry! You'll find a bit more information about XPath in part 57.4 of this series, I hope it helps!
Thanks you for useful topic.
Can u plz also make a video to select a value from drop-down list
You're welcome Faiz! We will have a video on that topic, yes
Thank you!
Thank you Alexey!
Now that IE is retiring but you need the automation that IE offers. Fortunately, there's SeleniumBasic and can be used together with MSHTML, so all the things that I have learned to control IE from this channel over the years won't go to waste, which is a relief. Just a quick question, please: How to interact with browser's 'Save' dialog box after clicking on download button or link? Thank you very much, by the way for posting this helpful video..
Hi! I don't know how to interact with the Save dialog box. I'd just use the URLDownloadToFile function th-cam.com/video/JPezrWwvsJM/w-d-xo.html
I hope it helps!
@@WiseOwlTutorials Thank you very much for the link. I believe, I've seen that video. Unfortunately, I don't have a download link, the 'href=' attribute only contains "#". But if you click it, a dialog box appears. On IE, it's the yellow banner at the bottom. There is a code on SO-StackOverflow on how to capture the handle of the window using Windows API, just like the one on the link that you shared although a different .dll file. But there, it's just a code with insufficient explanation. I will just connect the idea from the link you shared and the code from SO because I think both have the same approach, just different .dll files. Thank you so much. I appreciate it..
@@SpaghettiCode5 I hope you get it to work!
Andrew, this is an awesome video. However I am having difficulty with the current website and at 11:50, you are FindElementByName("what"). On the current website there is a question mark, and I cannot figure out how to navigate the input of "Excel VBA" to that dropdown. How do I do this with the current website? Many thanks
Indeed, the problem with websites is that they're constantly changing! You might be able to find an old version of the Wise Owl website on the Wayback Machine which you could use to practise - here's one that might work web.archive.org/web/20221228132939/www.wiseowl.co.uk/
Hope it helps!
Parabens pelo tutorial
Thank you Mateus!
If I design a macro-enabled Excel file using Selenium to do web scraping per your video, will the file work on another computer that only has Chrome installed? Essentially, I want the file to do automated work for folks in my organization that are not VBA- nor computer savvy. I started to create one using IE, but didn't know about the sunsetting to Microsoft Edge.... Thanks in advance! Best, Bill
Hi Bill! Unfortunately, you would need to install the SeleniumBasic library on the computers which run the code (and keep the ChromeDriver up to date on those machines as well). It's not an ideal solution but unfortunately there aren't any good solutions for distributing VBA-based web scraping projects.
Thanks for the reply! Good to know about updating the ChromeDriver.@@WiseOwlTutorials
Thanks so much .. just want to know how to find window in web application by using selenium Google Chrome driver
Fantastic video! You mention towards the end that there are ways to speed the process up by switching a few things off. Is it possible to turn the browser visibility off like you can do with "IE.visible = false"?
Thanks! And yes, you certainly can run Chrome invisibly - I have a video recorded but not edited which demonstrates this which I'll upload hopefully some time this week.
While you're waiting, you could try this:
Sub GetTopFilms()
Dim cd As Selenium.ChromeDriver
Dim t As Selenium.WebElement
Set cd = New Selenium.ChromeDriver
cd.AddArgument "--headless"
cd.Start
cd.Get "en.wikipedia.org/wiki/List_of_highest-grossing_films"
Set t = cd.FindElementsByCss("table")(1)
t.AsTable.ToExcel Worksheets.Add.Range("A1")
cd.Quit
End Sub
And for more information, see here developers.google.com/web/updates/2017/04/headless-chrome
Hope it helps!
@@WiseOwlTutorials Worked like a charm, much appreciated!
@@novicerider751 You're welcome!
This is very helpful. I just want to ask to how one can learn to know the amount you know?
Many years of practice!
thanks a lot... i love it...
You're welcome, thanks for watching!
Thanks!
Thanks so much Bill, really appreciate your support!
All is great but for me who is trying to print out a single element, I might have missed it, and see all built on extended functions instead. Have to search all over the place for a simple version.
Great video,How can I do when a link that we click by code returns a new page in another tab and we want to capture that new page to continue capturing information from that new. Thanks for any help
Hi Richo! You might find video 57.6 in this playlist useful th-cam.com/play/PLNIs-AWhQzcl3xKvF8sVL4sWRWICj_clM.html
I hope it helps!
@@WiseOwlTutorials thanks Bro !
@@elricho72 No problem!
Thank you...
You're welcome, thanks for watching!
Brilliant
Thanks!
Nice videos.
Is it possible to open multiple tabs,
And later navigate between tabs, using Excel VBA.
If so please help me with that, how to do it in excel.
Thanks in advance.
Hi Jawahar! Yes you can open new tabs and navigate between them. It's probably easiest to point you to some examples which other people have written, I hope that it helps!
stackoverflow.com/questions/53381891/create-new-tab-for-each-google-search-by-selenium-in-excel-vba
stackoverflow.com/questions/55666348/open-new-chrome-tab
stackoverflow.com/questions/56314471/selenium-basic-vba-focus-on-new-tab-that-is-opened-by-click
@@WiseOwlTutorials thank you so much. It helped a lot.👍
@@dasRepalle That's great! Happy to hear that it helped and thank you for letting us know!
Hello! I'd like to ask what should I do if the available tags are only 'Style' and 'Title'?
I am trying to click the Title portion. Thank you!!
Hello! I think that you'll find Part 57.4 in this playlist useful th-cam.com/play/PLNIs-AWhQzcl3xKvF8sVL4sWRWICj_clM.html
I hope it helps!
Спасибо! Очень позновательно!
You're welcome, thanks for watching!
hi Andrew,
Great edu again.
Wonder if you could make one on popups, switch etc. i'm stucked there... after clicking to a new window/page but I can't acces the elements because i'm still in the page where I came from.
Hope you understand
Thanks
Hi Erik, thanks for the comment! Do you have the link to the page/pages you're having popup problems with? There are a few different types so it would be useful to see the exact one you're dealing with, thanks!
@@WiseOwlTutorials Thanks for reply. I allready foud the solution by finding the url of that new screen and followed that link I ended up in the right page and can access the elements.
@@erikeringaad8638 Good stuff, thanks for letting us know Erik!
Andrew, thanks so much for your tutorial! Do you perhaps know how to execute a print command after running ch.Get? With the old InternetExplorer object, this was simply done by running the line Explorer.ExecWB 6, 2, "", "" but for the life of me can't figure out how to do this with the ChromeDriver. Thanks again.
You're very welcome, glad you enjoyed it!
I have a feeling that I'm missing an easier way to do this but the simplest method I could find was to disable Chrome's print preview and then send keystrokes to simulate pressing CTRL + P followed by ENTER
Sub SeleniumPrintWithoutPreview()
Set cd = New Selenium.ChromeDriver
cd.AddArgument "--disable-print-preview"
cd.Start
cd.Get "www.wiseowl.co.uk"
VBA.SendKeys "^p"
Application.Wait Now + TimeValue("00:00:02")
VBA.SendKeys "{Enter}"
End Sub
If you want to work with Chrome's print preview, that's a little trickier! The print preview runs in a separate window and contains a nested set of shadow DOMs (here's some background on what that means developers.google.com/web/fundamentals/web-components/shadowdom)
Here's some very inelegant code to hit the print button in Chrome's print preview:
Sub SeleniumPrintWithPreview()
Dim ShadowHost As Selenium.WebElement
Dim ShadowRoot As Selenium.WebElement
Dim PrintButton As Selenium.WebElement
Set cd = New Selenium.ChromeDriver
cd.Start
cd.Get "www.wiseowl.co.uk"
VBA.SendKeys "^p"
'switch to the Print Preview window
cd.SwitchToNextWindow
'Walk down the nested shadow DOMs to get to the print button
Set ShadowHost = cd.FindElementByCss("print-preview-app")
Set ShadowRoot = cd.ExecuteScript( _
Script:="return arguments[0].shadowRoot", _
arguments:=ShadowHost)
Set ShadowHost = ShadowRoot.FindElementByCss("print-preview-sidebar")
Set ShadowRoot = cd.ExecuteScript( _
Script:="return arguments[0].shadowRoot", _
arguments:=ShadowHost)
Set ShadowHost = ShadowRoot.FindElementByCss("print-preview-button-strip")
Set ShadowRoot = cd.ExecuteScript( _
Script:="return arguments[0].shadowRoot", _
arguments:=ShadowHost)
Set PrintButton = ShadowRoot.FindElementByCss(".action-button")
PrintButton.Click
End Sub
I'm not sure if there's a better way to do this (surely there must be!) but I'll have to spend some time investigating.
I hope that helps in the meantime!
@@WiseOwlTutorials Wow, thank you SO much, Andrew! The no print preview seems to be working just fine for my purposes. I'm actually sending web pages to PDF, so no dialog is the preference.
Is there an easy line of code that suppresses the Chrome browser altogether so it runs in the background? Thanks again!
@@dangre00 No worries! There certainly is a way to run Chrome hidden using Headless Chrome (background info here developers.google.com/web/updates/2017/04/headless-chrome). I have a video on this but it's not yet published so here's the basics:
Sub GetHighestGrossingFilmsTable()
Dim cd As Selenium.ChromeDriver
Dim t As Selenium.WebElement
Set cd = New Selenium.ChromeDriver
cd.AddArgument "--headless"
cd.Start
cd.Get "en.wikipedia.org/wiki/List_of_highest-grossing_films"
Set t = cd.FindElementsByCss("table")(1)
t.AsTable.ToExcel Worksheets.Add.Range("A1")
cd.Quit
End Sub
Hope it helps!
@@WiseOwlTutorials You're the best, can't wait for the new video!
Thank you sir
You're welcome Rahul, thanks for watching!
Superb well explained video. Many thanks!
One question - is there any video where I can learn how to extract test and close alerts or pop-ups from a web page?
Thank you Rajiv! We don't have a specific video on closing alerts and pop-ups although I did cover one technique for pop-ups on Yahoo Finance as part of this video th-cam.com/video/_IlkdRwgIwg/w-d-xo.html
Not every pop-up is the same however, so that technique may not work for every situation!
Amazing video Thank You.I want ask this.
For example I was make application like in here sample for my friend.it must installed too Sellenium library in my friend's computer too?
Again thank you for this amazing tutorial
Yes, that's correct. Your friend will need the Selenium library installed too.
I hope that helps!
@@WiseOwlTutorials Thank you for reply ? Could you make an video about automatic installation example for Selenium ? I mean VBA checking Chrome version and and copy suitable Chromedrive exe to suitable folder ?
Also I want ask this How can make Turkish text reading application in VBA ? I mean exce (or any installed library etc ) can talking Turkish text ? Google Documents supporting to Turkish voice API
Could you make this kind video ?
(Sorry for my bad English, I hope undertand me )
@@Yorumcu63 Your English is much better than my Turkish!
I don't think the automatic installation of Selenium would work - in order to open Chrome and check the version (I'm not certain if that's possible in VBA) you'd need to have Selenium installed already.
You can perform basic text-to-speech in VBA using the Application.Speech.Speak method so for example:
Application.Speech.Speak Range("A1").Value
would speak the contents of cell A1 in the default voice assigned to the Text-To-Speech settings in Windows options. We have a video which covers the basics of this technique which you can see here th-cam.com/video/AD2nkTGkO4E/w-d-xo.html
Microsoft's documentation says that there is a Turkish voice and speech pack (his name is Tolga!) and you can see how to install it here support.microsoft.com/en-us/topic/how-to-download-text-to-speech-languages-for-windows-10-d5a6b612-b3ae-423f-afa5-4f6caf1ec5d3?ui=en-us&rs=en-gb&ad=gb
I hope that helps!
Hi
tanks for fantastic tutorials
i have some problem
i install latest version of firefox and selenium but when i want to start firefox have this error:"firefox failed to open the listening port 127.0.0.1:58849 within 15s
Hi Hamid, unfortunately SeleniumBasic no longer works with FireFox. The SeleniumBasic library was last updated in 2016 and appears unlikely to be updated to work with the changes to FireFox.
Awesome tutorial. It gives me an error "td" element not found. I didn't figured out, and finally I've copied your code. Thank you!!!
You're very welcome, I'm happy that it helped you!
Using Selenium how do you return text from a Class Element into Excel row A1
Andrew - amazing work mate, question, how best to deal with a ElementNotVisibleError element not interactable, ? this is happening as i try to click on a sub menu that sits under a parent menu item. Thanks mate.
Thanks Fredy! There could several reasons for this - it's possible that adding a simple Wait between clicking the parent item and clicking the sub menu item could solve it. Do you have the specific example you're trying?
Very interesting chrome driver for VBA.
How can I find a specific value inside a child "xxxx" where I know the parent tag TEXT I NEED
Without it going all over the page tags.
Thank you
Hi Marc! I'd check out part 57.4 which covers lots of techniques for referencing elements. I'd focus on CSS selectors or XPath to get what you need. I hope it helps!
Hi, How could I Press "ESCAPE" or "ESC" to close a popup when I Scrape using vba , chome and Selenium? I have tried with findElementby... but nothing work. I realized that when I press ESC all pop up closes and that could help. Thanks
Hi Henry! You could use the SendKeys method to do this learn.microsoft.com/en-us/office/vba/api/excel.application.sendkeys
Application.SendKeys "{Esc}"
I hope it helps!
I need to access a website with user and password, but when i use FindElementByname show an error "can't find element"
chromedriver vba excel import data csv to website. (im login user and password and import data ) is it possible to use excel?
I tried to search on this site : property-beta [dot] phila [dot] gov and there is a class name for input but it does not work to send the keys... Tried everything... There is an id but it is dynamic (it changes each time page loads). It does not work either without using selenium commands like you have shown in an old video. Can you please help?
Hi Aaron, the form which contains the input has a fixed ID so you can use that to locate the form and then find the Input element within, this works:
Private cd As Selenium.ChromeDriver
Sub PhillySearch()
Set cd = New Selenium.ChromeDriver
cd.Start
cd.Get "property-beta.phila.gov/#/"
Dim SearchInput As Selenium.WebElement
Set SearchInput = cd.FindElementByCss("#search-form input")
SearchInput.SendKeys "a house"
End Sub
This video covers more on CSS locators if you're interested in how it works th-cam.com/video/lr7CFZEI2YA/w-d-xo.html
This is great. How do you select an option from a list in a web page? Could you point me to a video that explains that?
Hi! There's an example of referring to drop down list values in this video th-cam.com/video/_IlkdRwgIwg/w-d-xo.html You can find the list of chapters in the video description, it's around 26 minutes. I hope it helps!
@@WiseOwlTutorials Thank you. It worked. Now the issue is that after selecting the option on the list, the page starts loading the selection, but never finished.
Thx!
You're welcome!
Is there away to check if an element exists inside a collection of elements. For example: You have a div class ="phone number" tag that exists in each div class="result" tag, but all div class="result" may not have a div class="phone number" tag. this means as you loop through the collection of div class="phone number" in each div class="result", the company that does not have a phone number will be assigned a phone number from the div class="result" below it. What I want to do is either labeled that cell as "No phone number" or Null in the [Phone Number] field, so this company will not be assigned a phone number from another company below preventing that data from being assigned to the wrong record for that [Phone Number] field.
Hi there! We have a video which explains referencing elements in lots of detail which you might find useful th-cam.com/video/lr7CFZEI2YA/w-d-xo.html
You can find the chapter list in the video description and you'll be interested in the sections on "Checking If an Element is Present" and the section beginning at "Narrowing Scope with CSS Selectors"
I hope it helps!
If I inspect my element in cause I get this "Submit new contribution"
Hello. How can I do if the website from which I need the information requests login before accessing the data? Thank you so much
Hi Fabian! It depends on the website you're using. If there's a convenient form on the page to enter your Username and Password you may be able to use Sendkeys to type your credentials and then Submit the form.
If the site uses Windows security you might find this video useful th-cam.com/video/Oxx6t6BEJAw/w-d-xo.html (sorry it uses Internet Explorer!).
If the site is more complicated than that you may find that you need to use a provided API and get involved with OAuth2 but I don't know enough about that to give you any good advice, sorry! stackoverflow.com/questions/55882439/vba-api-get-that-requires-request-token-authorizing-and-access-tokens
Hello and many tanks for this great tutorial. I found a problem during my test on the website I want to use with Excel.
The problem is that at the las point of the order process, to confirm an submit the order I have a Pop-up message where I need to click OK.
Unfortunately I don't now how to deal with it.
Do you have a solution for this problem?
Thank you in advance,
Alin
Hi Alin, sorry I don't have a specific technique to use for this, which site are you using? If you post your code I might get chance to look at it but you might have more success posting a question at somewhere like StackOverflow.com (they have many people ready to answer questions!)
Also while writing the code I do not get any suggestions.
Thanks for the great info you provide.. I need some help copying hidden components in the table. For example the id field in the table
Hi! Perhaps this will be useful stackoverflow.com/questions/13047056/how-to-read-text-from-hidden-element-with-selenium-webdriver
I hope it helps!
@@WiseOwlTutorials thanx .but can we do the same Scraping in ms access . TO table in access .
Yes you can write data to Access. Videos 31 and 32 in this playlist show you two different ways to do that th-cam.com/play/PLNIs-AWhQzclbRVLCZlsFvpz6fz2nPGbt.html
I hope it helps!