Great work Samer. Like others, I spent a lot of time trying to get this working. Turned out the java setup is where I was having issues. One small comment/suggestion - I did have to restart my computer after updating my environment in order to get the java version to show in command prompt. Thanks so much for your help!
Really great video. I've been messing about with chatGPT trying to get RSelenium to work and could never find a port. This nailed it and I'm scraping till my boots fill.
RSelenium stopped working for us a few weeks back and I had no idea why. I searched and searched for answers but I could not find anything. Your video pops up on reddit, and I decide to watch. You nonchalantly mention how the latest chrome drivers come with a license file which needs to be deleted. That's the answer! This needs to get out into the R community as this is relatively a new thing. Regardless, thank goodness you posted this video.
Tacking on here! The same situation and solution worked for me, and I'm on a mac. When I looked at the folders with the chrome drivers, the version that used to work didn't have a license file in it but the later ones did, when I saw that I knew we were on to something. Thanks so much, Samer!
OH THANK YOU SO MUCH! I've been struggling with the JAVA not found, then server version, then "port not available" problem for the past few hours one after the other! Legend thank you. Subscribed :)
This was amazing, thank you very much, I went from wanting to throw my laptop out of the window, to opening the browser and getting it to work. Im using mac and had to do some things for the Environment Variable that was different, but I figured it out. Suggestion for further RSelenium videos, how to scrape from dynamic websites that use javascript to load data to the browser. Im currently trying to extract HTML from a website that does this, I can see the elements in the inspect section of the remDr browser, but try as I may, I cant extract that information, I could really use some pointers on how to get that done. Thanks for this video!!!!
Thank you so much. The content is very interesting. However I encounter a problem; my chrome browser version is "124.0.6367.79" which is not available in the chromedriver version list. How do I resolve the problem?
Hello, at 15:10, when i execute lines 22, 27, 28, I have two browser windows that open then when I execute line 29, on the second window the page is correctly loaded, the first browser window remains empty ( i use chrome browser). Line 22, opens a window for me and line 28, opens a second window, I guess this line is not necessary.
@@SamerHijjazi And one last thing ^^, the browser closes after a few minutes of inactivity how to disable this behavior, I can't find it in the cran doc.
Is there something more to do in case I need RSelenium to scroll a page until the end or to a button for loading more entries? it's specifically a pop up page, but as long as scrolling is not involved I don't think I have problems with the page being a pop up
Thanks Samer! In case anyone else runs into this issue, the PATH wasn't in my environment - probably something to do with Program Files (x86) on my comp or user error. But this code seemed to fix it. Sys.getenv("PATH") Sys.setenv(PATH="C:\\Program Files\\Azul Java\\jdk\\bin")
Hi! I did a video on Statistics Globe channel. That part is covered at approximately minute 8, second 25. th-cam.com/video/WRjKyCZsbE4/w-d-xo.html&ab_channel=StatisticsGlobe
How do you account for problems when you have chrome versions up in 130 and 131? I am attempting to find these chrome drivers and can never get the exact chrome driver that lines up with my version (e.g. latest driver I have is 131.0.6778.69, version on computer is 131.0.6778.70 and Chrome download page doesn't have 70) Wondering if there is a way to get an older version of Chrome without updating up to the newest versions. Every video I have found shows people back in Chrome 114, and all my devices have chrome 130 - 131. On Chrome's official driver page they default ot 114, and you have to go to their test/dev versions and that is where I cannot find the correct drivers. Not your problem, but this is kind of ridiculous for RSelenium and Chrome.
I have chrome 131. version and the latest driver downloaded by selenium is 114 so the browser won't start how can i fix that? do i need to download the driver manually? I have tried but I can not find a similar file to add to the binman folder
Hi! My Chrome just update so I need to change my selenium server. I did all the steps again but the folder called Local is nowhere. What can I do? I need urgent help
It's a hidden file. You'll have to enable the option to see the hidden files. Refer to this article: helpx.adobe.com/x-productkb/global/show-hidden-files-folders-extensions.html
Hello, thank for the video I get a error (i use windows): Could not open chrome browser. Client error message: Undefined error in httr call. httr output: Failed to connect to localhost port 14415 after 2257 ms: Connection refused Check server log for further details. Warning message: In rsDriver(browser = "chrome", chromever = "113.0.5672.63", verbose = F, : Could not determine server status.
Hello, this is amazing work that you contribute. Unfortunately for me, I get this message and I can't make the connection. "Could not open chrome browser. Client error message: Undefined error in httr call. httr output: Failed to connect to localhost port 14415 after 2259 ms: Connection refused Check server log for further details. Warning message: In rsDriver(browser = "chrome", chromever = "111.0.5563.64", verbose = F, : Could not determine server status." is there a solution?
@@SamerHijjazi Hello, It was very strange I checked the directory where the chromedriver is stored, and the license files had been activated. Once I removed them, now everything works great. Thanks for the reply.
Thank you, Samer. I've spent a lot of time trying to get RSelenium up and running. Sorted it out in 5 min after watching this video. Much appreciated!
Hi Samer, you saved me from an entire afternoon of frustration. It was all that tiny license file. Thank you very much; you are a real hero!
Amazing, Samer! Been going through endless searches, until I've found the file deletion bit. Thanks!
Great work Samer. Like others, I spent a lot of time trying to get this working. Turned out the java setup is where I was having issues.
One small comment/suggestion - I did have to restart my computer after updating my environment in order to get the java version to show in command prompt.
Thanks so much for your help!
Really great video. I've been messing about with chatGPT trying to get RSelenium to work and could never find a port. This nailed it and I'm scraping till my boots fill.
I had already used RSelenium before, but changed computers and for some reason it wouldn't run in my new laptop. This worked perfectly, thank you!
Hey Samer thank you so much for the video, you are fantastic.
You save the day Samer!!! a single stupid license file had wasted me 3 days of time not being able to start the code.
you are a legend. That license file was the issue. I'd never have worked that out
RSelenium stopped working for us a few weeks back and I had no idea why. I searched and searched for answers but I could not find anything. Your video pops up on reddit, and I decide to watch. You nonchalantly mention how the latest chrome drivers come with a license file which needs to be deleted. That's the answer! This needs to get out into the R community as this is relatively a new thing. Regardless, thank goodness you posted this video.
Glad to hear it worked for you, Craig! Thank you for your feedback :)
Agreed, I would have never gotten this to work unless I watched this video. Thanks Samer!
Tacking on here! The same situation and solution worked for me, and I'm on a mac. When I looked at the folders with the chrome drivers, the version that used to work didn't have a license file in it but the later ones did, when I saw that I knew we were on to something. Thanks so much, Samer!
Excellent explanation. Thank you Samer!
I want to give you a big hug. Thank you so much. You save my life
OH THANK YOU SO MUCH! I've been struggling with the JAVA not found, then server version, then "port not available" problem for the past few hours one after the other! Legend thank you. Subscribed :)
So glad to hear this! Thank you. Welcome to the channel ☺️
My hero doesn't wear a cape. He programs in R
Well done, Samer, Keep up the good work!
This video is a lifesaver. Thank you Samer
Thanks dear. Your help is greatly appreciated. Stay blessed.
Thank you Samer, great video very clear
🎉 very helpful. Many thanks!
This was amazing, thank you very much, I went from wanting to throw my laptop out of the window, to opening the browser and getting it to work. Im using mac and had to do some things for the Environment Variable that was different, but I figured it out. Suggestion for further RSelenium videos, how to scrape from dynamic websites that use javascript to load data to the browser. Im currently trying to extract HTML from a website that does this, I can see the elements in the inspect section of the remDr browser, but try as I may, I cant extract that information, I could really use some pointers on how to get that done. Thanks for this video!!!!
This is awesome to hear! Glad it helped.
You're the man. Thanks for this info, saved me a giant headache
Unfortunately doesn't work. My chrome version is 127 while in win32 all the versions are 113,114 and 114. Due to this it throw me an error....
Thank you so much. The content is very interesting. However I encounter a problem; my chrome browser version is "124.0.6367.79" which is not available in the chromedriver version list. How do I resolve the problem?
Same problem, did u manage it?
Same problem as well
Same
you are gods gift to earth
Thank you!!
Man you rock!
Hello, what should i do if I have already Java installed in my Mac. I got lost in selenium_object
Thanks, it works perfect
thank you
Hello, at 15:10, when i execute lines 22, 27, 28, I have two browser windows that open then when I execute line 29, on the second window the page is correctly loaded, the first browser window remains empty ( i use chrome browser).
Line 22, opens a window for me and line 28, opens a second window, I guess this line is not necessary.
Use the second one, as it is the client side.
@@SamerHijjazi And one last thing ^^, the browser closes after a few minutes of inactivity how to disable this behavior, I can't find it in the cran doc.
I try to install in my other pc, but I have this problem, you have any idea?
rsDriver
if anyone has this problem, well the problem i has in the last version of R, I used R-4.2.2 and work fine
@@branurroz I am using the R-4.3.0, but i am still having the same problem. Any idea?
I have the same problem.
Hi!
Thanks for very helpful video. However, I encountered one problem (12:35).
I write:
remote_driver
Hello! Please refer to my latest video about setting it up. It's slightly different now: th-cam.com/video/BnY4PZyL9cg/w-d-xo.html
@@SamerHijjazi Thank you!
Is there something more to do in case I need RSelenium to scroll a page until the end or to a button for loading more entries? it's specifically a pop up page, but as long as scrolling is not involved I don't think I have problems with the page being a pop up
Hi! I'm trying to scrap in headless mode with RSelenium from a Linux server (through R Studio Sever) any tips?
Thanks Samer!
In case anyone else runs into this issue, the PATH wasn't in my environment - probably something to do with Program Files (x86) on my comp or user error. But this code seemed to fix it.
Sys.getenv("PATH")
Sys.setenv(PATH="C:\\Program Files\\Azul Java\\jdk\\bin")
awesome. Do you have any videos on Rselenium selecting from a dropdown item list? Kicking me in the rear lol.
Hi! I did a video on Statistics Globe channel. That part is covered at approximately minute 8, second 25. th-cam.com/video/WRjKyCZsbE4/w-d-xo.html&ab_channel=StatisticsGlobe
How do you account for problems when you have chrome versions up in 130 and 131? I am attempting to find these chrome drivers and can never get the exact chrome driver that lines up with my version (e.g. latest driver I have is 131.0.6778.69, version on computer is 131.0.6778.70 and Chrome download page doesn't have 70)
Wondering if there is a way to get an older version of Chrome without updating up to the newest versions. Every video I have found shows people back in Chrome 114, and all my devices have chrome 130 - 131. On Chrome's official driver page they default ot 114, and you have to go to their test/dev versions and that is where I cannot find the correct drivers.
Not your problem, but this is kind of ridiculous for RSelenium and Chrome.
@jmurtha80 hello, please refer to my latest RSelenium video I made and that should help with your question 😀
Thanks! What to do if I have the Chrome 116.0.5845.97 version? The latest available chromedriver version is for 116.0.5845.96.
Hi thereI I made a video recently addressing that issue. Here it is: th-cam.com/video/BnY4PZyL9cg/w-d-xo.html
I have chrome 131. version and the latest driver downloaded by selenium is 114 so the browser won't start how can i fix that? do i need to download the driver manually? I have tried but I can not find a similar file to add to the binman folder
Hi! Refer to my latest video on downloading the chromedriver for RSelenium. That should work
Hello, Is it possible to launch the browser in the background? without a window opening.
To my knowledge, no.
Hi! My Chrome just update so I need to change my selenium server.
I did all the steps again but the folder called Local is nowhere.
What can I do?
I need urgent help
It's a hidden file. You'll have to enable the option to see the hidden files. Refer to this article: helpx.adobe.com/x-productkb/global/show-hidden-files-folders-extensions.html
omg luv u
please could you do a video about the installation in ubuntu because it is different and i am stick with this problem for 5 months
I installed Java 20 and gets stuck at "checking Selenium Server versions:
BEGIN: PREDOWNLOAD
BEGIN: DOWNLOAD
BEGIN: POSTDOWNLOAD". Any ideas?
Try a different Java version. An older one might work!
I try everything and search for the problem and i can not find the solution
Selenium server could not be started when run selenium()
Hi! Can you tell me what the error is?
Please show us a mac version i feel stupid and incompetent...
I am exploring this option. Might have to download a virtual Mac for this
@@SamerHijjazi Really appreciate it since I also have a problem to install it on my mac.
Hello, thank for the video
I get a error (i use windows):
Could not open chrome browser.
Client error message:
Undefined error in httr call. httr output: Failed to connect to localhost port 14415 after 2257 ms: Connection refused
Check server log for further details.
Warning message:
In rsDriver(browser = "chrome", chromever = "113.0.5672.63", verbose = F, :
Could not determine server status.
I did the same solution as Luis Alberto Esquivel Cruz (remove license) and it works
Hello, this is amazing work that you contribute.
Unfortunately for me, I get this message and I can't make the connection.
"Could not open chrome browser.
Client error message:
Undefined error in httr call. httr output: Failed to connect to localhost port 14415 after 2259 ms: Connection refused
Check server log for further details.
Warning message:
In rsDriver(browser = "chrome", chromever = "111.0.5563.64", verbose = F, :
Could not determine server status."
is there a solution?
Try using Firefox instead and see if that works.
@@SamerHijjazi I had same problem, using firefox doesn't help
@@SamerHijjazi Hello, It was very strange
I checked the directory where the chromedriver is stored, and the license files had been activated.
Once I removed them, now everything works great.
Thanks for the reply.
@@luisalbertoesquivelcruz1522 It worked for me too
Thanks a lot!