Man, just wanted to let you know I'm starting a new position as a Data Scraping Developer and you with your videos have been so helpful throughout the way. Thanks for all of your work, you truely affect people's life! And your teaching vibe is awesome
I’ve been web scraping for two years now and it’s always irritating when you’ve written a block of code to find that this as an issue! Always best to inspect the actual source code before attempting a scrape, thanks for the content!
What about using code like if price: price = price.text I do a lot of e-commerce scraping and some labels being None (e.g. Sale Price) gives information.
This video came a little late in your channel, but I’m super glad you made it lol. I would love to see more JavaScript content since those are the most difficult sites to scrape, at least in my opinion.
Could you do few more advanced videos? Like bypassing recaptcha v3 or advanced work with requests(when you need to do bunch of separate requests to collect verification tokens, sessionID, a lot of cookies from different places etc, before sending request you need in the first place)
i was scrapping youtube to save links of all the videos of a channel the code is working normal i was not getting output can you make a video to scrape youtube channel video please waiting for the replay
Great topic & video John! Thank you. I really like how you present the information & vibe. This got me thinking: what's the best approach to future-proof the scraping? I mean, websites change and that can break a now working script in the future. Is it advisable to apply for example the render in requests-html anyways so it can handle certain changes even if current website version doesn't need it? Maybe inform the admin if it breaks etc. Do you have any content about this topic, or give pointers about this in other videos?
Thank you so much for your content! I have been able to earn actual money, not a lot yet, using your videos as docs to help along the way. I am going to sign up for your Patreon as soon as I can get this money off Upwork lol You are the bomb!! Please keep up the great work! 🙏🙏🙏
Man, just wanted to let you know I'm starting a new position as a Data Scraping Developer and you with your videos have been so helpful throughout the way.
Thanks for all of your work, you truely affect people's life! And your teaching vibe is awesome
That is awesome! I'm really pleased good luck with the new job!!
John Watson Rooney and Python 360 have the best scraping vids on TH-cam right now.
s/o from South Africa
I learned web scraping by your videos, and of course I'm still learning. Thank you very much
You’re welcome I’m glad they have helped
I’ve been web scraping for two years now and it’s always irritating when you’ve written a block of code to find that this as an issue! Always best to inspect the actual source code before attempting a scrape, thanks for the content!
Thanks for watching, glad you enjoyed it!
What about using code like
if price:
price = price.text
I do a lot of e-commerce scraping and some labels being None (e.g. Sale Price) gives information.
I have just spent the last 2 hours trying to understand this error. I started learning web scraping today.
I hope this helped!
you are very underrated, i love your videos
One question (not directly related to this error video)
What is better. XPATH or Style scraping when using selenium / Chrome?
I always prefer css selectors because I’m so used to them, but xpath is very powerful. Pick one and learn it well and you’ll be sorted
@@JohnWatsonRooney xpath it will be (-:
Thank you 🤙🤙
This video came a little late in your channel, but I’m super glad you made it lol. I would love to see more JavaScript content since those are the most difficult sites to scrape, at least in my opinion.
sure, I've got some more ideas around that we can look at
I was looking for this video man thanks you deserve a like.
Could you do few more advanced videos? Like bypassing recaptcha v3 or advanced work with requests(when you need to do bunch of separate requests to collect verification tokens, sessionID, a lot of cookies from different places etc, before sending request you need in the first place)
I second this.
What I personally like to do is to first check if the element object is not None, then call its text method.
title = title.text if title else ' '
thats a good idea
i was scrapping youtube to save links of all the videos of a channel the code is working normal i was not getting output can you make a video to scrape youtube channel video please waiting for the replay
My IP got banned for a certain site. How can I change my IP address?
Unplug your router and plug it back in again, unless you have a static ip it will change.
Hello Jhon, thanks for all your Videos!!! i am trying to scrap data on a page with login and captcha.
Can you make a video about it?
Thanks!!!
Whats the solv text take me error
Kindly make a video on how to scrap from websites that are using recaptcha and also website using same classes name
please make some more videos with selenium and scrapy
Sure I can do that. I much prefer playwright but the idea and principles are the same
Thank you again for sharing.
Again I've learned something from you.
Next Live Show Mr John?
I’m not sure! I’d like to do more
Great topic & video John! Thank you.
I really like how you present the information & vibe.
This got me thinking: what's the best approach to future-proof the scraping?
I mean, websites change and that can break a now working script in the future.
Is it advisable to apply for example the render in requests-html anyways so it can handle certain changes even if current website version doesn't need it?
Maybe inform the admin if it breaks etc.
Do you have any content about this topic, or give pointers about this in other videos?
Nice video! thank you!
Glad you liked it!
I was expecting an inbuilt error handling logic or function there. We already knew all this.
Thank you so much for your content! I have been able to earn actual money, not a lot yet, using your videos as docs to help along the way. I am going to sign up for your Patreon as soon as I can get this money off Upwork lol You are the bomb!! Please keep up the great work! 🙏🙏🙏
wow thats great! I'm really pleased for you, keep it up!
awesome
thanks!