Really, really impressive how simple and clear this introduction to Scrapy is. Absolutely phenomenal thank you so much. So many gold nuggets in there too (e.g. always go to page 2 with pagination to see the full url). Thanks a lot for the time you put into this. Definitely subscribing to the channel blindly just because this video was so damn good.
@@SATSifaction is there any place on the channel that might address how you would scrape (e.g. this exact same tutorial demo book website if hypothetically it made you send a username/password first?)...? Googling around a bit it seems like I need to send the keys using Selenium in the parse() method that is generated by Scrapy when you create the spider. Just wondering if you could point me in the right direction possibly. Can't wait to see what other videos you come out with!
Thank you very much for this tutorial, I am really new to web scraping. When I tried to implement your code I got an error pseudo class attr() is unknown, has scrapy changed? Thank you again.
i'm a little bit confused because i'm trying to get info but the info is sitting inside a div in a div in a div in a tag so i don't understand how to get this
@@SATSifaction hey thanks i was able to fix it. Can you also make tutorial in how to scrape different kinds of website e.g static/dynamic? and is scrapy enough to scrape information from all kinds of website?
Really, really impressive how simple and clear this introduction to Scrapy is. Absolutely phenomenal thank you so much. So many gold nuggets in there too (e.g. always go to page 2 with pagination to see the full url). Thanks a lot for the time you put into this. Definitely subscribing to the channel blindly just because this video was so damn good.
Than you Kevin
@@SATSifaction is there any place on the channel that might address how you would scrape (e.g. this exact same tutorial demo book website if hypothetically it made you send a username/password first?)...? Googling around a bit it seems like I need to send the keys using Selenium in the parse() method that is generated by Scrapy when you create the spider. Just wondering if you could point me in the right direction possibly. Can't wait to see what other videos you come out with!
Hi Kevin check out this. It’s similar to what you’re looking for I believe - th-cam.com/video/HsA0mJ4kNKE/w-d-xo.html
@@SATSifaction thank you so much!!
Yes, please! Would like to see also a tutorial on more advanced lesson on web scraping, beyond the basics ;-) Thanks!
Great tutorial!!! Thank you!
You are so welcome!
Amazing and simple tutorial. It was useful for me. Thank you so much!
Perfect. Thank you.
Thank you for watching
Thank you very much for this tutorial, I am really new to web scraping. When I tried to implement your code I got an error pseudo class attr() is unknown, has scrapy changed? Thank you again.
Thanks for the simple tutorial. Would it be possible to handle a dynamic web-site using with splash together?
Thank you for making this video. I'd like to see more on scraping.
Stay tuned I always change things up
Thank you for the video
You’re welcome
Hey, lovely tutorial. Could anyone point me to the packages you're using in sublime to write this, and the syntax/style settings ?
Great tutorial! I'd like to see more videos about Scrapy, pls! Specially when the web target has no pages with number. Thanks!
+Xavi Ruiz thank. Stay tuned I’m always adding new stuff
Great tutorial. Thank you! Can you extent this tutorial with more advance features of scrapy? :)
I will in future
Hi,
Please advice me on how to improve / speed up the scrapy process
What specifically is bottleneck
I am having a spider which runs upto 6 hr to scrape the datas
So looking for options in scrapy so that atleast I can reduce half the time
show work with user-agent proxi and scrapyd
i'm a little bit confused because i'm trying to get info but the info is sitting inside a div in a div in a div in a tag so i don't understand how to get this
check xpath method
I’m general you should be able to search by div id in order to avoid multiple divs in divs
liked as soon as you told me too. Look no thumbs down XD
Thank you!
why am i getting duplicate data while scraping, I followed all the steps as shown here in the video
duplicates are sometimes a result of an improperly formatted loop. Make sure you check indenting
@@SATSifaction hey thanks i was able to fix it. Can you also make tutorial in how to scrape different kinds of website e.g static/dynamic? and is scrapy enough to scrape information from all kinds of website?
gwd that background music was annoying af. sooooo imappropriate for a tutorial vid