Intro To Web Scraping With Python

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 ก.พ. 2025

ความคิดเห็น • 252

  • @amreshgiri4933
    @amreshgiri4933 6 ปีที่แล้ว +130

    People like you should get more recognition and praise. I'm really thankful to you.

  • @sido.5783
    @sido.5783 6 ปีที่แล้ว +3

    Just wanted to say THANK YOU A LOT Brad!! I started watching your videos in January when I had zero skills/experience in web development and I started practicing almost every day until I felt confident enough to start applying for jobs. Happy to say I just landed a job as a Front End Developer thanks largely in part to your videos here and on udemy. I will forever be grateful

  • @Toxic-th4si
    @Toxic-th4si 6 ปีที่แล้ว +24

    It's A Festive Day In Our Country Where We Celebrate "Teachers" And Thank Them For Their Contribution To Society. I Would Like To Say Thank You To You For Being This Amazing.

    • @TraversyMedia
      @TraversyMedia  6 ปีที่แล้ว +2

      You are very welcome, thank you for watching

  • @irock2382
    @irock2382 6 ปีที่แล้ว +9

    You're actually the first person i've found that has explained the various commonly used functions, and then demonstrated their use! Others just pick up an example and go through with it! Awesome content!

  • @burhankalu2682
    @burhankalu2682 6 ปีที่แล้ว

    I regreat wasting time in school and we got genius lectures like you who is teaching us what we were never taught Brad your just a blessing

  • @fluidiccolours8091
    @fluidiccolours8091 6 ปีที่แล้ว

    Hello, Brad! I just want to say thank you from the bottom of my heart. I and my friend were struggling to build a website from scratch and your web tutorials helped us immensely.

  • @jlambert12013
    @jlambert12013 3 ปีที่แล้ว

    It is unreal how many tutorials Brad has actually made. I literally just typed in "Traversy Web Scraping" and sure enough.

  • @brikozub
    @brikozub 4 ปีที่แล้ว

    This is what we're working on at my coding bootcamp and this video helped me to write a much more elegant program than what was presented as the solution by the school.

  • @IsaacAsante17
    @IsaacAsante17 6 ปีที่แล้ว +5

    Brad, I've said it before and I'll say it again: You're amazing.
    Thanks for all your free tutorials.

    • @jaden8243
      @jaden8243 6 ปีที่แล้ว

      Isaac Asante Lol, your second name literally translates to thank you in Kiswahili

    • @IsaacAsante17
      @IsaacAsante17 6 ปีที่แล้ว

      Yeah, I learnt that from other Africans, hehe. I'm Ghanaian though, and it's a common family name back there.

    • @brianadams2862
      @brianadams2862 6 ปีที่แล้ว

      kweli

  • @NaftuliSinger
    @NaftuliSinger 4 ปีที่แล้ว +1

    Simple straightforward, I wish all TH-camrs will be like you! Thank you!

  • @TheyCensorUsHere
    @TheyCensorUsHere 6 ปีที่แล้ว

    Homeless and studying to get a Python job. Just completed the Treehouse track for Python and am now slowly expanding at coffee shops. Thanks for the vid! First one I've seen where you put the data into a table - VERY NICE. :)

  • @Ragnar-bh1tu
    @Ragnar-bh1tu 6 ปีที่แล้ว +1

    I was just making TH-cam API project when realized that new video is here. Your channel is really Blessing! Thanks, Brad!

    • @mo9204
      @mo9204 5 ปีที่แล้ว

      tell me more about your idea please

  • @2628rohit
    @2628rohit 6 ปีที่แล้ว +9

    your channel is one of theeee best channels i found on youtube. love you man :)

    • @SUMITMANCHANDA01
      @SUMITMANCHANDA01 6 ปีที่แล้ว +3

      Let me know Other two I have found this only !! @brad is just awsome !!

  • @zeroproductions7759
    @zeroproductions7759 6 ปีที่แล้ว

    Hi Brad, I took your JavaScript course from udemy. Now I have some good knowledge of JavaScript. Thanks for the great content.God bless you.

  • @iwanvanmirlo
    @iwanvanmirlo 5 ปีที่แล้ว

    Only had time to watch half of the clip will come back later, you have a great explanation i love how u walk true the api , and learn me myself , with limited html skills as a MAIN learning language to go use a webscrapyer in python and perhaps even make a cool project out of it .

  • @charleswang5875
    @charleswang5875 6 ปีที่แล้ว

    Hi Brad, Thank you for all of your videos. the tutorials are so clearly understanding. you are very expert at breaking the complicated concept down into every little thing which is easily understood.
    By the way, I am a Chinese guy, your English pronunciation is the best clear and accurate I have ever listened from the all of Tech channels I subscribed. I can study technologies and Engish from you Haha. Thank you very much, so appreciated it.

  • @TheNickster1212
    @TheNickster1212 6 ปีที่แล้ว +3

    Cool! It's crazy I was just looking into web scraping and beautifulsoup in particular and then you post this! Awesome content as always!

  • @AaronStorey
    @AaronStorey 6 ปีที่แล้ว +6

    This is something I was about to look at not 1 week ago, and now you have a tutorial out for it... Mind reader o.o (Also thank you!)

  • @kennethbolmelund6302
    @kennethbolmelund6302 5 ปีที่แล้ว

    I'm popping by to tell you to keep doing what you do!
    You're great at what you do and you explain in an easy-to-digest way.

  • @buddybob5502
    @buddybob5502 4 ปีที่แล้ว

    sir I just want to say thank you for living you are a true blessing to us. programmers, you are my go to guy, god bless dude freakin genius

  • @mehroazeen2471
    @mehroazeen2471 5 ปีที่แล้ว

    I officially consider you My teacher, and have great respect for you. Thank's a lot.

  • @Sagliyu
    @Sagliyu 6 ปีที่แล้ว +44

    Thanks 👍 , please more python videos

  • @mohammedhossain5041
    @mohammedhossain5041 4 ปีที่แล้ว

    I think this was the most efficient web scrapping tutorial in TH-cam

  • @joshuamurphy6994
    @joshuamurphy6994 5 ปีที่แล้ว +2

    I'm glad that I'm not the only one that looks at the keyboard when I type. Thanks for the great vid

  • @dontbeafraid5313
    @dontbeafraid5313 6 ปีที่แล้ว

    Brad I owe you a beer and 60% of my web development knowledge. God bless this great man

  • @dildgemckenzie8597
    @dildgemckenzie8597 6 ปีที่แล้ว

    Excellent Brad. Just so happens I've just started looking at scraping our old corproate website.

  • @nateshrager512
    @nateshrager512 6 ปีที่แล้ว +9

    Fantastic! Can't wait to try this out myself

  • @jackbird5839
    @jackbird5839 3 ปีที่แล้ว +2

    Awesome tutorial thank you. but for a non-tech user it is quiet hard to do a workable scraper for my WooCommerce store. As a side solution i am using eCommerce "ESCRAPER" maybe it helps somebody too.
    But I am not giving up))) Thank you for your input!!!

  • @dzonialucard
    @dzonialucard 6 ปีที่แล้ว +79

    at this point i owe u so much beer it aint even funny anymore

  • @mkhpd8158
    @mkhpd8158 4 ปีที่แล้ว

    What a simple concise explanation. Thank you

  • @zygimantas3
    @zygimantas3 6 ปีที่แล้ว +21

    you need to slow down I can't keep up with all your courses and all the content on youtube I work 8 hours a day and need to spend time with my family :D JK your the best keep it up!

    • @TraversyMedia
      @TraversyMedia  6 ปีที่แล้ว +16

      Zygimantas Kairys the content isnt going anywhere. Just come back to it when you get time 😊

  • @Charizm0
    @Charizm0 6 ปีที่แล้ว +8

    Aaahhh finally! Looking forward to more such tutorials.

  • @lucifyer4486
    @lucifyer4486 6 ปีที่แล้ว +1

    Just when I was thinking of trying out web scraping. And who else to learn it from other than Brad! Great work

  • @zoel639
    @zoel639 4 ปีที่แล้ว

    You make it so simple to understand. Thank you!

  • @mahmudulhassan9043
    @mahmudulhassan9043 6 ปีที่แล้ว +1

    please Create More Contents with python .Your tutorials are just awesome.....Thank you so much...

  • @MuffinologyTrainer
    @MuffinologyTrainer 6 ปีที่แล้ว

    High quality, just like every other tutorial. Great stuff.

  • @circuitmasters5258
    @circuitmasters5258 6 ปีที่แล้ว

    traversy as soon as i can brother, i am buying all of your courses....I got a plan!

    • @circuitmasters5258
      @circuitmasters5258 6 ปีที่แล้ว

      brother the things you can do with python...oh the possibilities...YOU CAN LITERALLY OWN THE WEB..

  • @rizwanriyad6818
    @rizwanriyad6818 6 ปีที่แล้ว +1

    Thanks Brad. It was pretty resourceful 👍
    Btw I'm a huge fan of your work here. Have been learning lots of stuff from you.

  • @tejendrakumar1028
    @tejendrakumar1028 6 ปีที่แล้ว

    I've been waiting for this forever.

  • @onecarwood
    @onecarwood 6 ปีที่แล้ว

    I’m glad you did this video I was listening to a podcast about this although a great podcast it was in no way teaching me how. Thanks!

  • @StureLarsson
    @StureLarsson 5 ปีที่แล้ว

    Great video! First time coding in python and it was really easy to follow along dude! Thanks a lot! :)

  • @juliuswaweru1904
    @juliuswaweru1904 6 ปีที่แล้ว

    Your tutorial is the best.

  • @KhamisImranWangara
    @KhamisImranWangara 6 ปีที่แล้ว

    thanks man, was waiting for this for ages

  • @KaJluHuHrpag
    @KaJluHuHrpag 6 ปีที่แล้ว +1

    Some moments I imagined harder after a year of parsing:0) Thanks for this tutorial.

  • @guruvigneshnagaraj8501
    @guruvigneshnagaraj8501 6 ปีที่แล้ว +1

    Thank you Brad!! Great work.... Please make more videos using Python

  • @WatchingBlue
    @WatchingBlue 6 ปีที่แล้ว

    There are a few things I want to mention. First of all if the website you want to scrap is providing an API then use this instead, the API is for this porpuse. Second, scraping with bs4 is nice for small scale, but if you want to get more information faster available, well you need to parallelize things like using grequests. BUT there is one option I would like to recommend, using scrapy which does this kind of thing for you. It is certainly harder to get into it, but it is worthwile.

  • @SethWilson
    @SethWilson 6 ปีที่แล้ว

    This is super-helpful! I've been meaning to look into this for a while, but never got around to it.
    It's cool that BeautifulSoup lets you use either snake case or camel case for its methods. I'll note that snake case is best practice for Python, and if you use camel case Python snobs may yell at you. :) So, soup.find_all() rather than soup.findAll().

  • @dstanif
    @dstanif 4 ปีที่แล้ว

    This video is GOLD!!!
    Thanks

  • @DocPosture
    @DocPosture 6 ปีที่แล้ว

    geez. i didnt even think about you for python tuts. my bad. youre my goto guy for php/css/javascript stuff but i kinda moved to other channels for my python fix. just saw your flask series. thx.

  • @kimanih617
    @kimanih617 6 ปีที่แล้ว

    Thank you sir. I so want to give you a hug right now

  • @l3xx3r
    @l3xx3r 6 ปีที่แล้ว

    Thank you very much - there are out there so much crap infos but you could help a lot.
    Awesome and Thumbs up

  • @phillipaaronperpetua7218
    @phillipaaronperpetua7218 5 ปีที่แล้ว

    Thanks for that bro🙂
    From philippines🎉🎉🎉

  • @CerealTuesday
    @CerealTuesday 6 ปีที่แล้ว

    Just another awesome video, simply the best 👍

  • @ankitmishra-zw9vc
    @ankitmishra-zw9vc 6 ปีที่แล้ว

    Much awaited video😊

  • @Klawzify
    @Klawzify 6 ปีที่แล้ว

    Love your content Brad! This was exactly what I needed :)

  • @avtaras
    @avtaras 6 ปีที่แล้ว

    Woo-Hoo! Finally! Thanks a lot, Brad!!!

  • @markolivancic
    @markolivancic 6 ปีที่แล้ว

    Awesome! I tried this with selenium and webbrowser libraries, but BeautifulSoup seems great

  • @martinkaspar5095
    @martinkaspar5095 4 ปีที่แล้ว

    you guy rock - many many thanks for all you did!!!! GREAT

  • @joshuanelson445
    @joshuanelson445 5 ปีที่แล้ว

    Thank you for sharing all that you do!

  • @volfegan
    @volfegan 6 ปีที่แล้ว +2

    Great working explaining beautifulSoup. You should continue the explanation on how to do web scraping for the virtual dom created by javascript. I think there is package for that called Selenium.

  • @ryanriddell5087
    @ryanriddell5087 6 ปีที่แล้ว

    Thanks, Brad! This was really helpful.

  • @AngryHmong
    @AngryHmong 6 ปีที่แล้ว

    Thank you very much for the video, Brad!

  • @converti76
    @converti76 4 ปีที่แล้ว

    Great video thanks a lot, for tables we use same methods with the new tags right?

  • @galoggob
    @galoggob 4 ปีที่แล้ว

    Good tutorial man. Thank you

  • @jashrun9788
    @jashrun9788 6 ปีที่แล้ว

    this was very cool. thanks Brad

  • @collo5070
    @collo5070 5 ปีที่แล้ว

    another successful tutorial. thank you

  • @madsudan9227
    @madsudan9227 6 ปีที่แล้ว

    Thanks,really grateful for your efforts

  • @SoumilShah
    @SoumilShah 5 ปีที่แล้ว

    Great tutorials thumb Up !!!

  • @YaserAz
    @YaserAz 6 ปีที่แล้ว

    Love your spirit man !
    Keep it up Brad (y) thanks a lot

  • @awaisraza2285
    @awaisraza2285 6 ปีที่แล้ว

    Thank you Brad For your tutorials. I have learned a lot of things from your tutorials and udemy courses :) Please add one more course about Python full stack including django and flask.

  • @cizario
    @cizario 5 ปีที่แล้ว

    it looks very easy and intuitive to scrape sites with python than php / curl

  • @bouhannacheabdallah
    @bouhannacheabdallah 4 ปีที่แล้ว

    As good as possible scrabbed nice man

  • @floppy_keyboard
    @floppy_keyboard 6 ปีที่แล้ว

    More Python! Love your videos btw!

  • @albertgalvez2556
    @albertgalvez2556 6 ปีที่แล้ว

    As we travellllll, the Universsssss
    Off topic, but I needed that gap, that self-healing, I bought a telescope, a beginner's celetron scope, enjoy life and see what's out there, wow the kids ladies and gentle men!
    Mars! (Goes in the back of the class, I'm having a breakfast club episode, dang it 80's).

  • @christophecazin1213
    @christophecazin1213 6 ปีที่แล้ว

    Thank you for this very good and serious tutorial.
    Understood requests and BeautifulSoup
    I love U ;)

  • @Sece1
    @Sece1 3 ปีที่แล้ว

    Great content thank you! Would you be able to update it with the dynamic DOM?

  • @JennHayden
    @JennHayden 4 ปีที่แล้ว

    a wonderful video, thank you so much!

  • @martinkaspar5095
    @martinkaspar5095 4 ปีที่แล้ว

    great to see that you run vscode

  • @eyesis0081
    @eyesis0081 6 ปีที่แล้ว

    Is it a must that a person use vs code or can a person use something else for these webscraping exercises? Thaks

  • @hanzlaahabib
    @hanzlaahabib 6 ปีที่แล้ว +2

    Ma sha Allah May Allah Bless you :)

  • @thesoftwaredeliverypodcast
    @thesoftwaredeliverypodcast 5 ปีที่แล้ว

    Thanks so much for this really interested in learning python and this amazing

  • @noufalbabu549
    @noufalbabu549 6 ปีที่แล้ว

    Welcome back to Python 😄💜

  • @yucemantar
    @yucemantar 5 ปีที่แล้ว +2

    I cant use get_text..
    error is:
    AttributeError: 'NoneType' object has no attribute 'get_text'

  • @Shivamtrivanshi
    @Shivamtrivanshi 6 ปีที่แล้ว +4

    Please make video series on ECommerce shopping cart website using Node.js, Express.js and MongoDB

  • @VladArnoldner
    @VladArnoldner 6 ปีที่แล้ว

    Thank you, Brad!

  • @garyshker20
    @garyshker20 6 ปีที่แล้ว +3

    Cool!!!
    Will there be a continuation?

  • @wilk85
    @wilk85 6 ปีที่แล้ว

    Thank you Brad

  • @rachidbeggar711
    @rachidbeggar711 5 ปีที่แล้ว

    Thank you so much Brad

  • @RameenFallschirmjager
    @RameenFallschirmjager 6 ปีที่แล้ว

    thanks a ton, it was very informative.

  • @zhaoyunfeng5171
    @zhaoyunfeng5171 5 ปีที่แล้ว

    Hi Traversy, could you tell me where can I find example of HTML code like you have in the webscraping.py ?

  • @AbhishekKumar-mq1tt
    @AbhishekKumar-mq1tt 6 ปีที่แล้ว

    Thank you for this awesome video

  • @nova-intl
    @nova-intl 6 ปีที่แล้ว

    Thank you! This is awesome!

  • @farmakoxeris
    @farmakoxeris 6 ปีที่แล้ว

    Usually, http requests are sent through port 80 or 8080. What about other ports? I have a connection through a router and the port is different. In the web browser I have to type the IP and the port eg. 192.193.194.195:520. Can it work with Beautifulsoup?

  • @ghazikerkeni7031
    @ghazikerkeni7031 6 ปีที่แล้ว

    Thank you so much for this video! my biggest request is that you make another video using laravel along with Goutte for web scraping

  • @JonathasPatrick
    @JonathasPatrick 5 ปีที่แล้ว

    THANK YOU SO MUCH YOU'RE A GOD

  • @geoptus
    @geoptus 6 ปีที่แล้ว

    Great intro to the subject, thanks very much 👍
    - will you be doing any Flask tutorials?

  • @sanwalyousaf
    @sanwalyousaf 6 ปีที่แล้ว

    excellent tutorial

  • @MULTICODE
    @MULTICODE 6 ปีที่แล้ว

    Thanks a lot traversy media

  • @ratugakaboom2010
    @ratugakaboom2010 6 ปีที่แล้ว

    i am a beginner web developper,should i use Boilerplate and shiv?

  • @johnsmith-oy9kx
    @johnsmith-oy9kx 6 ปีที่แล้ว

    You made Python a King Cobra, Thanks lot !