Python web scraper $$$ - Easy step by step guide | How to make money with Python Episode 1

แชร์
ฝัง
  • เผยแพร่เมื่อ 20 ม.ค. 2025

ความคิดเห็น • 315

  • @MakeDataUseful
    @MakeDataUseful  ปีที่แล้ว +11

    Blown away by the support! Check out my latest video about ChatGPT vision here th-cam.com/video/BoPFBnjRvoc/w-d-xo.html top project idea I will build!

  • @bombswabs3041
    @bombswabs3041 ปีที่แล้ว +53

    The fact that you explain the fine details instead of glossing over them is so much appreciated. I even do this at times as an expert in my field I forget those Im explaining to do not have the same understanding. The challenge is what details are relevant and which need to be left out. You strike that balance with grace and articulation!.

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว +1

      Thank you! And agree! Really helps with thinking through a problem

  • @MakeDataUseful
    @MakeDataUseful  ปีที่แล้ว +54

    Thanks to all the recent subscribers! Lots of new videos coming! 😀

  • @MakeDataUseful
    @MakeDataUseful  4 ปีที่แล้ว +38

    Big shout out to all the encouraging comments and new subscribers! I really appreciate it, thank you!

  • @YahiaHegazy
    @YahiaHegazy 4 ปีที่แล้ว +112

    Not gonna lie here, but you are like the Bob Ross of Web Scraping. Voice is soothing and I'm learning quite a bit. Keep up the good work!

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +8

      Hey thanks Yahia! I like the idea of being the Bob Ross of something, such a cool guy. I really appreciate the feedback, keep an eye out for new cool content coming soon!

    • @merv893
      @merv893 ปีที่แล้ว

      Is that the cool calm painter, nice one. Great vid. We get that still in the uk.

  • @MakeDataUseful
    @MakeDataUseful  ปีที่แล้ว +5

    2023 Adam here! Thank you for watching this tutorial!! Make sure you subscribe to catch my weekly tutorials which include: How to make money with Python in 2023, web scraping with ChatGPT API python tutorials, and many more! I really appreciate all your support!

  • @websnuzy6240
    @websnuzy6240 10 หลายเดือนก่อน +1

    Fabulous delivery! No fluff - clear examples, information & instructions. 30 mins seemed to pass real quick - well worth watching and following.

    • @MakeDataUseful
      @MakeDataUseful  10 หลายเดือนก่อน

      Thank you!! Some really cool stuff in the works, stay tuned 😎

  • @shinohai5781
    @shinohai5781 ปีที่แล้ว +27

    This helps SO much with bridging the gap between what I'm studying and what really gets used in the field. Thank you!

  • @Locco356T
    @Locco356T ปีที่แล้ว +1

    I'm just seeing this now!!!?
    Man, I won't lie, i haven't found someone as seamless and simple as you are bro. Keep it up.

  • @whiterabbit6417
    @whiterabbit6417 ปีที่แล้ว +7

    Never thought scraping would be this much easy! Totally loved it man !

  • @minh-phinguyen7823
    @minh-phinguyen7823 ปีที่แล้ว +24

    I totally like the way how you explain the steps. I'm a Python beginner and im so impressed by your work. Thanks a lot.

    • @powerball200
      @powerball200 ปีที่แล้ว

      how much have u learned cuz i just started, maybe we can go together if u want?

    • @TheChad17
      @TheChad17 ปีที่แล้ว

      @@powerball200what I’m doing is downloading scripts and modifying them to work with what I’m trying to do. As I run into issues, I research how to resolve that issue.

  • @venomlovekitties
    @venomlovekitties 2 ปีที่แล้ว +46

    I am a designer and your tutorials are brilliant, easy to understand without having prior knowledge of coding. You are AWESOME teacher, keep doing YOU. Insta subscribed.

  • @geef0813
    @geef0813 ปีที่แล้ว +12

    All this time later and your still teaching new folks things! Incredible explanation. You’ve done what others couldn’t. You made it “click” for me! Thanks.

    • @geef0813
      @geef0813 ปีที่แล้ว

      And nice beard.

  • @Reese_414
    @Reese_414 4 ปีที่แล้ว +7

    I thank the TH-cam algorithm for placing this video in my feed!.!.! Was an excellent video and very encouraging for me as I'm still learning python but reaching the point where I want to find ways to monetize what I can master as I learn...

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +4

      Thanks for the feedback! Time for me to get making more videos! Drop me a comment if there's anything you want me to cover!

    • @jj-in4yd
      @jj-in4yd 2 ปีที่แล้ว

      hey bro found something you can monetize by learning ?

  • @iynesh07
    @iynesh07 ปีที่แล้ว +1

    One of best recommendation I got in recent time. Continue doing the good work!!❤‍🔥

  • @svedalawoodcrafts
    @svedalawoodcrafts ปีที่แล้ว +2

    Very well produced video with explanation even beginners can understand. Awesome idea also on how to make money with Python. Thank you. Or should we hit this website 20 thousand times, lol.

  • @rafidrahman8654
    @rafidrahman8654 4 ปีที่แล้ว +44

    Great video man, it just goes to show how easy it is to make money with some python skill. Want more of these videos and if possible give some tips how to get a proposal accepted. Cheers !

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +8

      Thank you! I am pretty excited to make a series on making money with Python! Thanks for the feedback, much appreciated.

    • @rafidrahman8654
      @rafidrahman8654 4 ปีที่แล้ว +1

      @@MakeDataUseful hello ! Can I connect with you in any way ?

    • @pkavenger9990
      @pkavenger9990 4 ปีที่แล้ว +1

      @@rafidrahman8654 Are you looking to team to co learn Python?

    • @rafidrahman8654
      @rafidrahman8654 4 ปีที่แล้ว +1

      @@pkavenger9990 Hi, yes certainly that would be great actually !

    • @pkavenger9990
      @pkavenger9990 4 ปีที่แล้ว

      @@rafidrahman8654 ok good here is my discord ID: Lord Ainz#3259. You can add me and then when can talk. by the way where are you from?

  • @NexusGuru
    @NexusGuru ปีที่แล้ว +1

    first time ive seen someone doing and explaining actual work as an example thank you! subbed

  • @joelngige5776
    @joelngige5776 ปีที่แล้ว +16

    I have been learning python lately and am inspired by this video as it is a way of solidifying one's knowledge by taking on these real jobs as 'exercises' and making money at the same time. God bless you

  • @TheBizbuggy
    @TheBizbuggy ปีที่แล้ว +1

    Great sharing, looking forwards for your next demonstration here. Thank you for the kind sharing.

  • @kadaliakshay6770
    @kadaliakshay6770 9 หลายเดือนก่อน +2

    bro you're gonna get to more than 1M subs, luv yo' videos

  • @daveys
    @daveys ปีที่แล้ว +3

    Excellent video, and I see what someone else meant by you being the Bob Ross of web scraping. I’m just starting to learn Python and found this really interesting.

  • @jenot7164
    @jenot7164 ปีที่แล้ว

    Wow, this is like a gold mine. It’s not guaranteed that you make money with this, but as you start working on proposals you learn a lot about real life problems.

  • @aliasi465
    @aliasi465 3 ปีที่แล้ว +10

    Sir, you did really amazing. Please regularly update stuff like this. This is quite helpful for many people who dont know how to scraping data. Please sir do more videos like this. Thanks

  • @gambar
    @gambar ปีที่แล้ว +2

    End of 2023: almost 27k subs... Quite a leap from "almost a thousand"! Congratulations and 50k soon! :)

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว +2

      Thank you!! Means a lot, I’m really devoted to getting a lot more tutorials out there. Let me know if there’s anything you would like to see 🤟

  • @Gtmz53fxt56zxc
    @Gtmz53fxt56zxc ปีที่แล้ว +1

    Just like magic you’re genius man, great example in your life and work of what it’s like to be a successful data engineer 😎

  • @luantorres3758
    @luantorres3758 4 ปีที่แล้ว +3

    Greetings from Brazil, I discovered your channel by Reddit and I'm really enjoying your content... This kind of video, encouraging people to learn by working, it's just amazing, and your teaching method is also great ;)

    • @luantorres3758
      @luantorres3758 4 ปีที่แล้ว +1

      btw, i would like to know if there is a method to memorize better these multiples libraries that you used in the video

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +3

      Thanks for the great feedback! Memorizing all the different libraries, syntax and approach to a problem simply comes down to practice. I think I have probably imported requests and BeautifulSoup over a thousand times :)

    • @luantorres3758
      @luantorres3758 4 ปีที่แล้ว

      @@MakeDataUseful amazing!! Thank you! ;)

    • @jj-in4yd
      @jj-in4yd 2 ปีที่แล้ว

      Eai mano sou do br tbm

  • @kudrah
    @kudrah ปีที่แล้ว +1

    I m learning python, this was so easy to understand, the logic of everything. I need more experience to be as confident as you.

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      Great to hear! Lots of practice and drop a comment if you have any questions

  • @dontjud6eme227
    @dontjud6eme227 4 ปีที่แล้ว

    Most helpful video I've watched on youtube. Been out of work for a while now. Thank you!

  • @johntelesengmec
    @johntelesengmec 9 หลายเดือนก่อน +1

    Simply, wonderful! Thanks, mate!

  • @Teyros
    @Teyros ปีที่แล้ว

    Wow! I learned a lot more than I thought from this. Well done! Didn't know about the Pandas thing. Pretty useful.

  • @lowata
    @lowata 4 ปีที่แล้ว +14

    Thank you for the videos. I am new to python and wanting to specialized with web scraping. Already working on Scrapy. Although your videos basically are with BeautifulSoup, I find your approaches are interesting and have lot to learn. Thank you for the videos and congratulation for achieving the target of 1K subs already. Best wishes for the 10K by the end of 2020.
    Cheers mate.

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +1

      Thank you Nashanthe! 10k is the new goal!! :D

  • @SurvivorIOKids
    @SurvivorIOKids ปีที่แล้ว +2

    You don't just got a subscriber, you earned my respect.😇

  • @tomymaster-100
    @tomymaster-100 4 หลายเดือนก่อน

    I started learning Python last year, but I have struggled because I have no experience or degree in this field.
    With my work schedule, I also find it hard to find time to continue
    However today I came across your tutorial, and your explanations are
    inspiring me to keep going with my Python course.

  • @christophercraig9295
    @christophercraig9295 ปีที่แล้ว

    I just found your series and I'm so excited to follow it. Thanks so much for putting this together, you've definitely got me as a subscriber. LOL 🙂

  • @patrickstingley4126
    @patrickstingley4126 ปีที่แล้ว +3

    This was great! It was very clear and easy to follow. Well done!

  • @breatheinbreatheout1980
    @breatheinbreatheout1980 ปีที่แล้ว +1

    Still learning Python and this video is so awesome. Thank you so much.

  • @battlecrushr1
    @battlecrushr1 4 ปีที่แล้ว +4

    This was amazing and easy to understand. So happy to have found your channel :)

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว +2

      Thanks Alameen! I try to come from a place of learning by doing :)

  • @KeiraraVT
    @KeiraraVT ปีที่แล้ว

    i love upwork. learning python this year has been a journey! thank you for this tutorial

  • @MdFathiRahmanBD
    @MdFathiRahmanBD 2 ปีที่แล้ว

    in these 30 mins, I didn't feel bored, really nice tutorial man!

  • @altaccount8749
    @altaccount8749 ปีที่แล้ว

    Thanks for shouting out new subscribers. I’m new in 2 years.

  • @Good-and-Geeky
    @Good-and-Geeky ปีที่แล้ว +1

    Like the way you showed your thinking as you processed the problem. I have Jupyter, not used it much yet. Definitely I should use it more.

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      Thank you, talking through problems helps when I get it wrong 😅 Definitely get back into Jupyter, there is so many cool things you can with Python 🤟

  • @asdasdasasdasdas9073
    @asdasdasasdasdas9073 3 ปีที่แล้ว +17

    Love the way you explain everything, very simple and patient. Awesome!

  • @change2change
    @change2change ปีที่แล้ว

    Awesome,sir ! I am a newbie to web scraping. This stuff is really important to analyse the information of a website. I am a Nepali guy. Do upload full Python Tutorials,too.

  • @beeohenji
    @beeohenji ปีที่แล้ว

    This is just amazing. I just started learning python yesterday. Thank you!

  • @simooudoun9073
    @simooudoun9073 3 ปีที่แล้ว

    Just started with web scraping and I absolutely love your videos

  • @shahalmoveed6191
    @shahalmoveed6191 3 ปีที่แล้ว

    Great work sir. we are looking for such an interesting and helpful video's in the future.

  • @joreilly
    @joreilly ปีที่แล้ว +10

    Great descriptions and breakdowns of your logic. I'm learning python as a structural engineer, it's tough to think so pragmatically but there's an impressive efficiency to it! Great video, look forward to checking out your others. 👍

    • @randomimmigrant348
      @randomimmigrant348 ปีที่แล้ว +1

      Also a structural engineer in Durban, South Africa. I'm learning python to automate some structural engineering calculations. Can't wait to try these methods out.

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      Thank you!

  • @gamerzparadise2355
    @gamerzparadise2355 2 ปีที่แล้ว

    Very well explained video, on how to do some simple web scraping. Looking forward to more content from this channel. 5 stars.😀

  • @danielmelek9348
    @danielmelek9348 9 หลายเดือนก่อน

    Thank you very much! It was a 30 mins well spent

  • @andrewspaulding7970
    @andrewspaulding7970 ปีที่แล้ว

    Very clear video. You make it look so easy! Subscribed!

  • @cybrMonk
    @cybrMonk 4 ปีที่แล้ว

    Cristal Clear buddy! Love that content! Keep pushing forward🤙🏽

  • @creatorZ02
    @creatorZ02 ปีที่แล้ว

    you are great, i really learned a lot from this video about how to do web scraping and more

  • @enzym2004
    @enzym2004 ปีที่แล้ว

    Great tutorial, picked up some great Python tips! =)

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      Glad to hear it! Lots more to come!! Have you checked out the latest end to end analytics tutorial. Some really fun stuff in there!

  • @amoljain3677
    @amoljain3677 4 ปีที่แล้ว

    You will grow big oneday !!
    Keep the good work on awesome videos.

  • @eduardom800
    @eduardom800 ปีที่แล้ว +1

    7000 subscribers later... thanks man. You have a very nice mind set.

  • @minhajex
    @minhajex ปีที่แล้ว

    You gained a new subscriber , I'll practice this right now .

  • @timlheds
    @timlheds ปีที่แล้ว

    I like what you did on that f-string. Very neat!

  • @oblakej
    @oblakej ปีที่แล้ว

    Awesome video mate 👍🏻 you have amazing teaching skills

  • @cianmcgovern720
    @cianmcgovern720 4 ปีที่แล้ว +1

    Great video. Really useful and actionable content! Subscribed.

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว

      Thanks for subscribing, I really appreciate it!

  • @HamzaAli-rt4pp
    @HamzaAli-rt4pp 2 ปีที่แล้ว

    Excellent Sir
    Please continue further

  • @Ahmedzicas
    @Ahmedzicas ปีที่แล้ว

    Thanks for your amazing tutorials, and the way you explain the code is bloooowing 👍👍👍

  • @epiconcommand5477
    @epiconcommand5477 4 ปีที่แล้ว

    Really nice video, it helped me a lot and you are doing great job. Also looking forward for some more videos related to this.

  • @TheWind5urfer
    @TheWind5urfer ปีที่แล้ว +1

    Thanks for all the useful tips, it works very well. My only problem is: When I transform my file into a csv, I do not get columns, just the values sepereated by commas. Can anybody help me, why that is?

  • @mariuspanaitescu7352
    @mariuspanaitescu7352 9 หลายเดือนก่อน

    I'm watching this, and just realized how much the upWork interface changed. It was much better looking, much cleaner back then. I'm not sure why they must change something that works.. probably for some developers to justify their jobs. Not to mention that 4 connects jobs are ancient history :)

  • @riccardoronco627
    @riccardoronco627 7 หลายเดือนก่อน

    wonderful explanation - thank you!

  • @arreak
    @arreak ปีที่แล้ว

    This tutorial was really cool! I love that your solution is exactly the same one i would have done

  • @smedley76
    @smedley76 ปีที่แล้ว

    I subscribed because of this series of videos. I'm really interested in learning the web scraping stuff. I've given it a shot on that website, not actually taking any paid work on, just looking at the details and seeing if I can do some hands on learning. I've been able to dig in but still have trouble spots. Right away I knew it needed to use headers because of response 403, the main issue I'm having is if I use find seems to work fine but only does one result, using find_all just gives an error. It works for some things just not what I want it to.

  • @JamesTyranski
    @JamesTyranski ปีที่แล้ว

    Found your channel, and this is great information to know how easy it can be to find coding projects.

  • @aliasi465
    @aliasi465 3 ปีที่แล้ว

    Subscribed and bell is on now. Waiting for more videos.

  • @RandomVideos-im4ue
    @RandomVideos-im4ue ปีที่แล้ว +2

    As we know there is "Welcome" word in every h1 heading so using that condition we can avoid errors on some variations like this
    if title.startswith("Welcome"):
    then write to the excel file
    else:
    continue

    • @onlyme0349
      @onlyme0349 ปีที่แล้ว

      how he has it right now he could include a log of all the pages that haven't been setup yet, for when the client needs an updated excel sheet in a few years

  • @hemrajpar
    @hemrajpar 4 ปีที่แล้ว +1

    Great Video Buddy Thanks for this :)

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว

      Hey no worries, thanks for the comment! :)

  • @jeffsinason4336
    @jeffsinason4336 4 ปีที่แล้ว +1

    Good video I subscribed to see more. Thank you

    • @MakeDataUseful
      @MakeDataUseful  4 ปีที่แล้ว

      Thank you! Plenty more to come :) I hope my balance of "getting the job done" and explaining why works for folk.

  • @popsyann
    @popsyann ปีที่แล้ว

    Your explanations make everything simple! Thanks

  • @cryptoevolution5250
    @cryptoevolution5250 3 ปีที่แล้ว

    You explain things well. Great video!

  • @rickrandazzo
    @rickrandazzo ปีที่แล้ว

    Looks like you hit your 1000.... great video!

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      I did :) Very happy and thank you!

  • @gunjankhanal7772
    @gunjankhanal7772 3 ปีที่แล้ว

    I love all your videos. Outstanding. Actually, I am familiar with scrapy. But BS is more easy I guess after seeing this video.

  • @magos2610
    @magos2610 3 ปีที่แล้ว

    Well composed, sir!!! Thanks for the great content!

  • @moheb_shia
    @moheb_shia ปีที่แล้ว

    Hi. The extract link in persian web site not work cause error 404 show an any data.

  • @sadiamchandio
    @sadiamchandio 4 ปีที่แล้ว +1

    This was really helpful!!!
    Kindly make more videos for monetising python skills.

  • @josesolis4124
    @josesolis4124 2 ปีที่แล้ว

    Love your video styles, thanks!

  • @johncello1703
    @johncello1703 ปีที่แล้ว +1

    Good job Big bro. But next time don't forget to put the links in the description....Thanks

  • @beethovennine
    @beethovennine ปีที่แล้ว

    Great vid! Subscribed

  • @boraaslan1890
    @boraaslan1890 ปีที่แล้ว +1

    this is a great guide!!!!!!!!!!!

  • @rblxPelez
    @rblxPelez ปีที่แล้ว +1

    Great video

  • @atultanna
    @atultanna 5 หลายเดือนก่อน

    Is it possible to code for keywords lsi keywords frequency keywords and phrases from first 2 URLs of a keywords in SE and extract them

  • @fernandogomes2514
    @fernandogomes2514 ปีที่แล้ว +1

    Excellent video

  • @thejellyman2280
    @thejellyman2280 ปีที่แล้ว +1

    Well done on the 1k subs . Just subd now and your at 30k+

  • @Rycidex
    @Rycidex ปีที่แล้ว +1

    Upwork is hard. Its very oversaturated now with many applicants for each job posting. Its hard to get picked when youre starting out. Do you have any tips?

  • @janered8047
    @janered8047 ปีที่แล้ว

    This series are great tutorial videos. Consider doing one about submitting a proposal, please. Thank you.

  • @QvsTheWorld
    @QvsTheWorld ปีที่แล้ว

    My first thought would be to check if they have a site map with all the id's or maybe an API that would let you get all the ID in json format.

    • @ianatkin542
      @ianatkin542 ปีที่แล้ว +2

      There is no sitemap for the portals in any format and their APIs are for other purposes, i.e. patient records. I did manage to ascertain that the portals run from 10 to almost 30000 with many gaps. The scheme is totally arbitrary. There is also an ad hoc versioning scheme (n, n-1, n-2, etc.) and some pages don't contain the name of the practice at all. Total time to grab every available clinic name runs to about 7 hours.

  • @CarlAshfield
    @CarlAshfield 4 ปีที่แล้ว +8

    Hey Man! Thanks for this. I have just started learning python last week. I've never coded before. so it's good to see how you can make money like this. Just a quick question - How long have you been using python and did you pick it up easy?

  • @mohamedyazanelsayed9335
    @mohamedyazanelsayed9335 ปีที่แล้ว

    Great explanations and information ❤❤

  • @freem4nn129
    @freem4nn129 ปีที่แล้ว

    Thanks ! Very clear and understandable !

  • @SajithBaskr
    @SajithBaskr 4 ปีที่แล้ว

    Very good work .. thanks

  • @sebacabj9502
    @sebacabj9502 4 ปีที่แล้ว

    You are GREAT, friend. My English is too bad, but you make yourself understood.
    There is not much material in Spanish on the subject. Thank you very much ! Do you have a website?

  • @piyushpatil495
    @piyushpatil495 ปีที่แล้ว

    But why do you have to go through other portals, as the portal name is already given their from which the data has to be extracted.

  • @mahmoudnabil4565
    @mahmoudnabil4565 2 ปีที่แล้ว

    Great work man

  • @SOFRADAKAOS
    @SOFRADAKAOS 3 ปีที่แล้ว

    very good content thanks for sharing !

  • @k.varetsa
    @k.varetsa ปีที่แล้ว

    That is amazing! Thanks!

    • @MakeDataUseful
      @MakeDataUseful  ปีที่แล้ว

      Most welcome! Checkout my latest video series for more cool stuff