Look here FIRST when trying to Scrape Data

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ก.พ. 2025

ความคิดเห็น • 21

  • @alexdin1565
    @alexdin1565 29 วันที่ผ่านมา +10

    Hi John,First of all, thank you for all your amazing content! It’s really helped me a lot.
    I’ve noticed recently that you're repeating some of the same content. I hope we get to see some new, more advanced topics soon, like using Docker or how we can run scrapers online. It would be awesome to dive deeper into these methods! Keep up the great work! 🙌

    • @danlee1027
      @danlee1027 26 วันที่ผ่านมา

      Agreed a few recent videos have been a bit repetitive but using different techniques and examples of different api calls.

  • @yamaha5722
    @yamaha5722 29 วันที่ผ่านมา +1

    Thanks mate for your content. I’m constantly watching it. All the best wishes for you!

  • @jnugent6293
    @jnugent6293 29 วันที่ผ่านมา +1

    You have taught me so incredibly much. Thank you.

  • @ivanleandroalvarez2727
    @ivanleandroalvarez2727 29 วันที่ผ่านมา +1

    Awesome video! I really enjoyed it, and I appreciate that it includes audio tracks in Spanish. Could you dive deeper into how to fetch data from an API that requires a token? It would be great to see a detailed explanation or example on that topic. Thanks!

  • @danlee1027
    @danlee1027 26 วันที่ผ่านมา

    Agreed on being surprised how easy to grab and find the direct API call the website front end uses to render full page. One of my websites i scrape has the api key exposed to make the API call. Lol.
    Could you show example of API or website using a POST call inserted of get? I tried converting a post call to cURL and got some garbage response...not a HTTP error.
    Great videos showing different ways doing similar things. I like variety of the data model storage techniques with their pros and cons. E.g. dataclasses, pydantic, pandas etc. Helpful.

  • @danlee1027
    @danlee1027 26 วันที่ผ่านมา

    Great video as usual John.
    I notice you switch between using the clli_lib and other TLS libraries and converting full request from cURL to requests. Do you recommend one over the other or try either and see which doesnt get blocked?

  • @Rapid1898
    @Rapid1898 25 วันที่ผ่านมา

    Can i somewhere see the full code from this video?

  • @bakasenpaidesu
    @bakasenpaidesu 29 วันที่ผ่านมา +3

    I want hx editor Configuration for python and golang video plzzz 🙏

    • @cybern9ne
      @cybern9ne 25 วันที่ผ่านมา

      first install helix and helix-grammers. then run hx --health and install anything marked with a red x. for python, it will be rust. go needs go-plus and dlv. fyl debugger do not work well in helix. run helix --health again to make sure the red x's changed to green check marks.

  • @obiwanfisher537
    @obiwanfisher537 29 วันที่ผ่านมา +1

    I always try to use that method but so far haven't got lucky. Or maybe I do something wrong when I look for that json gold. But the method is sound.

    • @JohnWatsonRooney
      @JohnWatsonRooney  29 วันที่ผ่านมา

      It doesn’t work everywhere but I always check it first as if it does it makes life easy

    • @obiwanfisher537
      @obiwanfisher537 28 วันที่ผ่านมา

      @@JohnWatsonRooney Does it work on airbnb? Really just need a yes and no answer here lol Because I tried it multiple times on airbnb.

  • @mihhailkapustin7886
    @mihhailkapustin7886 29 วันที่ผ่านมา +1

    What browser are you using?

    • @JohnWatsonRooney
      @JohnWatsonRooney  29 วันที่ผ่านมา +1

      It’s librewolf which is Firefox based. I prefer Firefox to chrome

  • @braincandy623
    @braincandy623 29 วันที่ผ่านมา +1

    What do you think of tools like selenium-wire and mitmproxy for uncovering hidden API endpoints?

    • @JohnWatsonRooney
      @JohnWatsonRooney  29 วันที่ผ่านมา +1

      Can be very useful I think selenium wire is archived now, but mitm is necessary when scraping mobile apps for sure

  • @JNET_Reloaded
    @JNET_Reloaded 29 วันที่ผ่านมา

    1st of all this ps is a trile and also it only works with ipv4 I have ipv6 only ! so Il doube anyone will "look here 1st" :/

    • @cybern9ne
      @cybern9ne 25 วันที่ผ่านมา

      what!?