Hi John,First of all, thank you for all your amazing content! It’s really helped me a lot. I’ve noticed recently that you're repeating some of the same content. I hope we get to see some new, more advanced topics soon, like using Docker or how we can run scrapers online. It would be awesome to dive deeper into these methods! Keep up the great work! 🙌
Awesome video! I really enjoyed it, and I appreciate that it includes audio tracks in Spanish. Could you dive deeper into how to fetch data from an API that requires a token? It would be great to see a detailed explanation or example on that topic. Thanks!
Agreed on being surprised how easy to grab and find the direct API call the website front end uses to render full page. One of my websites i scrape has the api key exposed to make the API call. Lol. Could you show example of API or website using a POST call inserted of get? I tried converting a post call to cURL and got some garbage response...not a HTTP error. Great videos showing different ways doing similar things. I like variety of the data model storage techniques with their pros and cons. E.g. dataclasses, pydantic, pandas etc. Helpful.
Great video as usual John. I notice you switch between using the clli_lib and other TLS libraries and converting full request from cURL to requests. Do you recommend one over the other or try either and see which doesnt get blocked?
first install helix and helix-grammers. then run hx --health and install anything marked with a red x. for python, it will be rust. go needs go-plus and dlv. fyl debugger do not work well in helix. run helix --health again to make sure the red x's changed to green check marks.
Hi John,First of all, thank you for all your amazing content! It’s really helped me a lot.
I’ve noticed recently that you're repeating some of the same content. I hope we get to see some new, more advanced topics soon, like using Docker or how we can run scrapers online. It would be awesome to dive deeper into these methods! Keep up the great work! 🙌
Agreed a few recent videos have been a bit repetitive but using different techniques and examples of different api calls.
Thanks mate for your content. I’m constantly watching it. All the best wishes for you!
You have taught me so incredibly much. Thank you.
Awesome video! I really enjoyed it, and I appreciate that it includes audio tracks in Spanish. Could you dive deeper into how to fetch data from an API that requires a token? It would be great to see a detailed explanation or example on that topic. Thanks!
Agreed on being surprised how easy to grab and find the direct API call the website front end uses to render full page. One of my websites i scrape has the api key exposed to make the API call. Lol.
Could you show example of API or website using a POST call inserted of get? I tried converting a post call to cURL and got some garbage response...not a HTTP error.
Great videos showing different ways doing similar things. I like variety of the data model storage techniques with their pros and cons. E.g. dataclasses, pydantic, pandas etc. Helpful.
Great video as usual John.
I notice you switch between using the clli_lib and other TLS libraries and converting full request from cURL to requests. Do you recommend one over the other or try either and see which doesnt get blocked?
Can i somewhere see the full code from this video?
I want hx editor Configuration for python and golang video plzzz 🙏
first install helix and helix-grammers. then run hx --health and install anything marked with a red x. for python, it will be rust. go needs go-plus and dlv. fyl debugger do not work well in helix. run helix --health again to make sure the red x's changed to green check marks.
I always try to use that method but so far haven't got lucky. Or maybe I do something wrong when I look for that json gold. But the method is sound.
It doesn’t work everywhere but I always check it first as if it does it makes life easy
@@JohnWatsonRooney Does it work on airbnb? Really just need a yes and no answer here lol Because I tried it multiple times on airbnb.
What browser are you using?
It’s librewolf which is Firefox based. I prefer Firefox to chrome
What do you think of tools like selenium-wire and mitmproxy for uncovering hidden API endpoints?
Can be very useful I think selenium wire is archived now, but mitm is necessary when scraping mobile apps for sure
1st of all this ps is a trile and also it only works with ipv4 I have ipv6 only ! so Il doube anyone will "look here 1st" :/
what!?